2026-03-29 20:00:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 20:00:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 20:00:04 [motorway.uk] INFO: Batch mode enabled: batch 1/4
2026-03-29 20:00:04 [motorway.uk] INFO: Starting spider motorway.uk
2026-03-29 20:00:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 20:00:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 20:00:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 20:00:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 20:00:04 [scrapy.extensions.telnet] INFO: Telnet Password: 8022fb926e0f1a95
2026-03-29 20:00:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-29 20:00:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/motorway.uk/task_1_2026-03-29T20_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-29 20:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 20:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 20:00:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 20:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 20:00:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 20:00:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-29 20:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 20:00:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2123
2026-03-29 20:00:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 20:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 20:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 20:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 20:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 20:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 20:00:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 20:00:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 20:00:05 [scrapy.core.engine] INFO: Spider opened
2026-03-29 20:00:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 20:00:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 20:00:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-29 20:00:05 [scrapy-playwright] INFO: Starting download handler
2026-03-29 20:00:05 [scrapy-playwright] INFO: Starting download handler
2026-03-29 20:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://pro.motorway.co.uk/api/login> (referer: None) ['zyte-api']
2026-03-29 20:00:13 [motorway.uk] INFO: Scrapy-formatted cookies: [{'name': 'access-token', 'value': 'eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ2ZXJzaW9uIjoyLCJpZCI6ODQyOSwibmFtZSI6IlNhbmogS3Jpc2huYXNhbXkiLCJlbWFpbCI6ImluZm9Ac2tkaXJlY3QuY28udWsiLCJmZWF0dXJlcyI6eyJzZWxsZXJCYW5rU3RhdGVtZW50Ijp0cnVlLCJTRUxMRVJfUkVFTlRSWSI6dHJ1ZSwiRE9DVU1FTlRTX1BST0dSRVNTSVZFX1VQTE9BRCI6dHJ1ZSwiZG9jdW1lbnRDYXB0dXJlVjIiOmZhbHNlLCJwYXltZW50c01WUCI6ZmFsc2UsInBheW1lbnRzSGlkZVNlbGxlckJhbmtEZXRhaWxzIjpmYWxzZSwicGF5bWVudHNLWUMiOmZhbHNlLCJwYXltZW50c012cFRyYW5zYWN0aW9uU3RhdGVtZW50Ijp0cnVlLCJwYXltZW50c0ZlZUNvbGxlY3Rpb24iOmZhbHNlfSwiaGFzSW52b2ljZUFjY2VzcyI6dHJ1ZSwicGhvbmUiOiIwNzc4NzU3ODIxMSIsIm90cFBob25lIjpudWxsLCJwaG9uZUNvbmZpcm1lZEF0IjpudWxsLCJkZWFsZXJOYW1lIjoiUyBLIERpcmVjdCIsImRlYWxlcklzVHJhZGUiOmZhbHNlLCJwcmltYXJ5Q29udGFjdCI6dHJ1ZSwiZGVhbGVySWQiOjgyMjMsImRlYWxlclN0YXR1cyI6eyJzbHVnIjoiaW5hY3RpdmUiLCJiaWRkaW5nRW5hYmxlZCI6dHJ1ZX0sImxhdGl0dWRlIjo1MS42MDE4MTkxLCJsb25naXR1ZGUiOi0wLjY3NzYxNTgsInBvc3Rjb2RlIjoiSFAxMDBOTiIsInBhcnRuZXJzIjpbXSwiaWRlbnRpdHkiOiJleUpoYkdjaU9pSklVekkxTmlJc0luUjVjQ0k2SWtwWFZDSjkuZXlKcFpHVnVkR2wwYVdWeklqcGJleUpwWkNJNk9EUXlPU3dpWlcxaGFXd2lPaUpwYm1adlFITnJaR2x5WldOMExtTnZMblZySWl3aWRIbHdaU0k2SW1SbFlXeGxjaUlzSW1WNGNHbHlaWE1pT2lJeU1ESTJMVEEwTFRJNFZESXdPakF3T2pFeExqWTBPRm9pTENKd1lYSjBibVZ5Y3lJNlcxMTlYU3dpYVdGMElqb3hOemMwT0RFME5ERXhmUS5nZWE3bXYtUDRjajhjTkdWU0cwdlQzekMzZnJsN055VnNUUFVHME05VlJjIiwiZGVhbGVyUGVybWlzc2lvbnMiOlsiaW52b2ljaW5nIiwia3ljIl0sInJlZnJlc2hUb2tlbiI6ImJjZGQ4OTQ2NjUwYzFlMDVmZTdlMWJhZTdhZjI2NTQzMDlmMjE5NTU2ZTczOTc2NGJmOWE3NGFmNWIwZTdmMjMiLCJkZWFsZXJUaWVyIjoic2VsZi1zZXJ2ZSIsImlzc3VlZEF0IjoxNzc0ODE0NDEyOTY3LCJpYXQiOjE3NzQ4MTQ0MTIsImV4cCI6MTc3NDgxNDcxMn0.HAf95TIRy3Ti7RebartVhO7OAOZDPVOWLf_mldm8UHE', 'domain': '.motorway.co.uk', 'path': '/'}]
2026-03-29 20:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk> (referer: https://pro.motorway.co.uk/api/login) ['zyte-api']
2026-03-29 20:00:15 [motorway.uk] INFO: Extracted Build ID: gL_OFaxoLv6tVLfo6F2-N
2026-03-29 20:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=buyItNow&loadedCount=0&page=0&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=0&page=0&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20210884
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 18349632
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20491343
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 19335779
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20478384
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720478384%27 HTTP/1.1" 200 None
2026-03-29 20:00:17 [motorway.uk] INFO: Scrape type for 20478384: 1
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20420964
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 19293050
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 11469561
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711469561%27 HTTP/1.1" 200 None
2026-03-29 20:00:17 [motorway.uk] INFO: Scrape type for 11469561: 1
2026-03-29 20:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 16791811
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 16345921
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716345921%27 HTTP/1.1" 200 None
2026-03-29 20:00:17 [motorway.uk] INFO: Scrape type for 16345921: 0
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20501784
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20434421
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720434421%27 HTTP/1.1" 200 None
2026-03-29 20:00:17 [motorway.uk] INFO: Scrape type for 20434421: 2
2026-03-29 20:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20406874
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20486638
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 15631500
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 19204416
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20462868
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720462868%27 HTTP/1.1" 200 None
2026-03-29 20:00:17 [motorway.uk] INFO: Scrape type for 20462868: 1
2026-03-29 20:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20403112
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720403112%27 HTTP/1.1" 200 None
2026-03-29 20:00:17 [motorway.uk] INFO: Scrape type for 20403112: 1
2026-03-29 20:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20380533
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20438346
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 18341236
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 19960036
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 19356442
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719356442%27 HTTP/1.1" 200 None
2026-03-29 20:00:17 [motorway.uk] INFO: Scrape type for 19356442: 1
2026-03-29 20:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20217457
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20183041
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 17833819
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717833819%27 HTTP/1.1" 200 None
2026-03-29 20:00:17 [motorway.uk] INFO: Scrape type for 17833819: 1
2026-03-29 20:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 6235966
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 8799286
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278799286%27 HTTP/1.1" 200 None
2026-03-29 20:00:17 [motorway.uk] INFO: Scrape type for 8799286: 1
2026-03-29 20:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 12116877
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20485059
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 14687227
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20371220
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20221411
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20482651
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 20414596
2026-03-29 20:00:17 [motorway.uk] INFO: Found listing with ID: 13957348
2026-03-29 20:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20462868.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19356442.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb with identifier: 20462868
2026-03-29 20:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb with scrape type 1
2026-03-29 20:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2868%252F20462868%252Fexterior_front_driver-1774613347113.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2868/20462868/exterior_front_driver-1774613347113.jpeg not downloaded yet
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2868%252F20462868%252Fexterior_rear_driver-1774613397923.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2868/20462868/exterior_rear_driver-1774613397923.jpeg not downloaded yet
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2868%252F20462868%252Fexterior_front_passenger-1774613376197.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2868/20462868/exterior_front_passenger-1774613376197.jpeg not downloaded yet
2026-03-29 20:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ccd09e0-6789-59e0-a6d0-99258b518177 with identifier: 19356442
2026-03-29 20:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ccd09e0-6789-59e0-a6d0-99258b518177 with scrape type 1
2026-03-29 20:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ccd09e0-6789-59e0-a6d0-99258b518177
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6442%252F19356442%252F19356442-exterior_front_driver-modified-1774781471972.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6442/19356442/19356442-exterior_front_driver-modified-1774781471972.jpeg not downloaded yet
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2868%252F20462868%252Fexterior_rear_passenger-1774613388998.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2868/20462868/exterior_rear_passenger-1774613388998.jpeg not downloaded yet
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6442%252F19356442%252F19356442-exterior_rear_driver-modified-1774781480975.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6442/19356442/19356442-exterior_rear_driver-modified-1774781480975.jpeg not downloaded yet
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2868%252F20462868%252Finterior_front_seats-1774613418045.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2868/20462868/interior_front_seats-1774613418045.jpeg not downloaded yet
2026-03-29 20:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6442%252F19356442%252Fexterior_front_passenger-1769343988717.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6442/19356442/exterior_front_passenger-1769343988717.jpeg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2868%252F20462868%252Finterior_rear_seats-1774613453582.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2868/20462868/interior_rear_seats-1774613453582.jpeg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6442%252F19356442%252F19356442-exterior_rear_passenger-modified-1774781461999.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6442/19356442/19356442-exterior_rear_passenger-modified-1774781461999.jpeg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2868%252F20462868%252Finterior_dashboard-1774613479447.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2868/20462868/interior_dashboard-1774613479447.jpeg not downloaded yet
2026-03-29 20:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11469561.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6442%252F19356442%252Finterior_front_seats-1769344070183.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6442/19356442/interior_front_seats-1769344070183.jpeg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2868%252F20462868%252Finstrument_cluster-1774613571604.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2868/20462868/instrument_cluster-1774613571604.jpeg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6442%252F19356442%252Finterior_rear_seats-1769344091328.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6442/19356442/interior_rear_seats-1769344091328.jpeg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2868%252F20462868%252Finterior_boot-1774613484986.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2868/20462868/interior_boot-1774613484986.jpeg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6442%252F19356442%252F19356442-interior_dashboard-modified-1774781448883.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6442/19356442/19356442-interior_dashboard-modified-1774781448883.jpeg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2868%252F20462868%252F20462868-docs_service_history-modified-1774778381775.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbf61b93e980baebe9d9d7f4d004c4969%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2868/20462868/20462868-docs_service_history-modified-1774778381775.jpeg?ixlib=js-3.8.0&auto=format&s=bf61b93e980baebe9d9d7f4d004c4969 not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6442%252F19356442%252Finterior_boot-1769344173986.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6442/19356442/interior_boot-1769344173986.jpeg not downloaded yet
2026-03-29 20:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 244ec632-8d9e-544f-8af4-ceadfb862ded with identifier: 11469561
2026-03-29 20:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 244ec632-8d9e-544f-8af4-ceadfb862ded with scrape type 1
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 244ec632-8d9e-544f-8af4-ceadfb862ded
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9561%252F11469561%252Fexterior_front_driver-1774610492099.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9561/11469561/exterior_front_driver-1774610492099.jpeg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F6442%252F19356442%252Fdocs_service_history-1769344374379.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D88ca25d199776114f49fcfc9b92ab320%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/6442/19356442/docs_service_history-1769344374379.jpeg?ixlib=js-3.8.0&auto=format&s=88ca25d199776114f49fcfc9b92ab320 not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9561%252F11469561%252Fexterior_rear_driver-1774610544119.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9561/11469561/exterior_rear_driver-1774610544119.jpeg not downloaded yet
2026-03-29 20:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20403112.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F6442%252F19356442%252Fdocs_service_history-1769344379599.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D554bce09c4be2d3ce11fe92a62a889a4%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/6442/19356442/docs_service_history-1769344379599.jpeg?ixlib=js-3.8.0&auto=format&s=554bce09c4be2d3ce11fe92a62a889a4 not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9561%252F11469561%252Fexterior_front_passenger-1774610508626.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9561/11469561/exterior_front_passenger-1774610508626.jpeg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9561%252F11469561%252Fexterior_rear_passenger-1774610527429.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9561/11469561/exterior_rear_passenger-1774610527429.jpeg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9561%252F11469561%252Finterior_front_seats-1774610779202.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9561/11469561/interior_front_seats-1774610779202.jpeg not downloaded yet
2026-03-29 20:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20478384.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9561%252F11469561%252Finterior_rear_seats-1774610860551.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9561/11469561/interior_rear_seats-1774610860551.jpeg not downloaded yet
2026-03-29 20:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20434421.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9561%252F11469561%252Finterior_dashboard-1774610901646.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9561/11469561/interior_dashboard-1774610901646.jpeg not downloaded yet
2026-03-29 20:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b251acd2-fc59-5fbb-93d3-90d63a7c0528 with identifier: 20403112
2026-03-29 20:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b251acd2-fc59-5fbb-93d3-90d63a7c0528 with scrape type 1
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b251acd2-fc59-5fbb-93d3-90d63a7c0528
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3112%252F20403112%252Fexterior_front_driver-1774707016329.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3112/20403112/exterior_front_driver-1774707016329.jpg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9561%252F11469561%252Finstrument_cluster-1774610962111.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9561/11469561/instrument_cluster-1774610962111.jpeg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3112%252F20403112%252Fexterior_rear_driver-1774707012894.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3112/20403112/exterior_rear_driver-1774707012894.jpg not downloaded yet
2026-03-29 20:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2868/20462868/exterior_rear_driver-1774613397923.jpeg> (referer: None)
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9561%252F11469561%252Finterior_boot-1774610912632.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9561/11469561/interior_boot-1774610912632.jpeg not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3112%252F20403112%252Fexterior_front_passenger-1774707024914.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3112/20403112/exterior_front_passenger-1774707024914.jpg not downloaded yet
2026-03-29 20:00:21 [motorway.uk] ERROR: Error parsing details
Traceback (most recent call last):
File "/usr/src/app/crawlers/spiders/motorway.py", line 262, in parse_details
item = self._extract_listing_item(detail_data, auction_type)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 290, in _extract_listing_item
trim = self._extract_trim(detail_data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 476, in _extract_trim
.replace(model, "")
^^^^^^^^^^^^^^^^^^
TypeError: replace() argument 1 must be str, not None
2026-03-29 20:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe48c54-41a4-5553-915a-fcc5f90f4ddc with identifier: 20434421
2026-03-29 20:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe48c54-41a4-5553-915a-fcc5f90f4ddc with scrape type 2
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fe48c54-41a4-5553-915a-fcc5f90f4ddc with scrape type 2
2026-03-29 20:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5fe48c54-41a4-5553-915a-fcc5f90f4ddc, identifier: 20434421
2026-03-29 20:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2868/20462868/exterior_rear_passenger-1774613388998.jpeg> (referer: None)
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9561%252F11469561%252Fdocs_service_history-1774620842322.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9be64db6adfd2499fe1237086b401c4e%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9561/11469561/docs_service_history-1774620842322.jpeg?ixlib=js-3.8.0&auto=format&s=9be64db6adfd2499fe1237086b401c4e not downloaded yet
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3112%252F20403112%252Fexterior_rear_passenger-1774707008403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3112/20403112/exterior_rear_passenger-1774707008403.jpg not downloaded yet
2026-03-29 20:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5fe48c54-41a4-5553-915a-fcc5f90f4ddc with identifier: 20434421
2026-03-29 20:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Orange HTTP/1.1" 200 None
2026-03-29 20:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2026-03-29 20:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5fe48c54-41a4-5553-915a-fcc5f90f4ddc with identifier: 20434421
2026-03-29 20:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5fe48c54-41a4-5553-915a-fcc5f90f4ddc with identifier: 20434421 to the API
2026-03-29 20:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20434421.json>
{'auction_title': '',
'category': None,
'color': 'Orange',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '5fe48c54-41a4-5553-915a-fcc5f90f4ddc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY74 SXU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20434421',
'listing': 'auction',
'location': 'Dorset Poole',
'make': 'Volkswagen',
'model': 'Other Volkswagen',
'odometer': 8630,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 36500,
'price_includes_vat': False,
'registration_date': '2024-11-06',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen ID Buzz Life',
'transmission': 'automatic',
'trim': 'ID Buzz Life',
'vin': 'WV2ZZZEB1SH000557',
'year': 2024}
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720434421%27 HTTP/1.1" 200 None
2026-03-29 20:00:24 [motorway.uk] INFO: Saving data for 20434421: {'auction_closing_time': 1774884600.0, 'created_time': 1774556431.862212, 'last_price_update_time': 1774814424.399301}
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20434421') HTTP/1.1" 204 0
2026-03-29 20:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2868/20462868/exterior_front_passenger-1774613376197.jpeg> (referer: None)
2026-03-29 20:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17833819.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3112%252F20403112%252Finterior_front_seats-1774707261780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3112/20403112/interior_front_seats-1774707261780.jpg not downloaded yet
2026-03-29 20:00:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-29 20:00:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-29 20:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae2ebd0>
2026-03-29 20:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2123
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb/bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2868%252F20462868%252Fexterior_rear_driver-1774613397923.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2868/20462868/exterior_rear_driver-1774613397923.jpeg saved to cache
2026-03-29 20:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb
2026-03-29 20:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=36&page=1&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3112%252F20403112%252Finterior_rear_seats-1774707276245.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3112/20403112/interior_rear_seats-1774707276245.jpg not downloaded yet
2026-03-29 20:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa1fc90>
2026-03-29 20:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb/bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2868%252F20462868%252Fexterior_rear_passenger-1774613388998.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2868/20462868/exterior_rear_passenger-1774613388998.jpeg saved to cache
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3112%252F20403112%252Finterior_dashboard-1774707304210.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3112/20403112/interior_dashboard-1774707304210.jpg not downloaded yet
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d7fd0>
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb/bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2868%252F20462868%252Fexterior_front_passenger-1774613376197.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2868/20462868/exterior_front_passenger-1774613376197.jpeg saved to cache
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb
2026-03-29 20:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f939146-2168-504e-a532-1da1a3547cb6 with identifier: 17833819
2026-03-29 20:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f939146-2168-504e-a532-1da1a3547cb6 with scrape type 1
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5f939146-2168-504e-a532-1da1a3547cb6
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3819%252F17833819%252Fexterior_front_driver-1771685621254.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3819/17833819/exterior_front_driver-1771685621254.jpg not downloaded yet
2026-03-29 20:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2868/20462868/exterior_front_driver-1774613347113.jpeg> (referer: None)
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3112%252F20403112%252Finstrument_cluster-1774707491455.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3112/20403112/instrument_cluster-1774707491455.jpg not downloaded yet
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3819%252F17833819%252Fexterior_rear_driver-1771685564888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3819/17833819/exterior_rear_driver-1771685564888.jpg not downloaded yet
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 12213512
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20488190
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20491954
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 18395283
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718395283%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [motorway.uk] INFO: Scrape type for 18395283: 1
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3112%252F20403112%252Finterior_boot-1774707330159.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3112/20403112/interior_boot-1774707330159.jpg not downloaded yet
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3819%252F17833819%252Fexterior_front_passenger-1771685596461.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3819/17833819/exterior_front_passenger-1771685596461.jpg not downloaded yet
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20007284
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720007284%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [motorway.uk] INFO: Scrape type for 20007284: 0
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 10801992
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710801992%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [motorway.uk] INFO: Scrape type for 10801992: 1
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3112%252F20403112%252Fdocs_service_history-1774707535905.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dda74ff73a292ac8000e899a1d57321f2%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3112/20403112/docs_service_history-1774707535905.jpg?ixlib=js-3.8.0&auto=format&s=da74ff73a292ac8000e899a1d57321f2 not downloaded yet
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3819%252F17833819%252Fexterior_rear_passenger-1771685587627.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3819/17833819/exterior_rear_passenger-1771685587627.jpg not downloaded yet
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 19925917
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 19874916
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20226377
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20343618
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 19943436
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719943436%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [motorway.uk] INFO: Scrape type for 19943436: 1
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae3f790>
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb/bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2868%252F20462868%252Fexterior_front_driver-1774613347113.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2868/20462868/exterior_front_driver-1774613347113.jpeg saved to cache
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3819%252F17833819%252Finterior_front_seats-1774781790787.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3819/17833819/interior_front_seats-1774781790787.jpg not downloaded yet
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20452938
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 17257209
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20481812
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 19560308
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20485589
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20425191
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720425191%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [motorway.uk] INFO: Scrape type for 20425191: 1
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3819%252F17833819%252Finterior_rear_seats-1771687286137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3819/17833819/interior_rear_seats-1771687286137.jpg not downloaded yet
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 9396121
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 19478931
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20428242
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20451701
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720451701%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [motorway.uk] INFO: Scrape type for 20451701: 1
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3819%252F17833819%252Finterior_dashboard-1771689022903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3819/17833819/interior_dashboard-1771689022903.jpg not downloaded yet
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20458099
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 15842916
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715842916%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [motorway.uk] INFO: Scrape type for 15842916: 1
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3819%252F17833819%252Finterior_boot-1771687382668.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3819/17833819/interior_boot-1771687382668.jpg not downloaded yet
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20460677
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 18909824
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20468920
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 9709918
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20449963
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720449963%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [motorway.uk] INFO: Scrape type for 20449963: 1
2026-03-29 20:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6442/19356442/exterior_front_passenger-1769343988717.jpeg> (referer: None)
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3819%252F17833819%252Fdamage_scratches-1771685684528.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3819/17833819/damage_scratches-1771685684528.jpg not downloaded yet
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 16442218
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20468049
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 18710113
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 9721294
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20454912
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720454912%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [motorway.uk] INFO: Scrape type for 20454912: 1
2026-03-29 20:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6442/19356442/19356442-exterior_front_driver-modified-1774781471972.jpeg> (referer: None)
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3819%252F17833819%252Fwheels_front_driver-1771685783142.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3819/17833819/wheels_front_driver-1771685783142.jpg not downloaded yet
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 10856544
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710856544%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [motorway.uk] INFO: Scrape type for 10856544: 1
2026-03-29 20:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 20471927
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471927%27 HTTP/1.1" 200 None
2026-03-29 20:00:25 [motorway.uk] INFO: Scrape type for 20471927: 1
2026-03-29 20:00:25 [motorway.uk] INFO: Found listing with ID: 18459962
2026-03-29 20:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3112/20403112/exterior_rear_driver-1774707012894.jpg> (referer: None)
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9675010>
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccd09e0-6789-59e0-a6d0-99258b518177/9ccd09e0-6789-59e0-a6d0-99258b518177_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6442%252F19356442%252Fexterior_front_passenger-1769343988717.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6442/19356442/exterior_front_passenger-1769343988717.jpeg saved to cache
2026-03-29 20:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ccd09e0-6789-59e0-a6d0-99258b518177
2026-03-29 20:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9671950>
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccd09e0-6789-59e0-a6d0-99258b518177/9ccd09e0-6789-59e0-a6d0-99258b518177_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6442%252F19356442%252F19356442-exterior_front_driver-modified-1774781471972.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6442/19356442/19356442-exterior_front_driver-modified-1774781471972.jpeg saved to cache
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ccd09e0-6789-59e0-a6d0-99258b518177
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0b5dd0>
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b251acd2-fc59-5fbb-93d3-90d63a7c0528/b251acd2-fc59-5fbb-93d3-90d63a7c0528_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3112%252F20403112%252Fexterior_rear_driver-1774707012894.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3112/20403112/exterior_rear_driver-1774707012894.jpg saved to cache
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b251acd2-fc59-5fbb-93d3-90d63a7c0528
2026-03-29 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3112/20403112/exterior_rear_passenger-1774707008403.jpg> (referer: None)
2026-03-29 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2868/20462868/interior_rear_seats-1774613453582.jpeg> (referer: None)
2026-03-29 20:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3112/20403112/exterior_front_passenger-1774707024914.jpg> (referer: None)
2026-03-29 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6442/19356442/19356442-exterior_rear_driver-modified-1774781480975.jpeg> (referer: None)
2026-03-29 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3112/20403112/interior_dashboard-1774707304210.jpg> (referer: None)
2026-03-29 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2868/20462868/interior_front_seats-1774613418045.jpeg> (referer: None)
2026-03-29 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/6442/19356442/docs_service_history-1769344374379.jpeg?ixlib=js-3.8.0&auto=format&s=88ca25d199776114f49fcfc9b92ab320> (referer: None)
2026-03-29 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9561/11469561/exterior_rear_passenger-1774610527429.jpeg> (referer: None)
2026-03-29 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6442/19356442/19356442-exterior_rear_passenger-modified-1774781461999.jpeg> (referer: None)
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9697690>
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b251acd2-fc59-5fbb-93d3-90d63a7c0528/b251acd2-fc59-5fbb-93d3-90d63a7c0528_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3112%252F20403112%252Fexterior_rear_passenger-1774707008403.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3112/20403112/exterior_rear_passenger-1774707008403.jpg saved to cache
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b251acd2-fc59-5fbb-93d3-90d63a7c0528
2026-03-29 20:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3112/20403112/interior_front_seats-1774707261780.jpg> (referer: None)
2026-03-29 20:00:26 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:00:26 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:00:26 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00)g\x04\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02 \x89\x00)\\f\x00\x00\x00\x00'
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93e2890>
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb/bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2868%252F20462868%252Finterior_rear_seats-1774613453582.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2868/20462868/interior_rear_seats-1774613453582.jpeg saved to cache
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9380d90>
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b251acd2-fc59-5fbb-93d3-90d63a7c0528/b251acd2-fc59-5fbb-93d3-90d63a7c0528_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3112%252F20403112%252Fexterior_front_passenger-1774707024914.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3112/20403112/exterior_front_passenger-1774707024914.jpg saved to cache
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b251acd2-fc59-5fbb-93d3-90d63a7c0528
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9316310>
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccd09e0-6789-59e0-a6d0-99258b518177/9ccd09e0-6789-59e0-a6d0-99258b518177_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6442%252F19356442%252F19356442-exterior_rear_driver-modified-1774781480975.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6442/19356442/19356442-exterior_rear_driver-modified-1774781480975.jpeg saved to cache
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ccd09e0-6789-59e0-a6d0-99258b518177
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9382010>
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b251acd2-fc59-5fbb-93d3-90d63a7c0528/b251acd2-fc59-5fbb-93d3-90d63a7c0528_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3112%252F20403112%252Finterior_dashboard-1774707304210.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3112/20403112/interior_dashboard-1774707304210.jpg saved to cache
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b251acd2-fc59-5fbb-93d3-90d63a7c0528
2026-03-29 20:00:26 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:00:26 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:00:26 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000\x82\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xa5\xa3\x000x"\x00\x00\x00\x00'
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9303750>
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb/bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2868%252F20462868%252Finterior_front_seats-1774613418045.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2868/20462868/interior_front_seats-1774613418045.jpeg saved to cache
2026-03-29 20:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbc216a4-e7ce-5d1c-9683-a2d20bb2bdbb
2026-03-29 20:00:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:00:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f931dd90>
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccd09e0-6789-59e0-a6d0-99258b518177/9ccd09e0-6789-59e0-a6d0-99258b518177_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F6442%252F19356442%252Fdocs_service_history-1769344374379.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D88ca25d199776114f49fcfc9b92ab320') HTTP/1.1" 204 0
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/6442/19356442/docs_service_history-1769344374379.jpeg?ixlib=js-3.8.0&auto=format&s=88ca25d199776114f49fcfc9b92ab320 saved to cache
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9ccd09e0-6789-59e0-a6d0-99258b518177
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f931d310>
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_244ec632-8d9e-544f-8af4-ceadfb862ded/244ec632-8d9e-544f-8af4-ceadfb862ded_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9561%252F11469561%252Fexterior_rear_passenger-1774610527429.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9561/11469561/exterior_rear_passenger-1774610527429.jpeg saved to cache
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 244ec632-8d9e-544f-8af4-ceadfb862ded
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9310690>
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ccd09e0-6789-59e0-a6d0-99258b518177/9ccd09e0-6789-59e0-a6d0-99258b518177_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6442%252F19356442%252F19356442-exterior_rear_passenger-modified-1774781461999.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6442/19356442/19356442-exterior_rear_passenger-modified-1774781461999.jpeg saved to cache
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ccd09e0-6789-59e0-a6d0-99258b518177
2026-03-29 20:00:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96d5d90>
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b251acd2-fc59-5fbb-93d3-90d63a7c0528/b251acd2-fc59-5fbb-93d3-90d63a7c0528_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3112%252F20403112%252Finterior_front_seats-1774707261780.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3112/20403112/interior_front_seats-1774707261780.jpg saved to cache
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b251acd2-fc59-5fbb-93d3-90d63a7c0528
2026-03-29 20:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=72&page=2&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9561/11469561/interior_boot-1774610912632.jpeg> (referer: None)
2026-03-29 20:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8799286.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 6579411
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 18288929
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 10230435
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 20413878
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720413878%27 HTTP/1.1" 200 None
2026-03-29 20:00:27 [motorway.uk] INFO: Scrape type for 20413878: 2
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 20489985
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 20266437
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720266437%27 HTTP/1.1" 200 None
2026-03-29 20:00:27 [motorway.uk] INFO: Scrape type for 20266437: 1
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 18704338
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 20479276
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 13909960
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713909960%27 HTTP/1.1" 200 None
2026-03-29 20:00:27 [motorway.uk] INFO: Scrape type for 13909960: 1
2026-03-29 20:00:27 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:00:27 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:00:27 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00!\xde9\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xa6\xc3\x00!\xd4\xb3\x00\x00\x00\x00'
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f937d0d0>
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_244ec632-8d9e-544f-8af4-ceadfb862ded/244ec632-8d9e-544f-8af4-ceadfb862ded_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9561%252F11469561%252Finterior_boot-1774610912632.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9561/11469561/interior_boot-1774610912632.jpeg saved to cache
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 244ec632-8d9e-544f-8af4-ceadfb862ded
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 20487021
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487021%27 HTTP/1.1" 200 None
2026-03-29 20:00:27 [motorway.uk] INFO: Scrape type for 20487021: 1
2026-03-29 20:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0082d07a-5000-5b85-a449-31805653c964 with identifier: 8799286
2026-03-29 20:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0082d07a-5000-5b85-a449-31805653c964 with scrape type 1
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0082d07a-5000-5b85-a449-31805653c964
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9286%252F8799286%252Fexterior_front_driver-1774615444332.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9286/8799286/exterior_front_driver-1774615444332.jpeg not downloaded yet
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 19601663
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 20444990
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720444990%27 HTTP/1.1" 200 None
2026-03-29 20:00:27 [motorway.uk] INFO: Scrape type for 20444990: 1
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9286%252F8799286%252Fexterior_rear_driver-1774615564659.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9286/8799286/exterior_rear_driver-1774615564659.jpeg not downloaded yet
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 20184498
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720184498%27 HTTP/1.1" 200 None
2026-03-29 20:00:27 [motorway.uk] INFO: Scrape type for 20184498: 1
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9286%252F8799286%252F8799286-exterior_front_passenger-modified-1774695149033.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9286/8799286/8799286-exterior_front_passenger-modified-1774695149033.jpeg not downloaded yet
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 20155249
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 14811957
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714811957%27 HTTP/1.1" 200 None
2026-03-29 20:00:27 [motorway.uk] INFO: Scrape type for 14811957: 1
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9286%252F8799286%252Fexterior_rear_passenger-1774615548472.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9286/8799286/exterior_rear_passenger-1774615548472.jpeg not downloaded yet
2026-03-29 20:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9561/11469561/interior_front_seats-1774610779202.jpeg> (referer: None)
2026-03-29 20:00:27 [motorway.uk] INFO: Found listing with ID: 4700757
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274700757%27 HTTP/1.1" 200 None
2026-03-29 20:00:27 [motorway.uk] INFO: Scrape type for 4700757: 1
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9286%252F8799286%252F8799286-interior_front_seats-modified-1774695159514.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9286/8799286/8799286-interior_front_seats-modified-1774695159514.jpeg not downloaded yet
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 20492157
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720492157%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [motorway.uk] INFO: Scrape type for 20492157: 1
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9286%252F8799286%252Finterior_rear_seats-1774615811093.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9286/8799286/interior_rear_seats-1774615811093.jpeg not downloaded yet
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 20415455
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 20465121
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 19763259
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 20407866
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720407866%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [motorway.uk] INFO: Scrape type for 20407866: 1
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9286%252F8799286%252Finterior_dashboard-1774615936334.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9286/8799286/interior_dashboard-1774615936334.jpeg not downloaded yet
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 19657268
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 4217945
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 20421154
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 20426599
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720426599%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [motorway.uk] INFO: Scrape type for 20426599: 2
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9286%252F8799286%252Finstrument_cluster-1774615862053.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9286/8799286/instrument_cluster-1774615862053.jpeg not downloaded yet
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 20483409
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483409%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [motorway.uk] INFO: Scrape type for 20483409: 1
2026-03-29 20:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20449963.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:28 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:00:28 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:00:28 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000h/\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02@\xc3\x000^\xa9\x00\x00\x00\x00'
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb0d50>
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_244ec632-8d9e-544f-8af4-ceadfb862ded/244ec632-8d9e-544f-8af4-ceadfb862ded_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9561%252F11469561%252Finterior_front_seats-1774610779202.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9561/11469561/interior_front_seats-1774610779202.jpeg saved to cache
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 244ec632-8d9e-544f-8af4-ceadfb862ded
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9286%252F8799286%252Finterior_boot-1774615956919.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9286/8799286/interior_boot-1774615956919.jpeg not downloaded yet
2026-03-29 20:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 20382764
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 17702324
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717702324%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [motorway.uk] INFO: Scrape type for 17702324: 1
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9286%252F8799286%252Fdocs_service_history-1774691830180.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da3538723016d8d68c425a98f33ff3746%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9286/8799286/docs_service_history-1774691830180.jpeg?ixlib=js-3.8.0&auto=format&s=a3538723016d8d68c425a98f33ff3746 not downloaded yet
2026-03-29 20:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3819/17833819/wheels_front_driver-1771685783142.jpg> (referer: None)
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 19979923
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 7899191
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277899191%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [motorway.uk] INFO: Scrape type for 7899191: 1
2026-03-29 20:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 520069de-66f2-5c24-99ff-af3c92a61b9d with identifier: 20449963
2026-03-29 20:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 520069de-66f2-5c24-99ff-af3c92a61b9d with scrape type 1
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 520069de-66f2-5c24-99ff-af3c92a61b9d
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9963%252F20449963%252Fexterior_front_driver-1774622135278.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_front_driver-1774622135278.jpg not downloaded yet
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 9335437
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 20443228
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 14132265
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 19384929
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 20385350
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720385350%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [motorway.uk] INFO: Scrape type for 20385350: 1
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9963%252F20449963%252Fexterior_rear_driver-1774622135856.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_rear_driver-1774622135856.jpg not downloaded yet
2026-03-29 20:00:28 [motorway.uk] INFO: Found listing with ID: 20231987
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9963%252F20449963%252Fexterior_front_passenger-1774622085400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_front_passenger-1774622085400.jpg not downloaded yet
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9963%252F20449963%252Fexterior_rear_passenger-1774621650120.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_rear_passenger-1774621650120.jpg not downloaded yet
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facc3190>
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f939146-2168-504e-a532-1da1a3547cb6/5f939146-2168-504e-a532-1da1a3547cb6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3819%252F17833819%252Fwheels_front_driver-1771685783142.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3819/17833819/wheels_front_driver-1771685783142.jpg saved to cache
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5f939146-2168-504e-a532-1da1a3547cb6
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9963%252F20449963%252Finterior_front_seats-1774622090119.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9963/20449963/interior_front_seats-1774622090119.jpg not downloaded yet
2026-03-29 20:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9286/8799286/docs_service_history-1774691830180.jpeg?ixlib=js-3.8.0&auto=format&s=a3538723016d8d68c425a98f33ff3746> (referer: None)
2026-03-29 20:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20454912.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3819/17833819/interior_dashboard-1771689022903.jpg> (referer: None)
2026-03-29 20:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3819/17833819/exterior_rear_passenger-1771685587627.jpg> (referer: None)
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9963%252F20449963%252Finterior_rear_seats-1774621927308.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9963/20449963/interior_rear_seats-1774621927308.jpg not downloaded yet
2026-03-29 20:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9963%252F20449963%252Finterior_dashboard-1774690378580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9963/20449963/interior_dashboard-1774690378580.jpg not downloaded yet
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9963%252F20449963%252Finstrument_cluster-1774690369358.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9963/20449963/instrument_cluster-1774690369358.jpg not downloaded yet
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9963%252F20449963%252Finterior_boot-1774622091799.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9963/20449963/interior_boot-1774622091799.jpg not downloaded yet
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9963%252F20449963%252Fwheels_front_driver-1774622086807.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9963/20449963/wheels_front_driver-1774622086807.jpg not downloaded yet
2026-03-29 20:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3819/17833819/damage_scratches-1771685684528.jpg> (referer: None)
2026-03-29 20:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3819/17833819/interior_front_seats-1774781790787.jpg> (referer: None)
2026-03-29 20:00:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa0a890>
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9286%252F8799286%252Fdocs_service_history-1774691830180.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da3538723016d8d68c425a98f33ff3746') HTTP/1.1" 204 0
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9286/8799286/docs_service_history-1774691830180.jpeg?ixlib=js-3.8.0&auto=format&s=a3538723016d8d68c425a98f33ff3746 saved to cache
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0082d07a-5000-5b85-a449-31805653c964
2026-03-29 20:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dc83af9-802e-510b-8bd6-a70aabca5e59 with identifier: 20454912
2026-03-29 20:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dc83af9-802e-510b-8bd6-a70aabca5e59 with scrape type 1
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3dc83af9-802e-510b-8bd6-a70aabca5e59
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Fexterior_front_driver-1774688457391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_front_driver-1774688457391.jpg not downloaded yet
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Fexterior_rear_driver-1774688316529.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_rear_driver-1774688316529.jpg not downloaded yet
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f939cb10>
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f939146-2168-504e-a532-1da1a3547cb6/5f939146-2168-504e-a532-1da1a3547cb6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3819%252F17833819%252Finterior_dashboard-1771689022903.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3819/17833819/interior_dashboard-1771689022903.jpg saved to cache
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5f939146-2168-504e-a532-1da1a3547cb6
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae6dc50>
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f939146-2168-504e-a532-1da1a3547cb6/5f939146-2168-504e-a532-1da1a3547cb6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3819%252F17833819%252Fexterior_rear_passenger-1771685587627.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3819/17833819/exterior_rear_passenger-1771685587627.jpg saved to cache
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5f939146-2168-504e-a532-1da1a3547cb6
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Fexterior_front_passenger-1774688392750.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_front_passenger-1774688392750.jpg not downloaded yet
2026-03-29 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3819/17833819/interior_rear_seats-1771687286137.jpg> (referer: None)
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae82550>
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f939146-2168-504e-a532-1da1a3547cb6/5f939146-2168-504e-a532-1da1a3547cb6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3819%252F17833819%252Fdamage_scratches-1771685684528.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3819/17833819/damage_scratches-1771685684528.jpg saved to cache
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5f939146-2168-504e-a532-1da1a3547cb6
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Fexterior_rear_passenger-1774688540896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_rear_passenger-1774688540896.jpg not downloaded yet
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4912%252F20454912%252Finterior_front_seats-1774688888644.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4912/20454912/interior_front_seats-1774688888644.jpg not downloaded yet
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9378a50>
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f939146-2168-504e-a532-1da1a3547cb6/5f939146-2168-504e-a532-1da1a3547cb6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3819%252F17833819%252Finterior_front_seats-1774781790787.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3819/17833819/interior_front_seats-1774781790787.jpg saved to cache
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5f939146-2168-504e-a532-1da1a3547cb6
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4912%252F20454912%252Finterior_rear_seats-1774688905986.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4912/20454912/interior_rear_seats-1774688905986.jpg not downloaded yet
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae71e50>
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f939146-2168-504e-a532-1da1a3547cb6/5f939146-2168-504e-a532-1da1a3547cb6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3819%252F17833819%252Finterior_rear_seats-1771687286137.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3819/17833819/interior_rear_seats-1771687286137.jpg saved to cache
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5f939146-2168-504e-a532-1da1a3547cb6
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Finterior_dashboard-1774688954298.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/interior_dashboard-1774688954298.jpg not downloaded yet
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Finstrument_cluster-1774688997535.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/instrument_cluster-1774688997535.jpg not downloaded yet
2026-03-29 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3819/17833819/interior_boot-1771687382668.jpg> (referer: None)
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4912%252F20454912%252Finterior_boot-1774688975711.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4912/20454912/interior_boot-1774688975711.jpg not downloaded yet
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Fwheels_front_driver-1774688594221.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/wheels_front_driver-1774688594221.jpg not downloaded yet
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae73810>
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5f939146-2168-504e-a532-1da1a3547cb6/5f939146-2168-504e-a532-1da1a3547cb6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3819%252F17833819%252Finterior_boot-1771687382668.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3819/17833819/interior_boot-1771687382668.jpg saved to cache
2026-03-29 20:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5f939146-2168-504e-a532-1da1a3547cb6
2026-03-29 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_front_driver-1774688457391.jpg> (referer: None)
2026-03-29 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_rear_driver-1774688316529.jpg> (referer: None)
2026-03-29 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4912/20454912/instrument_cluster-1774688997535.jpg> (referer: None)
2026-03-29 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_front_passenger-1774688392750.jpg> (referer: None)
2026-03-29 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15842916.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9963/20449963/wheels_front_driver-1774622086807.jpg> (referer: None)
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faef3ed0>
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Fexterior_front_driver-1774688457391.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_front_driver-1774688457391.jpg saved to cache
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3dc83af9-802e-510b-8bd6-a70aabca5e59
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb2dd0>
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Fexterior_rear_driver-1774688316529.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_rear_driver-1774688316529.jpg saved to cache
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3dc83af9-802e-510b-8bd6-a70aabca5e59
2026-03-29 20:00:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:00:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facd3190>
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Finstrument_cluster-1774688997535.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/instrument_cluster-1774688997535.jpg saved to cache
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3dc83af9-802e-510b-8bd6-a70aabca5e59
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf75e10>
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Fexterior_front_passenger-1774688392750.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_front_passenger-1774688392750.jpg saved to cache
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3dc83af9-802e-510b-8bd6-a70aabca5e59
2026-03-29 20:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e with identifier: 15842916
2026-03-29 20:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e with scrape type 1
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2916%252F15842916%252Fexterior_front_driver-1774543218009.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_front_driver-1774543218009.jpeg not downloaded yet
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabd8d50>
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9963%252F20449963%252Fwheels_front_driver-1774622086807.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9963/20449963/wheels_front_driver-1774622086807.jpg saved to cache
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 520069de-66f2-5c24-99ff-af3c92a61b9d
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2916%252F15842916%252Fexterior_rear_driver-1774543271088.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_rear_driver-1774543271088.jpeg not downloaded yet
2026-03-29 20:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10856544.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2916%252F15842916%252Fexterior_front_passenger-1774543238507.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_front_passenger-1774543238507.jpeg not downloaded yet
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2916%252F15842916%252Fexterior_rear_passenger-1774543255323.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_rear_passenger-1774543255323.jpeg not downloaded yet
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2916%252F15842916%252Finterior_front_seats-1774543291315.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2916/15842916/interior_front_seats-1774543291315.jpeg not downloaded yet
2026-03-29 20:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_rear_passenger-1774688540896.jpg> (referer: None)
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2916%252F15842916%252Finterior_dashboard-1774543405002.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2916/15842916/interior_dashboard-1774543405002.jpeg not downloaded yet
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2916%252F15842916%252F15842916-instrument_cluster-modified-1774688444852.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2916/15842916/15842916-instrument_cluster-modified-1774688444852.jpeg not downloaded yet
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2916%252F15842916%252Finterior_boot-1774543390251.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2916/15842916/interior_boot-1774543390251.jpeg not downloaded yet
2026-03-29 20:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4912/20454912/interior_front_seats-1774688888644.jpg> (referer: None)
2026-03-29 20:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4912/20454912/wheels_front_driver-1774688594221.jpg> (referer: None)
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2916%252F15842916%252Fdocs_service_history-1774544909762.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De4f52667c84312e4183d87d67cf4305a%27 HTTP/1.1" 200 None
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2916/15842916/docs_service_history-1774544909762.jpeg?ixlib=js-3.8.0&auto=format&s=e4f52667c84312e4183d87d67cf4305a not downloaded yet
2026-03-29 20:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bceb8c55-f6d9-5b75-a453-0974303194b7 with identifier: 10856544
2026-03-29 20:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bceb8c55-f6d9-5b75-a453-0974303194b7 with scrape type 1
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bceb8c55-f6d9-5b75-a453-0974303194b7
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6544%252F10856544%252Fexterior_front_driver-1774710873153.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_front_driver-1774710873153.jpg not downloaded yet
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2916%252F15842916%252Fdocs_service_history-1774545024169.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df1de9deb3e6a2f95a4c4321028aa0acc%27 HTTP/1.1" 200 None
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2916/15842916/docs_service_history-1774545024169.jpeg?ixlib=js-3.8.0&auto=format&s=f1de9deb3e6a2f95a4c4321028aa0acc not downloaded yet
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6544%252F10856544%252Fexterior_rear_driver-1774710902262.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_rear_driver-1774710902262.jpg not downloaded yet
2026-03-29 20:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20425191.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6544%252F10856544%252Fexterior_front_passenger-1774710958424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_front_passenger-1774710958424.jpg not downloaded yet
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab38390>
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Fexterior_rear_passenger-1774688540896.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_rear_passenger-1774688540896.jpg saved to cache
2026-03-29 20:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3dc83af9-802e-510b-8bd6-a70aabca5e59
2026-03-29 20:00:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:00:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010f1790>
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4912%252F20454912%252Finterior_front_seats-1774688888644.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4912/20454912/interior_front_seats-1774688888644.jpg saved to cache
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3dc83af9-802e-510b-8bd6-a70aabca5e59
2026-03-29 20:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9670810>
2026-03-29 20:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Fwheels_front_driver-1774688594221.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/wheels_front_driver-1774688594221.jpg saved to cache
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3dc83af9-802e-510b-8bd6-a70aabca5e59
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6544%252F10856544%252Fexterior_rear_passenger-1774710928686.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_rear_passenger-1774710928686.jpg not downloaded yet
2026-03-29 20:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4912/20454912/interior_rear_seats-1774688905986.jpg> (referer: None)
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6544%252F10856544%252Finterior_front_seats-1774711874342.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6544/10856544/interior_front_seats-1774711874342.jpg not downloaded yet
2026-03-29 20:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3647da9-674e-5e8b-a78d-2b18d1a2be9f with identifier: 20425191
2026-03-29 20:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f with scrape type 1
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5191%252F20425191%252Fexterior_front_driver-1774366289796.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5191/20425191/exterior_front_driver-1774366289796.jpg not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6544%252F10856544%252Finterior_rear_seats-1774711910255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6544/10856544/interior_rear_seats-1774711910255.jpg not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5191%252F20425191%252Fexterior_rear_driver-1774366301100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5191/20425191/exterior_rear_driver-1774366301100.jpg not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6544%252F10856544%252Finterior_dashboard-1774711981280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6544/10856544/interior_dashboard-1774711981280.jpg not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5191%252F20425191%252Fexterior_front_passenger-1774691197415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5191/20425191/exterior_front_passenger-1774691197415.jpg not downloaded yet
2026-03-29 20:00:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:00:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0b69d0>
2026-03-29 20:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4912%252F20454912%252Finterior_rear_seats-1774688905986.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4912/20454912/interior_rear_seats-1774688905986.jpg saved to cache
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3dc83af9-802e-510b-8bd6-a70aabca5e59
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6544%252F10856544%252Finstrument_cluster-1774711917501.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6544/10856544/instrument_cluster-1774711917501.jpg not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5191%252F20425191%252Fexterior_rear_passenger-1774366313000.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5191/20425191/exterior_rear_passenger-1774366313000.jpg not downloaded yet
2026-03-29 20:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20471927.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20483409.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6544%252F10856544%252Finterior_boot-1774712047669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6544/10856544/interior_boot-1774712047669.jpg not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5191%252F20425191%252Finterior_front_seats-1774366599977.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5191/20425191/interior_front_seats-1774366599977.jpg not downloaded yet
2026-03-29 20:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4912/20454912/interior_dashboard-1774688954298.jpg> (referer: None)
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6544%252F10856544%252Fdocs_service_history-1774714267512.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db65bcb2b34a92d201203c59ff46ae2ae%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6544/10856544/docs_service_history-1774714267512.jpg?ixlib=js-3.8.0&auto=format&s=b65bcb2b34a92d201203c59ff46ae2ae not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5191%252F20425191%252Finterior_rear_seats-1774366614572.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5191/20425191/interior_rear_seats-1774366614572.jpg not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5191%252F20425191%252Finterior_dashboard-1774366645438.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5191/20425191/interior_dashboard-1774366645438.jpg not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5191%252F20425191%252Finstrument_cluster-1774367993722.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5191/20425191/instrument_cluster-1774367993722.jpg not downloaded yet
2026-03-29 20:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da984507-4cd4-5f62-b890-2dcdd36827c3 with identifier: 20471927
2026-03-29 20:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da984507-4cd4-5f62-b890-2dcdd36827c3 with scrape type 1
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da984507-4cd4-5f62-b890-2dcdd36827c3
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1927%252F20471927%252Fexterior_front_driver-1774689891064.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1927/20471927/exterior_front_driver-1774689891064.jpg not downloaded yet
2026-03-29 20:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22c33cbe-e27d-5abd-ae46-27988605a6a5 with identifier: 20483409
2026-03-29 20:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22c33cbe-e27d-5abd-ae46-27988605a6a5 with scrape type 1
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22c33cbe-e27d-5abd-ae46-27988605a6a5
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20483409%252Fexterior_front_driver-1774707433732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_front_driver-1774707433732.jpg not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5191%252F20425191%252Finterior_boot-1774366647826.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5191/20425191/interior_boot-1774366647826.jpg not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1927%252F20471927%252Fexterior_rear_driver-1774687797978.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1927/20471927/exterior_rear_driver-1774687797978.jpg not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20483409%252Fexterior_rear_driver-1774707313433.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_rear_driver-1774707313433.jpg not downloaded yet
2026-03-29 20:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20451701.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5191%252F20425191%252Fwheels_front_driver-1774366367008.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5191/20425191/wheels_front_driver-1774366367008.jpg not downloaded yet
2026-03-29 20:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19943436.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1927%252F20471927%252Fexterior_front_passenger-1774689930336.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1927/20471927/exterior_front_passenger-1774689930336.jpg not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20483409%252Fexterior_front_passenger-1774707358979.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_front_passenger-1774707358979.jpg not downloaded yet
2026-03-29 20:00:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9173590>
2026-03-29 20:00:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4912%252F20454912%252Finterior_dashboard-1774688954298.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4912/20454912/interior_dashboard-1774688954298.jpg saved to cache
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3dc83af9-802e-510b-8bd6-a70aabca5e59
2026-03-29 20:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_front_passenger-1774710958424.jpg> (referer: None)
2026-03-29 20:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9963/20449963/instrument_cluster-1774690369358.jpg> (referer: None)
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1927%252F20471927%252Fexterior_rear_passenger-1774689953212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1927/20471927/exterior_rear_passenger-1774689953212.jpg not downloaded yet
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20483409%252Fexterior_rear_passenger-1774707321749.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_rear_passenger-1774707321749.jpg not downloaded yet
2026-03-29 20:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55fff14e-06a5-55d9-a72b-4d1ee2a530b5 with identifier: 20451701
2026-03-29 20:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5 with scrape type 1
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20451701%252Fexterior_front_driver-1774702164014.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_front_driver-1774702164014.jpg not downloaded yet
2026-03-29 20:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd00d91f-3676-5363-aae7-a0cd3cd87b0a with identifier: 19943436
2026-03-29 20:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a with scrape type 1
2026-03-29 20:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a
2026-03-29 20:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3436%252F19943436%252Fexterior_front_driver-1774621649127.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_front_driver-1774621649127.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1927%252F20471927%252Finterior_front_seats-1774687266020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1927/20471927/interior_front_seats-1774687266020.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3409%252F20483409%252Finterior_front_seats-1774708355112.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3409/20483409/interior_front_seats-1774708355112.jpg not downloaded yet
2026-03-29 20:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_front_driver-1774543218009.jpeg> (referer: None)
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20451701%252Fexterior_rear_driver-1774702367310.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_rear_driver-1774702367310.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3436%252F19943436%252Fexterior_rear_driver-1774621657414.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_rear_driver-1774621657414.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1927%252F20471927%252Finterior_dashboard-1774689974530.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1927/20471927/interior_dashboard-1774689974530.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3409%252F20483409%252Finterior_rear_seats-1774707805621.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3409/20483409/interior_rear_seats-1774707805621.jpg not downloaded yet
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9045f90>
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6544%252F10856544%252Fexterior_front_passenger-1774710958424.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_front_passenger-1774710958424.jpg saved to cache
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bceb8c55-f6d9-5b75-a453-0974303194b7
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8df9f90>
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9963%252F20449963%252Finstrument_cluster-1774690369358.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9963/20449963/instrument_cluster-1774690369358.jpg saved to cache
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 520069de-66f2-5c24-99ff-af3c92a61b9d
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20451701%252Fexterior_front_passenger-1774702369400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_front_passenger-1774702369400.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3436%252F19943436%252Fexterior_front_passenger-1774621649725.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_front_passenger-1774621649725.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1927%252F20471927%252Finstrument_cluster-1774687383514.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1927/20471927/instrument_cluster-1774687383514.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20483409%252Finterior_dashboard-1774707826633.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20483409/interior_dashboard-1774707826633.jpg not downloaded yet
2026-03-29 20:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9963/20449963/interior_dashboard-1774690378580.jpg> (referer: None)
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20451701%252Fexterior_rear_passenger-1774702261082.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_rear_passenger-1774702261082.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3436%252F19943436%252Fexterior_rear_passenger-1774621653432.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_rear_passenger-1774621653432.jpg not downloaded yet
2026-03-29 20:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_front_driver-1774710873153.jpg> (referer: None)
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1927%252F20471927%252Finterior_boot-1774689988367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1927/20471927/interior_boot-1774689988367.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20483409%252Finstrument_cluster-1774707730218.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20483409/instrument_cluster-1774707730218.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1701%252F20451701%252Finterior_front_seats-1774703035820.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1701/20451701/interior_front_seats-1774703035820.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3436%252F19943436%252Finterior_front_seats-1774625215052.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3436/19943436/interior_front_seats-1774625215052.jpg not downloaded yet
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9619e10>
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2916%252F15842916%252Fexterior_front_driver-1774543218009.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_front_driver-1774543218009.jpeg saved to cache
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1927%252F20471927%252Fdocs_service_history-1774688451778.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D85d357c9887f95b7860dd980517c0ef2%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1927/20471927/docs_service_history-1774688451778.jpg?ixlib=js-3.8.0&auto=format&s=85d357c9887f95b7860dd980517c0ef2 not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3409%252F20483409%252Finterior_boot-1774708368873.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3409/20483409/interior_boot-1774708368873.jpg not downloaded yet
2026-03-29 20:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_rear_driver-1774710902262.jpg> (referer: None)
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1701%252F20451701%252Finterior_rear_seats-1774703568704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1701/20451701/interior_rear_seats-1774703568704.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3436%252F19943436%252Finterior_rear_seats-1774622106337.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3436/19943436/interior_rear_seats-1774622106337.jpg not downloaded yet
2026-03-29 20:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4912/20454912/interior_boot-1774688975711.jpg> (referer: None)
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1927%252F20471927%252Fdocs_service_history-1774688572873.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2aa2c79e4bc11e29c92be9125f32bf04%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1927/20471927/docs_service_history-1774688572873.jpg?ixlib=js-3.8.0&auto=format&s=2aa2c79e4bc11e29c92be9125f32bf04 not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3409%252F20483409%252Fdocs_service_history-1774708141936.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db76a20f126e237ef8f21cde0182ca2d6%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3409/20483409/docs_service_history-1774708141936.jpg?ixlib=js-3.8.0&auto=format&s=b76a20f126e237ef8f21cde0182ca2d6 not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1701%252F20451701%252Finterior_dashboard-1774704388659.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1701/20451701/interior_dashboard-1774704388659.jpg not downloaded yet
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3436%252F19943436%252Finterior_dashboard-1774625343972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3436/19943436/interior_dashboard-1774625343972.jpg not downloaded yet
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c03f10>
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9963%252F20449963%252Finterior_dashboard-1774690378580.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9963/20449963/interior_dashboard-1774690378580.jpg saved to cache
2026-03-29 20:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 520069de-66f2-5c24-99ff-af3c92a61b9d
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9003d50>
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6544%252F10856544%252Fexterior_front_driver-1774710873153.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_front_driver-1774710873153.jpg saved to cache
2026-03-29 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bceb8c55-f6d9-5b75-a453-0974303194b7
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20451701%252Finstrument_cluster-1774703118896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20451701/instrument_cluster-1774703118896.jpg not downloaded yet
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3436%252F19943436%252Finstrument_cluster-1774625310750.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3436/19943436/instrument_cluster-1774625310750.jpg not downloaded yet
2026-03-29 20:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f957fd10>
2026-03-29 20:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6544%252F10856544%252Fexterior_rear_driver-1774710902262.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_rear_driver-1774710902262.jpg saved to cache
2026-03-29 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bceb8c55-f6d9-5b75-a453-0974303194b7
2026-03-29 20:00:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:00:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9019690>
2026-03-29 20:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4912%252F20454912%252Finterior_boot-1774688975711.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4912/20454912/interior_boot-1774688975711.jpg saved to cache
2026-03-29 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3dc83af9-802e-510b-8bd6-a70aabca5e59
2026-03-29 20:00:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3dc83af9-802e-510b-8bd6-a70aabca5e59, skipping ID generation
2026-03-29 20:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dc83af9-802e-510b-8bd6-a70aabca5e59 with scrape type 1
2026-03-29 20:00:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3dc83af9-802e-510b-8bd6-a70aabca5e59 sending to next pipeline
2026-03-29 20:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3dc83af9-802e-510b-8bd6-a70aabca5e59, identifier: 20454912
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1701%252F20451701%252Finterior_boot-1774703737110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1701/20451701/interior_boot-1774703737110.jpg not downloaded yet
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3436%252F19943436%252Finterior_boot-1774625330185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3436/19943436/interior_boot-1774625330185.jpg not downloaded yet
2026-03-29 20:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14811957.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3dc83af9-802e-510b-8bd6-a70aabca5e59 with identifier: 20454912
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2026-03-29 20:00:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3dc83af9-802e-510b-8bd6-a70aabca5e59 with identifier: 20454912
2026-03-29 20:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3dc83af9-802e-510b-8bd6-a70aabca5e59 with identifier: 20454912 to the API
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4912/20454912/interior_boot-1774688975711.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '3dc83af9-802e-510b-8bd6-a70aabca5e59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FH25 CDV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20454912',
'listing': 'auction',
'location': 'Derbyshire Derby',
'make': 'Porsche',
'model': 'Macan',
'odometer': 3581,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2559121,
'Height': 2949,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_front_driver-1774688457391.jpg',
'Width': 3932},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2230720,
'Height': 2875,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_rear_driver-1774688316529.jpg',
'Width': 3833},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2144722,
'Height': 2625,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_front_passenger-1774688392750.jpg',
'Width': 3500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1659980,
'Height': 2360,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4912/20454912/exterior_rear_passenger-1774688540896.jpg',
'Width': 3147},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2104141,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4912/20454912/interior_front_seats-1774688888644.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2523623,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4912/20454912/interior_rear_seats-1774688905986.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1095683,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4912/20454912/interior_dashboard-1774688954298.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2077478,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4912/20454912/instrument_cluster-1774688997535.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3706196,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4912/20454912/interior_boot-1774688975711.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3dc83af9-802e-510b-8bd6-a70aabca5e59/3dc83af9-802e-510b-8bd6-a70aabca5e59_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1146835,
'Height': 2390,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4912/20454912/wheels_front_driver-1774688594221.jpg',
'Width': 3187}],
'price': 74375,
'price_includes_vat': False,
'registration_date': '2025-08-08',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Macan 4S Electric',
'transmission': 'automatic',
'trim': '4S Electric',
'vin': 'WP1ZZZXA9SL157099',
'year': 2025}
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720454912%27 HTTP/1.1" 200 None
2026-03-29 20:00:34 [motorway.uk] INFO: Saving data for 20454912: {'created_time': 1774814434.656439, 'last_price_update_time': 1774814434.656451, 'auction_closing_time': 1774884600.0}
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20454912') HTTP/1.1" 204 0
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20451701%252Fwheels_front_driver-1774702484760.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20451701/wheels_front_driver-1774702484760.jpg not downloaded yet
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3436%252F19943436%252Fdocs_service_history-1774622147364.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbe15d3f075630c5ea20956cac2123ce5%27 HTTP/1.1" 200 None
2026-03-29 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3436/19943436/docs_service_history-1774622147364.jpg?ixlib=js-3.8.0&auto=format&s=be15d3f075630c5ea20956cac2123ce5 not downloaded yet
2026-03-29 20:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b7540b-6f4b-51c8-a004-9b47ac33b278 with identifier: 14811957
2026-03-29 20:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b7540b-6f4b-51c8-a004-9b47ac33b278 with scrape type 1
2026-03-29 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65b7540b-6f4b-51c8-a004-9b47ac33b278
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1957%252F14811957%252Fexterior_front_driver-1774625327888.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1957/14811957/exterior_front_driver-1774625327888.jpeg not downloaded yet
2026-03-29 20:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2916/15842916/interior_front_seats-1774543291315.jpeg> (referer: None)
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1957%252F14811957%252Fexterior_rear_driver-1774625385982.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1957/14811957/exterior_rear_driver-1774625385982.jpeg not downloaded yet
2026-03-29 20:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5191/20425191/exterior_rear_passenger-1774366313000.jpg> (referer: None)
2026-03-29 20:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5191/20425191/wheels_front_driver-1774366367008.jpg> (referer: None)
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1957%252F14811957%252F14811957-exterior_front_passenger-modified-1774629299932.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1957/14811957/14811957-exterior_front_passenger-modified-1774629299932.jpeg not downloaded yet
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1957%252F14811957%252Fexterior_rear_passenger-1774625379314.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1957/14811957/exterior_rear_passenger-1774625379314.jpeg not downloaded yet
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1957%252F14811957%252Finterior_front_seats-1774625740570.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1957/14811957/interior_front_seats-1774625740570.jpeg not downloaded yet
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1957%252F14811957%252Finterior_dashboard-1774625932456.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1957/14811957/interior_dashboard-1774625932456.jpeg not downloaded yet
2026-03-29 20:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1927/20471927/exterior_rear_driver-1774687797978.jpg> (referer: None)
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1957%252F14811957%252Finstrument_cluster-1774625904379.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1957/14811957/instrument_cluster-1774625904379.jpeg not downloaded yet
2026-03-29 20:00:35 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:00:35 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:00:35 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000_\t\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03a\xb1\x000T\x87\x00\x00\x00\x00'
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96d7510>
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2916%252F15842916%252Finterior_front_seats-1774543291315.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2916/15842916/interior_front_seats-1774543291315.jpeg saved to cache
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0a1490>
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5191%252F20425191%252Fexterior_rear_passenger-1774366313000.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5191/20425191/exterior_rear_passenger-1774366313000.jpg saved to cache
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facc3750>
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5191%252F20425191%252Fwheels_front_driver-1774366367008.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5191/20425191/wheels_front_driver-1774366367008.jpg saved to cache
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f
2026-03-29 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_rear_passenger-1774707321749.jpg> (referer: None)
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1957%252F14811957%252Finterior_boot-1774625856651.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1957/14811957/interior_boot-1774625856651.jpeg not downloaded yet
2026-03-29 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_rear_driver-1774707313433.jpg> (referer: None)
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1957%252F14811957%252F14811957-docs_service_history-modified-1774627657488.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2795d3506a89c3cd8ea595f422ab55ac%27 HTTP/1.1" 200 None
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1957/14811957/14811957-docs_service_history-modified-1774627657488.jpeg?ixlib=js-3.8.0&auto=format&s=2795d3506a89c3cd8ea595f422ab55ac not downloaded yet
2026-03-29 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3436/19943436/interior_boot-1774625330185.jpg> (referer: None)
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1957%252F14811957%252F14811957-docs_service_history-modified-1774627681832.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D216735bd6134e4496593bf3fcfdff8e1%27 HTTP/1.1" 200 None
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1957/14811957/14811957-docs_service_history-modified-1774627681832.jpeg?ixlib=js-3.8.0&auto=format&s=216735bd6134e4496593bf3fcfdff8e1 not downloaded yet
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facc0d50>
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1927%252F20471927%252Fexterior_rear_driver-1774687797978.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1927/20471927/exterior_rear_driver-1774687797978.jpg saved to cache
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da984507-4cd4-5f62-b890-2dcdd36827c3
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa11d90>
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20483409%252Fexterior_rear_passenger-1774707321749.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_rear_passenger-1774707321749.jpg saved to cache
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22c33cbe-e27d-5abd-ae46-27988605a6a5
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa55d10>
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20483409%252Fexterior_rear_driver-1774707313433.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_rear_driver-1774707313433.jpg saved to cache
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22c33cbe-e27d-5abd-ae46-27988605a6a5
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9320250>
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3436%252F19943436%252Finterior_boot-1774625330185.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3436/19943436/interior_boot-1774625330185.jpg saved to cache
2026-03-29 20:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a
2026-03-29 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9963/20449963/interior_boot-1774622091799.jpg> (referer: None)
2026-03-29 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2916/15842916/docs_service_history-1774545024169.jpeg?ixlib=js-3.8.0&auto=format&s=f1de9deb3e6a2f95a4c4321028aa0acc> (referer: None)
2026-03-29 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3436/19943436/instrument_cluster-1774625310750.jpg> (referer: None)
2026-03-29 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6544/10856544/instrument_cluster-1774711917501.jpg> (referer: None)
2026-03-29 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5191/20425191/interior_front_seats-1774366599977.jpg> (referer: None)
2026-03-29 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1701/20451701/instrument_cluster-1774703118896.jpg> (referer: None)
2026-03-29 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1701/20451701/wheels_front_driver-1774702484760.jpg> (referer: None)
2026-03-29 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3436/19943436/docs_service_history-1774622147364.jpg?ixlib=js-3.8.0&auto=format&s=be15d3f075630c5ea20956cac2123ce5> (referer: None)
2026-03-29 20:00:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa573d0>
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9963%252F20449963%252Finterior_boot-1774622091799.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9963/20449963/interior_boot-1774622091799.jpg saved to cache
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 520069de-66f2-5c24-99ff-af3c92a61b9d
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa096790>
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2916%252F15842916%252Fdocs_service_history-1774545024169.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df1de9deb3e6a2f95a4c4321028aa0acc') HTTP/1.1" 204 0
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2916/15842916/docs_service_history-1774545024169.jpeg?ixlib=js-3.8.0&auto=format&s=f1de9deb3e6a2f95a4c4321028aa0acc saved to cache
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f938e590>
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3436%252F19943436%252Finstrument_cluster-1774625310750.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3436/19943436/instrument_cluster-1774625310750.jpg saved to cache
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a
2026-03-29 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1957/14811957/14811957-docs_service_history-modified-1774627657488.jpeg?ixlib=js-3.8.0&auto=format&s=2795d3506a89c3cd8ea595f422ab55ac> (referer: None)
2026-03-29 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1957/14811957/14811957-docs_service_history-modified-1774627681832.jpeg?ixlib=js-3.8.0&auto=format&s=216735bd6134e4496593bf3fcfdff8e1> (referer: None)
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700da36d0>
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6544%252F10856544%252Finstrument_cluster-1774711917501.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6544/10856544/instrument_cluster-1774711917501.jpg saved to cache
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bceb8c55-f6d9-5b75-a453-0974303194b7
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9212e10>
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5191%252F20425191%252Finterior_front_seats-1774366599977.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5191/20425191/interior_front_seats-1774366599977.jpg saved to cache
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f928ad50>
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20451701%252Finstrument_cluster-1774703118896.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20451701/instrument_cluster-1774703118896.jpg saved to cache
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f938d390>
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20451701%252Fwheels_front_driver-1774702484760.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20451701/wheels_front_driver-1774702484760.jpg saved to cache
2026-03-29 20:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 150 - value: b'samsung\x00'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 158 - value: b'SM-S916B\x00'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 142 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 168 - value: b'S916BXXS3AWIF\x00'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 182 - value: b'2026:03:27 09:39:38\x00'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xca'
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700de2dd0>
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3436%252F19943436%252Fdocs_service_history-1774622147364.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbe15d3f075630c5ea20956cac2123ce5') HTTP/1.1" 204 0
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3436/19943436/docs_service_history-1774622147364.jpg?ixlib=js-3.8.0&auto=format&s=be15d3f075630c5ea20956cac2123ce5 saved to cache
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab399d0>
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1957%252F14811957%252F14811957-docs_service_history-modified-1774627657488.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2795d3506a89c3cd8ea595f422ab55ac') HTTP/1.1" 204 0
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1957/14811957/14811957-docs_service_history-modified-1774627657488.jpeg?ixlib=js-3.8.0&auto=format&s=2795d3506a89c3cd8ea595f422ab55ac saved to cache
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65b7540b-6f4b-51c8-a004-9b47ac33b278
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab9e890>
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1957%252F14811957%252F14811957-docs_service_history-modified-1774627681832.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D216735bd6134e4496593bf3fcfdff8e1') HTTP/1.1" 204 0
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1957/14811957/14811957-docs_service_history-modified-1774627681832.jpeg?ixlib=js-3.8.0&auto=format&s=216735bd6134e4496593bf3fcfdff8e1 saved to cache
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65b7540b-6f4b-51c8-a004-9b47ac33b278
2026-03-29 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1701/20451701/interior_boot-1774703737110.jpg> (referer: None)
2026-03-29 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1957/14811957/exterior_rear_passenger-1774625379314.jpeg> (referer: None)
2026-03-29 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1957/14811957/instrument_cluster-1774625904379.jpeg> (referer: None)
2026-03-29 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1957/14811957/interior_front_seats-1774625740570.jpeg> (referer: None)
2026-03-29 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1957/14811957/interior_dashboard-1774625932456.jpeg> (referer: None)
2026-03-29 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1957/14811957/interior_boot-1774625856651.jpeg> (referer: None)
2026-03-29 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1957/14811957/exterior_front_driver-1774625327888.jpeg> (referer: None)
2026-03-29 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3409/20483409/docs_service_history-1774708141936.jpg?ixlib=js-3.8.0&auto=format&s=b76a20f126e237ef8f21cde0182ca2d6> (referer: None)
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96d6b10>
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1701%252F20451701%252Finterior_boot-1774703737110.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1701/20451701/interior_boot-1774703737110.jpg saved to cache
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9184fd0>
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1957%252F14811957%252Fexterior_rear_passenger-1774625379314.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1957/14811957/exterior_rear_passenger-1774625379314.jpeg saved to cache
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65b7540b-6f4b-51c8-a004-9b47ac33b278
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00"\x84\xfc\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02%\x87\x00"z\xea\x00\x00\x00\x00'
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9605210>
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1957%252F14811957%252Finstrument_cluster-1774625904379.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1957/14811957/instrument_cluster-1774625904379.jpeg saved to cache
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65b7540b-6f4b-51c8-a004-9b47ac33b278
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x001\xd8\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xf9g\x001\xce\xae\x00\x00\x00\x00'
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87011a0910>
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1957%252F14811957%252Finterior_front_seats-1774625740570.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1957/14811957/interior_front_seats-1774625740570.jpeg saved to cache
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65b7540b-6f4b-51c8-a004-9b47ac33b278
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003\xf9r\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02N\xe0\x003\xefj\x00\x00\x00\x00'
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa33290>
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1957%252F14811957%252Finterior_dashboard-1774625932456.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1957/14811957/interior_dashboard-1774625932456.jpeg saved to cache
2026-03-29 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65b7540b-6f4b-51c8-a004-9b47ac33b278
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:00:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x008\x0f\xc7\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02m\x9b\x008\x05m\x00\x00\x00\x00'
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa2db50>
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1957%252F14811957%252Finterior_boot-1774625856651.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1957/14811957/interior_boot-1774625856651.jpeg saved to cache
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65b7540b-6f4b-51c8-a004-9b47ac33b278
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9591b10>
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1957%252F14811957%252Fexterior_front_driver-1774625327888.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1957/14811957/exterior_front_driver-1774625327888.jpeg saved to cache
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65b7540b-6f4b-51c8-a004-9b47ac33b278
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8701c10f50>
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3409%252F20483409%252Fdocs_service_history-1774708141936.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db76a20f126e237ef8f21cde0182ca2d6') HTTP/1.1" 204 0
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3409/20483409/docs_service_history-1774708141936.jpg?ixlib=js-3.8.0&auto=format&s=b76a20f126e237ef8f21cde0182ca2d6 saved to cache
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22c33cbe-e27d-5abd-ae46-27988605a6a5
2026-03-29 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1927/20471927/docs_service_history-1774688572873.jpg?ixlib=js-3.8.0&auto=format&s=2aa2c79e4bc11e29c92be9125f32bf04> (referer: None)
2026-03-29 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1957/14811957/exterior_rear_driver-1774625385982.jpeg> (referer: None)
2026-03-29 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3436/19943436/interior_dashboard-1774625343972.jpg> (referer: None)
2026-03-29 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3436/19943436/interior_rear_seats-1774622106337.jpg> (referer: None)
2026-03-29 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1957/14811957/14811957-exterior_front_passenger-modified-1774629299932.jpeg> (referer: None)
2026-03-29 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1701/20451701/interior_dashboard-1774704388659.jpg> (referer: None)
2026-03-29 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1927/20471927/docs_service_history-1774688451778.jpg?ixlib=js-3.8.0&auto=format&s=85d357c9887f95b7860dd980517c0ef2> (referer: None)
2026-03-29 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3436/19943436/interior_front_seats-1774625215052.jpg> (referer: None)
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ddd3d0>
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1927%252F20471927%252Fdocs_service_history-1774688572873.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2aa2c79e4bc11e29c92be9125f32bf04') HTTP/1.1" 204 0
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1927/20471927/docs_service_history-1774688572873.jpg?ixlib=js-3.8.0&auto=format&s=2aa2c79e4bc11e29c92be9125f32bf04 saved to cache
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da984507-4cd4-5f62-b890-2dcdd36827c3
2026-03-29 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3409/20483409/interior_boot-1774708368873.jpg> (referer: None)
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90117d0>
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1957%252F14811957%252Fexterior_rear_driver-1774625385982.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1957/14811957/exterior_rear_driver-1774625385982.jpeg saved to cache
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65b7540b-6f4b-51c8-a004-9b47ac33b278
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0c84d0>
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3436%252F19943436%252Finterior_dashboard-1774625343972.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3436/19943436/interior_dashboard-1774625343972.jpg saved to cache
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9618110>
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3436%252F19943436%252Finterior_rear_seats-1774622106337.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3436/19943436/interior_rear_seats-1774622106337.jpg saved to cache
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9160c90>
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1957%252F14811957%252F14811957-exterior_front_passenger-modified-1774629299932.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1957/14811957/14811957-exterior_front_passenger-modified-1774629299932.jpeg saved to cache
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65b7540b-6f4b-51c8-a004-9b47ac33b278
2026-03-29 20:00:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65b7540b-6f4b-51c8-a004-9b47ac33b278, skipping ID generation
2026-03-29 20:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b7540b-6f4b-51c8-a004-9b47ac33b278 with scrape type 1
2026-03-29 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65b7540b-6f4b-51c8-a004-9b47ac33b278 sending to next pipeline
2026-03-29 20:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 65b7540b-6f4b-51c8-a004-9b47ac33b278, identifier: 14811957
2026-03-29 20:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab9df90>
2026-03-29 20:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1701%252F20451701%252Finterior_dashboard-1774704388659.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1701/20451701/interior_dashboard-1774704388659.jpg saved to cache
2026-03-29 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5
2026-03-29 20:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f901dbd0>
2026-03-29 20:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1927%252F20471927%252Fdocs_service_history-1774688451778.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D85d357c9887f95b7860dd980517c0ef2') HTTP/1.1" 204 0
2026-03-29 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1927/20471927/docs_service_history-1774688451778.jpg?ixlib=js-3.8.0&auto=format&s=85d357c9887f95b7860dd980517c0ef2 saved to cache
2026-03-29 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da984507-4cd4-5f62-b890-2dcdd36827c3
2026-03-29 20:00:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96d7390>
2026-03-29 20:00:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3436%252F19943436%252Finterior_front_seats-1774625215052.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3436/19943436/interior_front_seats-1774625215052.jpg saved to cache
2026-03-29 20:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a
2026-03-29 20:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 65b7540b-6f4b-51c8-a004-9b47ac33b278 with identifier: 14811957
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey HTTP/1.1" 200 None
2026-03-29 20:00:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2026-03-29 20:00:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 65b7540b-6f4b-51c8-a004-9b47ac33b278 with identifier: 14811957
2026-03-29 20:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 65b7540b-6f4b-51c8-a004-9b47ac33b278 with identifier: 14811957 to the API
2026-03-29 20:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/1957/14811957/14811957-exterior_front_passenger-modified-1774629299932.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '65b7540b-6f4b-51c8-a004-9b47ac33b278',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PO21 SZE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14811957',
'listing': 'auction',
'location': 'Greater London Enfield',
'make': 'Fiat',
'model': 'Fiorino',
'odometer': 28804,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 943698,
'Height': 2115,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1957/14811957/exterior_front_driver-1774625327888.jpeg',
'Width': 2820},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1016703,
'Height': 2331,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1957/14811957/exterior_rear_driver-1774625385982.jpeg',
'Width': 3108},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1580387,
'Height': 2346,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1957/14811957/14811957-exterior_front_passenger-modified-1774629299932.jpeg',
'Width': 3128},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1221784,
'Height': 2400,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1957/14811957/exterior_rear_passenger-1774625379314.jpeg',
'Width': 3200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3396135,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1957/14811957/interior_front_seats-1774625740570.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3557458,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1957/14811957/interior_dashboard-1774625932456.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2402947,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1957/14811957/instrument_cluster-1774625904379.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3833186,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1957/14811957/interior_boot-1774625856651.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86724,
'Height': 933,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1957/14811957/14811957-docs_service_history-modified-1774627657488.jpeg?ixlib=js-3.8.0&auto=format&s=2795d3506a89c3cd8ea595f422ab55ac',
'Width': 1244},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b7540b-6f4b-51c8-a004-9b47ac33b278/65b7540b-6f4b-51c8-a004-9b47ac33b278_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133150,
'Height': 1150,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1957/14811957/14811957-docs_service_history-modified-1774627681832.jpeg?ixlib=js-3.8.0&auto=format&s=216735bd6134e4496593bf3fcfdff8e1',
'Width': 1533}],
'price': 6756,
'price_includes_vat': False,
'registration_date': '2021-06-25',
'seats_number': None,
'seller_name': None,
'title': 'Fiat Fiorino 16V Tecnico Mjetii SS',
'transmission': 'manual',
'trim': '16V Tecnico Mjetii SS',
'vin': 'ZFA22500006U71841',
'year': 2021}
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714811957%27 HTTP/1.1" 200 None
2026-03-29 20:00:40 [motorway.uk] INFO: Saving data for 14811957: {'created_time': 1774814440.296389, 'last_price_update_time': 1774814440.296402, 'auction_closing_time': 1774884600.0}
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14811957') HTTP/1.1" 204 0
2026-03-29 20:00:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9321750>
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3409%252F20483409%252Finterior_boot-1774708368873.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3409/20483409/interior_boot-1774708368873.jpg saved to cache
2026-03-29 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22c33cbe-e27d-5abd-ae46-27988605a6a5
2026-03-29 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1701/20451701/interior_rear_seats-1774703568704.jpg> (referer: None)
2026-03-29 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_rear_passenger-1774621653432.jpg> (referer: None)
2026-03-29 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1927/20471927/instrument_cluster-1774687383514.jpg> (referer: None)
2026-03-29 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_front_passenger-1774702369400.jpg> (referer: None)
2026-03-29 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_rear_passenger-1774702261082.jpg> (referer: None)
2026-03-29 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_front_passenger-1774621649725.jpg> (referer: None)
2026-03-29 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1927/20471927/interior_boot-1774689988367.jpg> (referer: None)
2026-03-29 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3409/20483409/instrument_cluster-1774707730218.jpg> (referer: None)
2026-03-29 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3409/20483409/interior_dashboard-1774707826633.jpg> (referer: None)
2026-03-29 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1701/20451701/interior_front_seats-1774703035820.jpg> (referer: None)
2026-03-29 20:00:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb1ad0>
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1701%252F20451701%252Finterior_rear_seats-1774703568704.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1701/20451701/interior_rear_seats-1774703568704.jpg saved to cache
2026-03-29 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93da290>
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3436%252F19943436%252Fexterior_rear_passenger-1774621653432.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_rear_passenger-1774621653432.jpg saved to cache
2026-03-29 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa529d0>
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1927%252F20471927%252Finstrument_cluster-1774687383514.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1927/20471927/instrument_cluster-1774687383514.jpg saved to cache
2026-03-29 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da984507-4cd4-5f62-b890-2dcdd36827c3
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d1650>
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20451701%252Fexterior_front_passenger-1774702369400.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_front_passenger-1774702369400.jpg saved to cache
2026-03-29 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faccddd0>
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20451701%252Fexterior_rear_passenger-1774702261082.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_rear_passenger-1774702261082.jpg saved to cache
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d1550>
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3436%252F19943436%252Fexterior_front_passenger-1774621649725.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_front_passenger-1774621649725.jpg saved to cache
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d2ed0>
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1927%252F20471927%252Finterior_boot-1774689988367.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1927/20471927/interior_boot-1774689988367.jpg saved to cache
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da984507-4cd4-5f62-b890-2dcdd36827c3
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f960e1d0>
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20483409%252Finstrument_cluster-1774707730218.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20483409/instrument_cluster-1774707730218.jpg saved to cache
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22c33cbe-e27d-5abd-ae46-27988605a6a5
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f963df50>
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20483409%252Finterior_dashboard-1774707826633.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20483409/interior_dashboard-1774707826633.jpg saved to cache
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22c33cbe-e27d-5abd-ae46-27988605a6a5
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf7b110>
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1701%252F20451701%252Finterior_front_seats-1774703035820.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1701/20451701/interior_front_seats-1774703035820.jpg saved to cache
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5
2026-03-29 20:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_rear_driver-1774702367310.jpg> (referer: None)
2026-03-29 20:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_front_driver-1774621649127.jpg> (referer: None)
2026-03-29 20:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1927/20471927/interior_front_seats-1774687266020.jpg> (referer: None)
2026-03-29 20:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_rear_driver-1774621657414.jpg> (referer: None)
2026-03-29 20:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1927/20471927/interior_dashboard-1774689974530.jpg> (referer: None)
2026-03-29 20:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3409/20483409/interior_front_seats-1774708355112.jpg> (referer: None)
2026-03-29 20:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3409/20483409/interior_rear_seats-1774707805621.jpg> (referer: None)
2026-03-29 20:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1927/20471927/exterior_front_driver-1774689891064.jpg> (referer: None)
2026-03-29 20:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6544/10856544/docs_service_history-1774714267512.jpg?ixlib=js-3.8.0&auto=format&s=b65bcb2b34a92d201203c59ff46ae2ae> (referer: None)
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa2d1d0>
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20451701%252Fexterior_rear_driver-1774702367310.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_rear_driver-1774702367310.jpg saved to cache
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5
2026-03-29 20:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_front_driver-1774707433732.jpg> (referer: None)
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa094590>
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3436%252F19943436%252Fexterior_front_driver-1774621649127.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_front_driver-1774621649127.jpg saved to cache
2026-03-29 20:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9181ad0>
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1927%252F20471927%252Finterior_front_seats-1774687266020.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1927/20471927/interior_front_seats-1774687266020.jpg saved to cache
2026-03-29 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da984507-4cd4-5f62-b890-2dcdd36827c3
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f957cd90>
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3436%252F19943436%252Fexterior_rear_driver-1774621657414.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_rear_driver-1774621657414.jpg saved to cache
2026-03-29 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a
2026-03-29 20:00:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd00d91f-3676-5363-aae7-a0cd3cd87b0a, skipping ID generation
2026-03-29 20:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a with scrape type 1
2026-03-29 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd00d91f-3676-5363-aae7-a0cd3cd87b0a sending to next pipeline
2026-03-29 20:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bd00d91f-3676-5363-aae7-a0cd3cd87b0a, identifier: 19943436
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f916a690>
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1927%252F20471927%252Finterior_dashboard-1774689974530.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1927/20471927/interior_dashboard-1774689974530.jpg saved to cache
2026-03-29 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da984507-4cd4-5f62-b890-2dcdd36827c3
2026-03-29 20:00:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9676450>
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3409%252F20483409%252Finterior_front_seats-1774708355112.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3409/20483409/interior_front_seats-1774708355112.jpg saved to cache
2026-03-29 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22c33cbe-e27d-5abd-ae46-27988605a6a5
2026-03-29 20:00:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d1590>
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3409%252F20483409%252Finterior_rear_seats-1774707805621.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3409/20483409/interior_rear_seats-1774707805621.jpg saved to cache
2026-03-29 20:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22c33cbe-e27d-5abd-ae46-27988605a6a5
2026-03-29 20:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bd00d91f-3676-5363-aae7-a0cd3cd87b0a with identifier: 19943436
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2026-03-29 20:00:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bd00d91f-3676-5363-aae7-a0cd3cd87b0a with identifier: 19943436
2026-03-29 20:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bd00d91f-3676-5363-aae7-a0cd3cd87b0a with identifier: 19943436 to the API
2026-03-29 20:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_rear_driver-1774621657414.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bd00d91f-3676-5363-aae7-a0cd3cd87b0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KN20 FSL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19943436',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 68056,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1893166,
'Height': 2660,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_front_driver-1774621649127.jpg',
'Width': 3546},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1476347,
'Height': 2543,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_rear_driver-1774621657414.jpg',
'Width': 3391},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2054748,
'Height': 2756,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_front_passenger-1774621649725.jpg',
'Width': 3675},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1397028,
'Height': 2633,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3436/19943436/exterior_rear_passenger-1774621653432.jpg',
'Width': 3510},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 941108,
'Height': 2006,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3436/19943436/interior_front_seats-1774625215052.jpg',
'Width': 2674},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1661534,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3436/19943436/interior_rear_seats-1774622106337.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1544680,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3436/19943436/interior_dashboard-1774625343972.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641896,
'Height': 2356,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3436/19943436/instrument_cluster-1774625310750.jpg',
'Width': 3141},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253039,
'Height': 1433,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3436/19943436/interior_boot-1774625330185.jpg',
'Width': 1910},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd00d91f-3676-5363-aae7-a0cd3cd87b0a/bd00d91f-3676-5363-aae7-a0cd3cd87b0a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 694453,
'Height': 2160,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3436/19943436/docs_service_history-1774622147364.jpg?ixlib=js-3.8.0&auto=format&s=be15d3f075630c5ea20956cac2123ce5',
'Width': 3840}],
'price': 21221,
'price_includes_vat': False,
'registration_date': '2020-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Velar R-DYNAMIC HSE P300 A',
'transmission': 'automatic',
'trim': 'Velar R-DYNAMIC HSE P300 A',
'vin': 'SALYA2AX9LA265076',
'year': 2020}
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719943436%27 HTTP/1.1" 200 None
2026-03-29 20:00:43 [motorway.uk] INFO: Saving data for 19943436: {'created_time': 1774814443.190972, 'last_price_update_time': 1774814443.190985, 'auction_closing_time': 1774884600.0}
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19943436') HTTP/1.1" 204 0
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae50310>
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1927%252F20471927%252Fexterior_front_driver-1774689891064.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1927/20471927/exterior_front_driver-1774689891064.jpg saved to cache
2026-03-29 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da984507-4cd4-5f62-b890-2dcdd36827c3
2026-03-29 20:00:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae0ac10>
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6544%252F10856544%252Fdocs_service_history-1774714267512.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db65bcb2b34a92d201203c59ff46ae2ae') HTTP/1.1" 204 0
2026-03-29 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6544/10856544/docs_service_history-1774714267512.jpg?ixlib=js-3.8.0&auto=format&s=b65bcb2b34a92d201203c59ff46ae2ae saved to cache
2026-03-29 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bceb8c55-f6d9-5b75-a453-0974303194b7
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa49c50>
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20483409%252Fexterior_front_driver-1774707433732.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_front_driver-1774707433732.jpg saved to cache
2026-03-29 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22c33cbe-e27d-5abd-ae46-27988605a6a5
2026-03-29 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_front_passenger-1774707358979.jpg> (referer: None)
2026-03-29 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_front_driver-1774702164014.jpg> (referer: None)
2026-03-29 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5191/20425191/instrument_cluster-1774367993722.jpg> (referer: None)
2026-03-29 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5191/20425191/interior_dashboard-1774366645438.jpg> (referer: None)
2026-03-29 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1927/20471927/exterior_rear_passenger-1774689953212.jpg> (referer: None)
2026-03-29 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1927/20471927/exterior_front_passenger-1774689930336.jpg> (referer: None)
2026-03-29 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6544/10856544/interior_boot-1774712047669.jpg> (referer: None)
2026-03-29 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5191/20425191/interior_rear_seats-1774366614572.jpg> (referer: None)
2026-03-29 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5191/20425191/interior_boot-1774366647826.jpg> (referer: None)
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae61610>
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3409%252F20483409%252Fexterior_front_passenger-1774707358979.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_front_passenger-1774707358979.jpg saved to cache
2026-03-29 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22c33cbe-e27d-5abd-ae46-27988605a6a5
2026-03-29 20:00:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22c33cbe-e27d-5abd-ae46-27988605a6a5, skipping ID generation
2026-03-29 20:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22c33cbe-e27d-5abd-ae46-27988605a6a5 with scrape type 1
2026-03-29 20:00:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22c33cbe-e27d-5abd-ae46-27988605a6a5 sending to next pipeline
2026-03-29 20:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 22c33cbe-e27d-5abd-ae46-27988605a6a5, identifier: 20483409
2026-03-29 20:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 22c33cbe-e27d-5abd-ae46-27988605a6a5 with identifier: 20483409
2026-03-29 20:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 22c33cbe-e27d-5abd-ae46-27988605a6a5 with identifier: 20483409
2026-03-29 20:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 22c33cbe-e27d-5abd-ae46-27988605a6a5 with identifier: 20483409 to the API
2026-03-29 20:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_front_passenger-1774707358979.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '22c33cbe-e27d-5abd-ae46-27988605a6a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LY04 ONS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20483409',
'listing': 'auction',
'location': 'Surrey Leatherhead',
'make': 'Ford',
'model': 'Ranger',
'odometer': 37100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2050720,
'Height': 2906,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_front_driver-1774707433732.jpg',
'Width': 3875},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2002617,
'Height': 2713,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_rear_driver-1774707313433.jpg',
'Width': 3617},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 653431,
'Height': 1782,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_front_passenger-1774707358979.jpg',
'Width': 2376},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1650139,
'Height': 2394,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3409/20483409/exterior_rear_passenger-1774707321749.jpg',
'Width': 3192},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3882565,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3409/20483409/interior_front_seats-1774708355112.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4366017,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3409/20483409/interior_rear_seats-1774707805621.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3140891,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3409/20483409/interior_dashboard-1774707826633.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2486692,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3409/20483409/instrument_cluster-1774707730218.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4067923,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3409/20483409/interior_boot-1774708368873.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22c33cbe-e27d-5abd-ae46-27988605a6a5/22c33cbe-e27d-5abd-ae46-27988605a6a5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1299149,
'Height': 3619,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3409/20483409/docs_service_history-1774708141936.jpg?ixlib=js-3.8.0&auto=format&s=b76a20f126e237ef8f21cde0182ca2d6',
'Width': 2504}],
'price': 19311,
'price_includes_vat': False,
'registration_date': '2021-08-27',
'seats_number': None,
'seller_name': None,
'title': 'Ford Ranger Wildtrak Ecoblue 4X4 A',
'transmission': 'automatic',
'trim': 'Wildtrak Ecoblue 4X4 A',
'vin': '6FPPXXMJ2PMR22713',
'year': 2021}
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483409%27 HTTP/1.1" 200 None
2026-03-29 20:00:44 [motorway.uk] INFO: Saving data for 20483409: {'created_time': 1774814444.224566, 'last_price_update_time': 1774814444.224575, 'auction_closing_time': 1774884600.0}
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20483409') HTTP/1.1" 204 0
2026-03-29 20:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5191/20425191/exterior_front_driver-1774366289796.jpg> (referer: None)
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae60310>
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1701%252F20451701%252Fexterior_front_driver-1774702164014.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_front_driver-1774702164014.jpg saved to cache
2026-03-29 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5
2026-03-29 20:00:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55fff14e-06a5-55d9-a72b-4d1ee2a530b5, skipping ID generation
2026-03-29 20:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5 with scrape type 1
2026-03-29 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55fff14e-06a5-55d9-a72b-4d1ee2a530b5 sending to next pipeline
2026-03-29 20:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 55fff14e-06a5-55d9-a72b-4d1ee2a530b5, identifier: 20451701
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9668890>
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5191%252F20425191%252Finstrument_cluster-1774367993722.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5191/20425191/instrument_cluster-1774367993722.jpg saved to cache
2026-03-29 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf7a890>
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5191%252F20425191%252Finterior_dashboard-1774366645438.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5191/20425191/interior_dashboard-1774366645438.jpg saved to cache
2026-03-29 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f915bbd0>
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1927%252F20471927%252Fexterior_rear_passenger-1774689953212.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1927/20471927/exterior_rear_passenger-1774689953212.jpg saved to cache
2026-03-29 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da984507-4cd4-5f62-b890-2dcdd36827c3
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf6fd50>
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1927%252F20471927%252Fexterior_front_passenger-1774689930336.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1927/20471927/exterior_front_passenger-1774689930336.jpg saved to cache
2026-03-29 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da984507-4cd4-5f62-b890-2dcdd36827c3
2026-03-29 20:00:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da984507-4cd4-5f62-b890-2dcdd36827c3, skipping ID generation
2026-03-29 20:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da984507-4cd4-5f62-b890-2dcdd36827c3 with scrape type 1
2026-03-29 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da984507-4cd4-5f62-b890-2dcdd36827c3 sending to next pipeline
2026-03-29 20:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: da984507-4cd4-5f62-b890-2dcdd36827c3, identifier: 20471927
2026-03-29 20:00:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9047850>
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6544%252F10856544%252Finterior_boot-1774712047669.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6544/10856544/interior_boot-1774712047669.jpg saved to cache
2026-03-29 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bceb8c55-f6d9-5b75-a453-0974303194b7
2026-03-29 20:00:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c10850>
2026-03-29 20:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5191%252F20425191%252Finterior_rear_seats-1774366614572.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5191/20425191/interior_rear_seats-1774366614572.jpg saved to cache
2026-03-29 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f
2026-03-29 20:00:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9677410>
2026-03-29 20:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5191%252F20425191%252Finterior_boot-1774366647826.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5191/20425191/interior_boot-1774366647826.jpg saved to cache
2026-03-29 20:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f
2026-03-29 20:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 55fff14e-06a5-55d9-a72b-4d1ee2a530b5 with identifier: 20451701
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2026-03-29 20:00:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Hybrid HTTP/1.1" 200 None
2026-03-29 20:00:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 55fff14e-06a5-55d9-a72b-4d1ee2a530b5 with identifier: 20451701
2026-03-29 20:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 55fff14e-06a5-55d9-a72b-4d1ee2a530b5 with identifier: 20451701 to the API
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_front_driver-1774702164014.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '55fff14e-06a5-55d9-a72b-4d1ee2a530b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA25 NNB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20451701',
'listing': 'auction',
'location': 'Leicestershire Leicester',
'make': 'Porsche',
'model': 'Panamera',
'odometer': 9915,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 859278,
'Height': 2021,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_front_driver-1774702164014.jpg',
'Width': 2694},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 716157,
'Height': 1823,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_rear_driver-1774702367310.jpg',
'Width': 2430},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1535179,
'Height': 2462,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_front_passenger-1774702369400.jpg',
'Width': 3283},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1580986,
'Height': 2429,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1701/20451701/exterior_rear_passenger-1774702261082.jpg',
'Width': 3239},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3427741,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1701/20451701/interior_front_seats-1774703035820.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4064344,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1701/20451701/interior_rear_seats-1774703568704.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2116022,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1701/20451701/interior_dashboard-1774704388659.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1169709,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1701/20451701/instrument_cluster-1774703118896.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3212885,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1701/20451701/interior_boot-1774703737110.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55fff14e-06a5-55d9-a72b-4d1ee2a530b5/55fff14e-06a5-55d9-a72b-4d1ee2a530b5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1163107,
'Height': 2284,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1701/20451701/wheels_front_driver-1774702484760.jpg',
'Width': 3045}],
'price': 84048,
'price_includes_vat': False,
'registration_date': '2025-05-23',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Panamera 4 E-HYBRID S-A',
'transmission': 'automatic',
'trim': '4 E-HYBRID S-A',
'vin': 'WP0ZZZYA1SL046078',
'year': 2025}
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720451701%27 HTTP/1.1" 200 None
2026-03-29 20:00:46 [motorway.uk] INFO: Saving data for 20451701: {'created_time': 1774814446.106193, 'last_price_update_time': 1774814446.106203, 'auction_closing_time': 1774884600.0}
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20451701') HTTP/1.1" 204 0
2026-03-29 20:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: da984507-4cd4-5f62-b890-2dcdd36827c3 with identifier: 20471927
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White HTTP/1.1" 200 None
2026-03-29 20:00:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: da984507-4cd4-5f62-b890-2dcdd36827c3 with identifier: 20471927
2026-03-29 20:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: da984507-4cd4-5f62-b890-2dcdd36827c3 with identifier: 20471927 to the API
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/1927/20471927/exterior_front_passenger-1774689930336.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '4.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'da984507-4cd4-5f62-b890-2dcdd36827c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HX19 YYT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20471927',
'listing': 'auction',
'location': 'Central Bedfordshire Bedford',
'make': 'Aston Martin',
'model': 'Vantage',
'odometer': 31793,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1396487,
'Height': 2213,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1927/20471927/exterior_front_driver-1774689891064.jpg',
'Width': 2951},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1287958,
'Height': 2749,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1927/20471927/exterior_rear_driver-1774687797978.jpg',
'Width': 3665},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2118876,
'Height': 2558,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1927/20471927/exterior_front_passenger-1774689930336.jpg',
'Width': 3411},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1858895,
'Height': 2504,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1927/20471927/exterior_rear_passenger-1774689953212.jpg',
'Width': 3339},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1336687,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1927/20471927/interior_front_seats-1774687266020.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1521206,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1927/20471927/interior_dashboard-1774689974530.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1446211,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1927/20471927/instrument_cluster-1774687383514.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 968911,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1927/20471927/interior_boot-1774689988367.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1028704,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1927/20471927/docs_service_history-1774688451778.jpg?ixlib=js-3.8.0&auto=format&s=85d357c9887f95b7860dd980517c0ef2',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da984507-4cd4-5f62-b890-2dcdd36827c3/da984507-4cd4-5f62-b890-2dcdd36827c3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 890500,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1927/20471927/docs_service_history-1774688572873.jpg?ixlib=js-3.8.0&auto=format&s=2aa2c79e4bc11e29c92be9125f32bf04',
'Width': 3840}],
'price': 67563,
'price_includes_vat': False,
'registration_date': '2019-06-28',
'seats_number': None,
'seller_name': None,
'title': 'Aston Martin Vantage V8 Auto',
'transmission': 'automatic',
'trim': 'V8 Auto',
'vin': 'SCFSLGAWXKGN01999',
'year': 2019}
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471927%27 HTTP/1.1" 200 None
2026-03-29 20:00:46 [motorway.uk] INFO: Saving data for 20471927: {'created_time': 1774814446.625964, 'last_price_update_time': 1774814446.625986, 'auction_closing_time': 1774884600.0}
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20471927') HTTP/1.1" 204 0
2026-03-29 20:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9019650>
2026-03-29 20:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5191%252F20425191%252Fexterior_front_driver-1774366289796.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5191/20425191/exterior_front_driver-1774366289796.jpg saved to cache
2026-03-29 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f
2026-03-29 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2916/15842916/interior_dashboard-1774543405002.jpeg> (referer: None)
2026-03-29 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_rear_passenger-1774710928686.jpg> (referer: None)
2026-03-29 20:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5191/20425191/exterior_rear_driver-1774366301100.jpg> (referer: None)
2026-03-29 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2916/15842916/docs_service_history-1774544909762.jpeg?ixlib=js-3.8.0&auto=format&s=e4f52667c84312e4183d87d67cf4305a> (referer: None)
2026-03-29 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2916/15842916/15842916-instrument_cluster-modified-1774688444852.jpeg> (referer: None)
2026-03-29 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5191/20425191/exterior_front_passenger-1774691197415.jpg> (referer: None)
2026-03-29 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6544/10856544/interior_rear_seats-1774711910255.jpg> (referer: None)
2026-03-29 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2916/15842916/interior_boot-1774543390251.jpeg> (referer: None)
2026-03-29 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6544/10856544/interior_dashboard-1774711981280.jpg> (referer: None)
2026-03-29 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6544/10856544/interior_front_seats-1774711874342.jpg> (referer: None)
2026-03-29 20:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9584f90>
2026-03-29 20:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2916%252F15842916%252Finterior_dashboard-1774543405002.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2916/15842916/interior_dashboard-1774543405002.jpeg saved to cache
2026-03-29 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e
2026-03-29 20:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faef1890>
2026-03-29 20:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6544%252F10856544%252Fexterior_rear_passenger-1774710928686.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_rear_passenger-1774710928686.jpg saved to cache
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bceb8c55-f6d9-5b75-a453-0974303194b7
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93b61d0>
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5191%252F20425191%252Fexterior_rear_driver-1774366301100.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5191/20425191/exterior_rear_driver-1774366301100.jpg saved to cache
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9373750>
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2916%252F15842916%252Fdocs_service_history-1774544909762.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De4f52667c84312e4183d87d67cf4305a') HTTP/1.1" 204 0
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2916/15842916/docs_service_history-1774544909762.jpeg?ixlib=js-3.8.0&auto=format&s=e4f52667c84312e4183d87d67cf4305a saved to cache
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0e6510>
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2916%252F15842916%252F15842916-instrument_cluster-modified-1774688444852.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2916/15842916/15842916-instrument_cluster-modified-1774688444852.jpeg saved to cache
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae2c410>
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5191%252F20425191%252Fexterior_front_passenger-1774691197415.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5191/20425191/exterior_front_passenger-1774691197415.jpg saved to cache
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f
2026-03-29 20:00:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3647da9-674e-5e8b-a78d-2b18d1a2be9f, skipping ID generation
2026-03-29 20:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f with scrape type 1
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3647da9-674e-5e8b-a78d-2b18d1a2be9f sending to next pipeline
2026-03-29 20:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a3647da9-674e-5e8b-a78d-2b18d1a2be9f, identifier: 20425191
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf6ef10>
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6544%252F10856544%252Finterior_rear_seats-1774711910255.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6544/10856544/interior_rear_seats-1774711910255.jpg saved to cache
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bceb8c55-f6d9-5b75-a453-0974303194b7
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x002\xdc\xdf\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\xd8\xcd\x002\xd2]\x00\x00\x00\x00'
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86face9c50>
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2916%252F15842916%252Finterior_boot-1774543390251.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2916/15842916/interior_boot-1774543390251.jpeg saved to cache
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f963d210>
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6544%252F10856544%252Finterior_dashboard-1774711981280.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6544/10856544/interior_dashboard-1774711981280.jpg saved to cache
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bceb8c55-f6d9-5b75-a453-0974303194b7
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faef3110>
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6544%252F10856544%252Finterior_front_seats-1774711874342.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6544/10856544/interior_front_seats-1774711874342.jpg saved to cache
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bceb8c55-f6d9-5b75-a453-0974303194b7
2026-03-29 20:00:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bceb8c55-f6d9-5b75-a453-0974303194b7, skipping ID generation
2026-03-29 20:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bceb8c55-f6d9-5b75-a453-0974303194b7 with scrape type 1
2026-03-29 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bceb8c55-f6d9-5b75-a453-0974303194b7 sending to next pipeline
2026-03-29 20:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bceb8c55-f6d9-5b75-a453-0974303194b7, identifier: 10856544
2026-03-29 20:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a3647da9-674e-5e8b-a78d-2b18d1a2be9f with identifier: 20425191
2026-03-29 20:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a3647da9-674e-5e8b-a78d-2b18d1a2be9f with identifier: 20425191
2026-03-29 20:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a3647da9-674e-5e8b-a78d-2b18d1a2be9f with identifier: 20425191 to the API
2026-03-29 20:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/5191/20425191/exterior_front_passenger-1774691197415.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'a3647da9-674e-5e8b-a78d-2b18d1a2be9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE24 ZWT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20425191',
'listing': 'auction',
'location': 'Kent Gillingham',
'make': 'Land Rover',
'model': 'Defender',
'odometer': 13926,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1447708,
'Height': 2507,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5191/20425191/exterior_front_driver-1774366289796.jpg',
'Width': 3343},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1355021,
'Height': 2394,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5191/20425191/exterior_rear_driver-1774366301100.jpg',
'Width': 3192},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2223801,
'Height': 2590,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5191/20425191/exterior_front_passenger-1774691197415.jpg',
'Width': 3453},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1623090,
'Height': 2623,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5191/20425191/exterior_rear_passenger-1774366313000.jpg',
'Width': 3497},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3087070,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5191/20425191/interior_front_seats-1774366599977.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3260867,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5191/20425191/interior_rear_seats-1774366614572.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1552454,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5191/20425191/interior_dashboard-1774366645438.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1604705,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5191/20425191/instrument_cluster-1774367993722.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3654714,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5191/20425191/interior_boot-1774366647826.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3647da9-674e-5e8b-a78d-2b18d1a2be9f/a3647da9-674e-5e8b-a78d-2b18d1a2be9f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1296890,
'Height': 2373,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5191/20425191/wheels_front_driver-1774366367008.jpg',
'Width': 3164}],
'price': 55250,
'price_includes_vat': False,
'registration_date': '2024-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Defender Xdynamic HSE D MHEV A',
'transmission': 'automatic',
'trim': 'Xdynamic HSE D MHEV A',
'vin': 'SALEA6AW5R2274426',
'year': 2024}
2026-03-29 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720425191%27 HTTP/1.1" 200 None
2026-03-29 20:00:48 [motorway.uk] INFO: Saving data for 20425191: {'created_time': 1774814448.528161, 'last_price_update_time': 1774814448.528172, 'auction_closing_time': 1774884600.0}
2026-03-29 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20425191') HTTP/1.1" 204 0
2026-03-29 20:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bceb8c55-f6d9-5b75-a453-0974303194b7 with identifier: 10856544
2026-03-29 20:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bceb8c55-f6d9-5b75-a453-0974303194b7 with identifier: 10856544
2026-03-29 20:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bceb8c55-f6d9-5b75-a453-0974303194b7 with identifier: 10856544 to the API
2026-03-29 20:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6544/10856544/interior_front_seats-1774711874342.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bceb8c55-f6d9-5b75-a453-0974303194b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FT21 BXB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10856544',
'listing': 'auction',
'location': 'Buckinghamshire Beaconsfield',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 38741,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1478577,
'Height': 2202,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_front_driver-1774710873153.jpg',
'Width': 2936},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1679060,
'Height': 2427,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_rear_driver-1774710902262.jpg',
'Width': 3236},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 907884,
'Height': 1913,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_front_passenger-1774710958424.jpg',
'Width': 2551},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1010028,
'Height': 2166,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6544/10856544/exterior_rear_passenger-1774710928686.jpg',
'Width': 2888},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4415068,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6544/10856544/interior_front_seats-1774711874342.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3077490,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6544/10856544/interior_rear_seats-1774711910255.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3899150,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6544/10856544/interior_dashboard-1774711981280.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2785036,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6544/10856544/instrument_cluster-1774711917501.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2541406,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6544/10856544/interior_boot-1774712047669.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bceb8c55-f6d9-5b75-a453-0974303194b7/bceb8c55-f6d9-5b75-a453-0974303194b7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139051,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6544/10856544/docs_service_history-1774714267512.jpg?ixlib=js-3.8.0&auto=format&s=b65bcb2b34a92d201203c59ff46ae2ae',
'Width': 595}],
'price': 16746,
'price_includes_vat': False,
'registration_date': '2021-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Karoq Sportline TSI S-A',
'transmission': 'automatic',
'trim': 'Sportline TSI S-A',
'vin': 'TMBKR7NU9M5058183',
'year': 2021}
2026-03-29 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710856544%27 HTTP/1.1" 200 None
2026-03-29 20:00:48 [motorway.uk] INFO: Saving data for 10856544: {'created_time': 1774814448.929573, 'last_price_update_time': 1774814448.929586, 'auction_closing_time': 1774884600.0}
2026-03-29 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10856544') HTTP/1.1" 204 0
2026-03-29 20:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_front_passenger-1774622085400.jpg> (referer: None)
2026-03-29 20:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_rear_driver-1774543271088.jpeg> (referer: None)
2026-03-29 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_rear_passenger-1774621650120.jpg> (referer: None)
2026-03-29 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_rear_passenger-1774543255323.jpeg> (referer: None)
2026-03-29 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9963/20449963/interior_rear_seats-1774621927308.jpg> (referer: None)
2026-03-29 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9963/20449963/interior_front_seats-1774622090119.jpg> (referer: None)
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa1a0d0>
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9963%252F20449963%252Fexterior_front_passenger-1774622085400.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_front_passenger-1774622085400.jpg saved to cache
2026-03-29 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 520069de-66f2-5c24-99ff-af3c92a61b9d
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae2f5d0>
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2916%252F15842916%252Fexterior_rear_driver-1774543271088.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_rear_driver-1774543271088.jpeg saved to cache
2026-03-29 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8de9990>
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9963%252F20449963%252Fexterior_rear_passenger-1774621650120.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_rear_passenger-1774621650120.jpg saved to cache
2026-03-29 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 520069de-66f2-5c24-99ff-af3c92a61b9d
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae08550>
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2916%252F15842916%252Fexterior_rear_passenger-1774543255323.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_rear_passenger-1774543255323.jpeg saved to cache
2026-03-29 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e
2026-03-29 20:00:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f902d410>
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9963%252F20449963%252Finterior_rear_seats-1774621927308.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9963/20449963/interior_rear_seats-1774621927308.jpg saved to cache
2026-03-29 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 520069de-66f2-5c24-99ff-af3c92a61b9d
2026-03-29 20:00:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96d48d0>
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9963%252F20449963%252Finterior_front_seats-1774622090119.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9963/20449963/interior_front_seats-1774622090119.jpg saved to cache
2026-03-29 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 520069de-66f2-5c24-99ff-af3c92a61b9d
2026-03-29 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=108&page=3&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_front_passenger-1774543238507.jpeg> (referer: None)
2026-03-29 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_front_driver-1774622135278.jpg> (referer: None)
2026-03-29 20:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_rear_driver-1774622135856.jpg> (referer: None)
2026-03-29 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9286/8799286/instrument_cluster-1774615862053.jpeg> (referer: None)
2026-03-29 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9286/8799286/interior_dashboard-1774615936334.jpeg> (referer: None)
2026-03-29 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9286/8799286/interior_boot-1774615956919.jpeg> (referer: None)
2026-03-29 20:00:49 [motorway.uk] INFO: Found listing with ID: 20449304
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720449304%27 HTTP/1.1" 200 None
2026-03-29 20:00:49 [motorway.uk] INFO: Scrape type for 20449304: 1
2026-03-29 20:00:49 [motorway.uk] INFO: Found listing with ID: 17481408
2026-03-29 20:00:49 [motorway.uk] INFO: Found listing with ID: 20476083
2026-03-29 20:00:49 [motorway.uk] INFO: Found listing with ID: 20450250
2026-03-29 20:00:49 [motorway.uk] INFO: Found listing with ID: 20443071
2026-03-29 20:00:49 [motorway.uk] INFO: Found listing with ID: 20263862
2026-03-29 20:00:49 [motorway.uk] INFO: Found listing with ID: 20476478
2026-03-29 20:00:49 [motorway.uk] INFO: Found listing with ID: 20477592
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720477592%27 HTTP/1.1" 200 None
2026-03-29 20:00:49 [motorway.uk] INFO: Scrape type for 20477592: 1
2026-03-29 20:00:49 [motorway.uk] INFO: Found listing with ID: 19952830
2026-03-29 20:00:49 [motorway.uk] INFO: Found listing with ID: 19845582
2026-03-29 20:00:49 [motorway.uk] INFO: Found listing with ID: 20485961
2026-03-29 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485961%27 HTTP/1.1" 200 None
2026-03-29 20:00:50 [motorway.uk] INFO: Scrape type for 20485961: 1
2026-03-29 20:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f966b5d0>
2026-03-29 20:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2916%252F15842916%252Fexterior_front_passenger-1774543238507.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_front_passenger-1774543238507.jpeg saved to cache
2026-03-29 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e
2026-03-29 20:00:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e, skipping ID generation
2026-03-29 20:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e with scrape type 1
2026-03-29 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e sending to next pipeline
2026-03-29 20:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e, identifier: 15842916
2026-03-29 20:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700e211d0>
2026-03-29 20:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9963%252F20449963%252Fexterior_front_driver-1774622135278.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_front_driver-1774622135278.jpg saved to cache
2026-03-29 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 520069de-66f2-5c24-99ff-af3c92a61b9d
2026-03-29 20:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f905d090>
2026-03-29 20:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9963%252F20449963%252Fexterior_rear_driver-1774622135856.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_rear_driver-1774622135856.jpg saved to cache
2026-03-29 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 520069de-66f2-5c24-99ff-af3c92a61b9d
2026-03-29 20:00:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 520069de-66f2-5c24-99ff-af3c92a61b9d, skipping ID generation
2026-03-29 20:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 520069de-66f2-5c24-99ff-af3c92a61b9d with scrape type 1
2026-03-29 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 520069de-66f2-5c24-99ff-af3c92a61b9d sending to next pipeline
2026-03-29 20:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 520069de-66f2-5c24-99ff-af3c92a61b9d, identifier: 20449963
2026-03-29 20:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e with identifier: 15842916
2026-03-29 20:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e with identifier: 15842916
2026-03-29 20:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e with identifier: 15842916 to the API
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_front_passenger-1774543238507.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BA73 XUH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15842916',
'listing': 'auction',
'location': 'Staffordshire Wolverhampton',
'make': 'Land Rover',
'model': 'Defender',
'odometer': 21048,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2266863,
'Height': 2852,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_front_driver-1774543218009.jpeg',
'Width': 3802},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2407377,
'Height': 2962,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_rear_driver-1774543271088.jpeg',
'Width': 3949},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2198332,
'Height': 3008,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_front_passenger-1774543238507.jpeg',
'Width': 4011},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2199761,
'Height': 2746,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2916/15842916/exterior_rear_passenger-1774543255323.jpeg',
'Width': 3661},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3391674,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2916/15842916/interior_front_seats-1774543291315.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1355398,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2916/15842916/interior_dashboard-1774543405002.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1428503,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2916/15842916/15842916-instrument_cluster-modified-1774688444852.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3585452,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2916/15842916/interior_boot-1774543390251.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2359751,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2916/15842916/docs_service_history-1774544909762.jpeg?ixlib=js-3.8.0&auto=format&s=e4f52667c84312e4183d87d67cf4305a',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e/e7629f7a-1b6c-5dad-8d2c-fe9ff7b57c0e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3902306,
'Height': 4284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2916/15842916/docs_service_history-1774545024169.jpeg?ixlib=js-3.8.0&auto=format&s=f1de9deb3e6a2f95a4c4321028aa0acc',
'Width': 5712}],
'price': 55469,
'price_includes_vat': False,
'registration_date': '2023-12-28',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Defender Hdtp Xdyn HSE Dmhev A',
'transmission': 'automatic',
'trim': 'Hdtp Xdyn HSE Dmhev A',
'vin': 'SALEAJAW2R2286388',
'year': 2023}
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715842916%27 HTTP/1.1" 200 None
2026-03-29 20:00:50 [motorway.uk] INFO: Saving data for 15842916: {'created_time': 1774814450.920664, 'last_price_update_time': 1774814450.920677, 'auction_closing_time': 1774884600.0}
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15842916') HTTP/1.1" 204 0
2026-03-29 20:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 520069de-66f2-5c24-99ff-af3c92a61b9d with identifier: 20449963
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Blue HTTP/1.1" 200 None
2026-03-29 20:00:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 520069de-66f2-5c24-99ff-af3c92a61b9d with identifier: 20449963
2026-03-29 20:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 520069de-66f2-5c24-99ff-af3c92a61b9d with identifier: 20449963 to the API
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_rear_driver-1774622135856.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '520069de-66f2-5c24-99ff-af3c92a61b9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'J13 RXY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20449963',
'listing': 'auction',
'location': 'Gwent Newport',
'make': 'Tesla',
'model': 'Model 3',
'odometer': 6100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1245625,
'Height': 2145,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_front_driver-1774622135278.jpg',
'Width': 2860},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1079833,
'Height': 1973,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_rear_driver-1774622135856.jpg',
'Width': 2631},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1194916,
'Height': 2181,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_front_passenger-1774622085400.jpg',
'Width': 2908},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1878508,
'Height': 2570,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9963/20449963/exterior_rear_passenger-1774621650120.jpg',
'Width': 3427},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3221827,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9963/20449963/interior_front_seats-1774622090119.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3148639,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9963/20449963/interior_rear_seats-1774621927308.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2115316,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9963/20449963/interior_dashboard-1774690378580.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1608527,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9963/20449963/instrument_cluster-1774690369358.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4386200,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9963/20449963/interior_boot-1774622091799.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_520069de-66f2-5c24-99ff-af3c92a61b9d/520069de-66f2-5c24-99ff-af3c92a61b9d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1942012,
'Height': 2759,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9963/20449963/wheels_front_driver-1774622086807.jpg',
'Width': 3679}],
'price': 26613,
'price_includes_vat': False,
'registration_date': '2024-05-17',
'seats_number': None,
'seller_name': None,
'title': 'Tesla Model 3',
'transmission': 'automatic',
'trim': '',
'vin': 'LRW3F7FS9RC147343',
'year': 2024}
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720449963%27 HTTP/1.1" 200 None
2026-03-29 20:00:51 [motorway.uk] INFO: Saving data for 20449963: {'created_time': 1774814451.635539, 'last_price_update_time': 1774814451.635551, 'auction_closing_time': 1774884600.0}
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20449963') HTTP/1.1" 204 0
2026-03-29 20:00:51 [motorway.uk] INFO: Found listing with ID: 19583490
2026-03-29 20:00:51 [motorway.uk] INFO: Found listing with ID: 20485937
2026-03-29 20:00:51 [motorway.uk] INFO: Found listing with ID: 20431432
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720431432%27 HTTP/1.1" 200 None
2026-03-29 20:00:51 [motorway.uk] INFO: Scrape type for 20431432: 1
2026-03-29 20:00:51 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:00:51 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:00:51 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x18\x1d\x11\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02VY\x00\x18\x12\x8f\x00\x00\x00\x00'
2026-03-29 20:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f92889d0>
2026-03-29 20:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9286%252F8799286%252Finstrument_cluster-1774615862053.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9286/8799286/instrument_cluster-1774615862053.jpeg saved to cache
2026-03-29 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0082d07a-5000-5b85-a449-31805653c964
2026-03-29 20:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf80850>
2026-03-29 20:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9286%252F8799286%252Finterior_dashboard-1774615936334.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9286/8799286/interior_dashboard-1774615936334.jpeg saved to cache
2026-03-29 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0082d07a-5000-5b85-a449-31805653c964
2026-03-29 20:00:51 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:00:51 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:00:51 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00.\xa4H\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x93\xa7\x00.\x99\xc6\x00\x00\x00\x00'
2026-03-29 20:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700e48990>
2026-03-29 20:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9286%252F8799286%252Finterior_boot-1774615956919.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9286/8799286/interior_boot-1774615956919.jpeg saved to cache
2026-03-29 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0082d07a-5000-5b85-a449-31805653c964
2026-03-29 20:00:51 [motorway.uk] INFO: Found listing with ID: 20420321
2026-03-29 20:00:51 [motorway.uk] INFO: Found listing with ID: 19097531
2026-03-29 20:00:51 [motorway.uk] INFO: Found listing with ID: 20491041
2026-03-29 20:00:51 [motorway.uk] INFO: Found listing with ID: 15524366
2026-03-29 20:00:51 [motorway.uk] INFO: Found listing with ID: 20382551
2026-03-29 20:00:51 [motorway.uk] INFO: Found listing with ID: 20477418
2026-03-29 20:00:51 [motorway.uk] INFO: Found listing with ID: 20305532
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720305532%27 HTTP/1.1" 200 None
2026-03-29 20:00:51 [motorway.uk] INFO: Scrape type for 20305532: 1
2026-03-29 20:00:51 [motorway.uk] INFO: Found listing with ID: 18763419
2026-03-29 20:00:51 [motorway.uk] INFO: Found listing with ID: 17680882
2026-03-29 20:00:51 [motorway.uk] INFO: Found listing with ID: 8876821
2026-03-29 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278876821%27 HTTP/1.1" 200 None
2026-03-29 20:00:52 [motorway.uk] INFO: Scrape type for 8876821: 1
2026-03-29 20:00:52 [motorway.uk] INFO: Found listing with ID: 20413933
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720413933%27 HTTP/1.1" 200 None
2026-03-29 20:00:52 [motorway.uk] INFO: Scrape type for 20413933: 1
2026-03-29 20:00:52 [motorway.uk] INFO: Found listing with ID: 11696787
2026-03-29 20:00:52 [motorway.uk] INFO: Found listing with ID: 20136196
2026-03-29 20:00:52 [motorway.uk] INFO: Found listing with ID: 20500894
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720500894%27 HTTP/1.1" 200 None
2026-03-29 20:00:52 [motorway.uk] INFO: Scrape type for 20500894: 1
2026-03-29 20:00:52 [motorway.uk] INFO: Found listing with ID: 20411106
2026-03-29 20:00:52 [motorway.uk] INFO: Found listing with ID: 18971390
2026-03-29 20:00:52 [motorway.uk] INFO: Found listing with ID: 20311155
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720311155%27 HTTP/1.1" 200 None
2026-03-29 20:00:52 [motorway.uk] INFO: Scrape type for 20311155: 1
2026-03-29 20:00:52 [motorway.uk] INFO: Found listing with ID: 20401199
2026-03-29 20:00:52 [motorway.uk] INFO: Found listing with ID: 16449198
2026-03-29 20:00:52 [motorway.uk] INFO: Found listing with ID: 20386812
2026-03-29 20:00:52 [motorway.uk] INFO: Found listing with ID: 20464629
2026-03-29 20:00:52 [motorway.uk] INFO: Found listing with ID: 13048174
2026-03-29 20:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9286/8799286/exterior_rear_driver-1774615564659.jpeg> (referer: None)
2026-03-29 20:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9286/8799286/8799286-interior_front_seats-modified-1774695159514.jpeg> (referer: None)
2026-03-29 20:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9286/8799286/8799286-exterior_front_passenger-modified-1774695149033.jpeg> (referer: None)
2026-03-29 20:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9286/8799286/exterior_rear_passenger-1774615548472.jpeg> (referer: None)
2026-03-29 20:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9286/8799286/interior_rear_seats-1774615811093.jpeg> (referer: None)
2026-03-29 20:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20385350.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facf2310>
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9286%252F8799286%252Fexterior_rear_driver-1774615564659.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9286/8799286/exterior_rear_driver-1774615564659.jpeg saved to cache
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0082d07a-5000-5b85-a449-31805653c964
2026-03-29 20:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20426599.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/7899191.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17702324.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca5910>
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9286%252F8799286%252F8799286-interior_front_seats-modified-1774695159514.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9286/8799286/8799286-interior_front_seats-modified-1774695159514.jpeg saved to cache
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0082d07a-5000-5b85-a449-31805653c964
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f917a610>
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9286%252F8799286%252F8799286-exterior_front_passenger-modified-1774695149033.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9286/8799286/8799286-exterior_front_passenger-modified-1774695149033.jpeg saved to cache
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0082d07a-5000-5b85-a449-31805653c964
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faccdc90>
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9286%252F8799286%252Fexterior_rear_passenger-1774615548472.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9286/8799286/exterior_rear_passenger-1774615548472.jpeg saved to cache
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0082d07a-5000-5b85-a449-31805653c964
2026-03-29 20:00:52 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:00:52 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:00:52 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00;P\xa8\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03/S\x00;F&\x00\x00\x00\x00'
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9ffac90>
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9286%252F8799286%252Finterior_rear_seats-1774615811093.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9286/8799286/interior_rear_seats-1774615811093.jpeg saved to cache
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0082d07a-5000-5b85-a449-31805653c964
2026-03-29 20:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cebcbf1f-15a7-5526-9bdc-28fa398a3b70 with identifier: 20385350
2026-03-29 20:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cebcbf1f-15a7-5526-9bdc-28fa398a3b70 with scrape type 1
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cebcbf1f-15a7-5526-9bdc-28fa398a3b70
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5350%252F20385350%252Fexterior_front_driver-1774695190821.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5350/20385350/exterior_front_driver-1774695190821.jpeg not downloaded yet
2026-03-29 20:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94202ca3-47fb-555a-8a08-904f3385a167 with identifier: 20426599
2026-03-29 20:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94202ca3-47fb-555a-8a08-904f3385a167 with scrape type 2
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94202ca3-47fb-555a-8a08-904f3385a167 with scrape type 2
2026-03-29 20:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 94202ca3-47fb-555a-8a08-904f3385a167, identifier: 20426599
2026-03-29 20:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 902b7763-a7f1-527b-93b1-556ad912af6a with identifier: 7899191
2026-03-29 20:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 902b7763-a7f1-527b-93b1-556ad912af6a with scrape type 1
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 902b7763-a7f1-527b-93b1-556ad912af6a
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9191%252F7899191%252Fexterior_front_driver-1774704658981.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9191/7899191/exterior_front_driver-1774704658981.jpg not downloaded yet
2026-03-29 20:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1b066ee-6207-54b3-b818-136eba1f16d5 with identifier: 17702324
2026-03-29 20:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1b066ee-6207-54b3-b818-136eba1f16d5 with scrape type 1
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1b066ee-6207-54b3-b818-136eba1f16d5
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2324%252F17702324%252Fexterior_front_driver-1774705015788.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2324/17702324/exterior_front_driver-1774705015788.jpg not downloaded yet
2026-03-29 20:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 94202ca3-47fb-555a-8a08-904f3385a167 with identifier: 20426599
2026-03-29 20:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 94202ca3-47fb-555a-8a08-904f3385a167 with identifier: 20426599
2026-03-29 20:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 94202ca3-47fb-555a-8a08-904f3385a167 with identifier: 20426599 to the API
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20426599.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '94202ca3-47fb-555a-8a08-904f3385a167',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'S1 JOL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20426599',
'listing': 'auction',
'location': 'Greater Manchester Bolton',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 75687,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 25000,
'price_includes_vat': False,
'registration_date': '2020-11-24',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Rrover Sport A-BIO DYN SDV6 A',
'transmission': 'automatic',
'trim': 'Rrover Sport A-BIO DYN SDV6 A',
'vin': 'SALWA2AK0LA737743',
'year': 2020}
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720426599%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [motorway.uk] INFO: Saving data for 20426599: {'auction_closing_time': 1774884600.0, 'created_time': 1774642146.532698, 'last_price_update_time': 1774814453.302525}
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20426599') HTTP/1.1" 204 0
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5350%252F20385350%252Fexterior_rear_driver-1774695344985.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5350/20385350/exterior_rear_driver-1774695344985.jpeg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9191%252F7899191%252Fexterior_rear_driver-1774704681723.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9191/7899191/exterior_rear_driver-1774704681723.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2324%252F17702324%252Fexterior_rear_driver-1774705030931.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2324/17702324/exterior_rear_driver-1774705030931.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5350%252F20385350%252Fexterior_front_passenger-1774695231593.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5350/20385350/exterior_front_passenger-1774695231593.jpeg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9191%252F7899191%252Fexterior_front_passenger-1774704888537.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9191/7899191/exterior_front_passenger-1774704888537.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2324%252F17702324%252Fexterior_front_passenger-1774705068025.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2324/17702324/exterior_front_passenger-1774705068025.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5350%252F20385350%252Fexterior_rear_passenger-1774695327448.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5350/20385350/exterior_rear_passenger-1774695327448.jpeg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9191%252F7899191%252Fexterior_rear_passenger-1774704681625.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9191/7899191/exterior_rear_passenger-1774704681625.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2324%252F17702324%252Fexterior_rear_passenger-1774705047508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2324/17702324/exterior_rear_passenger-1774705047508.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5350%252F20385350%252Finterior_front_seats-1774695951747.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5350/20385350/interior_front_seats-1774695951747.jpeg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9191%252F7899191%252Finterior_front_seats-1774705130968.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9191/7899191/interior_front_seats-1774705130968.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2324%252F17702324%252Finterior_front_seats-1774705702523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2324/17702324/interior_front_seats-1774705702523.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5350%252F20385350%252Finterior_rear_seats-1774695992255.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5350/20385350/interior_rear_seats-1774695992255.jpeg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9191%252F7899191%252Finterior_rear_seats-1774703283391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9191/7899191/interior_rear_seats-1774703283391.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2324%252F17702324%252Finterior_rear_seats-1774705739227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2324/17702324/interior_rear_seats-1774705739227.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5350%252F20385350%252Finterior_dashboard-1774696078059.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5350/20385350/interior_dashboard-1774696078059.jpeg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9191%252F7899191%252Finterior_dashboard-1774705144537.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9191/7899191/interior_dashboard-1774705144537.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2324%252F17702324%252Finterior_dashboard-1774705439317.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2324/17702324/interior_dashboard-1774705439317.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5350%252F20385350%252Finterior_boot-1774696054174.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5350/20385350/interior_boot-1774696054174.jpeg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9191%252F7899191%252Finstrument_cluster-1774705235759.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9191/7899191/instrument_cluster-1774705235759.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2324%252F17702324%252Finstrument_cluster-1774705465701.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2324/17702324/instrument_cluster-1774705465701.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5350%252F20385350%252Fdocs_service_history-1774696427159.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df2a5eb1d19116c7bf874b28f84d90183%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5350/20385350/docs_service_history-1774696427159.jpeg?ixlib=js-3.8.0&auto=format&s=f2a5eb1d19116c7bf874b28f84d90183 not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9191%252F7899191%252Finterior_boot-1774705143810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9191/7899191/interior_boot-1774705143810.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2324%252F17702324%252Finterior_boot-1774705445734.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2324/17702324/interior_boot-1774705445734.jpg not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5350%252F20385350%252Fdocs_service_history-1774696442699.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D22fac60451e774f579998198376578f1%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5350/20385350/docs_service_history-1774696442699.jpeg?ixlib=js-3.8.0&auto=format&s=22fac60451e774f579998198376578f1 not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9191%252F7899191%252Fdocs_service_history-1774714936236.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbe849a013e67ed530640e271b9c37d70%27 HTTP/1.1" 200 None
2026-03-29 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9191/7899191/docs_service_history-1774714936236.jpg?ixlib=js-3.8.0&auto=format&s=be849a013e67ed530640e271b9c37d70 not downloaded yet
2026-03-29 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2324%252F17702324%252Fdocs_service_history-1774706137301.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D71d661a630703722bbf5b1da47c60959%27 HTTP/1.1" 200 None
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2324/17702324/docs_service_history-1774706137301.jpg?ixlib=js-3.8.0&auto=format&s=71d661a630703722bbf5b1da47c60959 not downloaded yet
2026-03-29 20:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20407866.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9286/8799286/exterior_front_driver-1774615444332.jpeg> (referer: None)
2026-03-29 20:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca957cc1-e087-52f0-ab38-673dbe500698 with identifier: 20407866
2026-03-29 20:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca957cc1-e087-52f0-ab38-673dbe500698 with scrape type 1
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca957cc1-e087-52f0-ab38-673dbe500698
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7866%252F20407866%252Fexterior_front_driver-1774706906691.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7866/20407866/exterior_front_driver-1774706906691.jpg not downloaded yet
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7866%252F20407866%252Fexterior_rear_driver-1774706749562.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7866/20407866/exterior_rear_driver-1774706749562.jpg not downloaded yet
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7866%252F20407866%252Fexterior_front_passenger-1774706895596.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7866/20407866/exterior_front_passenger-1774706895596.jpg not downloaded yet
2026-03-29 20:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86face9d50>
2026-03-29 20:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9286%252F8799286%252Fexterior_front_driver-1774615444332.jpeg') HTTP/1.1" 204 0
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9286/8799286/exterior_front_driver-1774615444332.jpeg saved to cache
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0082d07a-5000-5b85-a449-31805653c964
2026-03-29 20:00:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0082d07a-5000-5b85-a449-31805653c964, skipping ID generation
2026-03-29 20:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0082d07a-5000-5b85-a449-31805653c964 with scrape type 1
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0082d07a-5000-5b85-a449-31805653c964 sending to next pipeline
2026-03-29 20:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0082d07a-5000-5b85-a449-31805653c964, identifier: 8799286
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7866%252F20407866%252Fexterior_rear_passenger-1774706889085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7866/20407866/exterior_rear_passenger-1774706889085.jpg not downloaded yet
2026-03-29 20:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0082d07a-5000-5b85-a449-31805653c964 with identifier: 8799286
2026-03-29 20:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0082d07a-5000-5b85-a449-31805653c964 with identifier: 8799286
2026-03-29 20:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0082d07a-5000-5b85-a449-31805653c964 with identifier: 8799286 to the API
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9286/8799286/exterior_front_driver-1774615444332.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '0082d07a-5000-5b85-a449-31805653c964',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OO09 AKB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/8799286',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Audi',
'model': 'A1',
'odometer': 40180,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1320542,
'Height': 2500,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9286/8799286/exterior_front_driver-1774615444332.jpeg',
'Width': 3333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866900,
'Height': 2590,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9286/8799286/exterior_rear_driver-1774615564659.jpeg',
'Width': 3453},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1826684,
'Height': 2699,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9286/8799286/8799286-exterior_front_passenger-modified-1774695149033.jpeg',
'Width': 3599},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1852815,
'Height': 2885,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9286/8799286/exterior_rear_passenger-1774615548472.jpeg',
'Width': 3847},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1539498,
'Height': 2413,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9286/8799286/8799286-interior_front_seats-modified-1774695159514.jpeg',
'Width': 3217},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4095995,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9286/8799286/interior_rear_seats-1774615811093.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1686074,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9286/8799286/interior_dashboard-1774615936334.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1733482,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9286/8799286/instrument_cluster-1774615862053.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3225583,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9286/8799286/interior_boot-1774615956919.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0082d07a-5000-5b85-a449-31805653c964/0082d07a-5000-5b85-a449-31805653c964_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130303,
'Height': 1760,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9286/8799286/docs_service_history-1774691830180.jpeg?ixlib=js-3.8.0&auto=format&s=a3538723016d8d68c425a98f33ff3746',
'Width': 1237}],
'price': 9700,
'price_includes_vat': False,
'registration_date': '2018-01-24',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 S Line TFSI',
'transmission': 'manual',
'trim': 'S Line TFSI',
'vin': 'WAUZZZ8X2JB037993',
'year': 2018}
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278799286%27 HTTP/1.1" 200 None
2026-03-29 20:00:54 [motorway.uk] INFO: Saving data for 8799286: {'created_time': 1774814454.791251, 'last_price_update_time': 1774814454.791266, 'auction_closing_time': 1774884600.0}
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='8799286') HTTP/1.1" 204 0
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7866%252F20407866%252Finterior_front_seats-1774707451575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7866/20407866/interior_front_seats-1774707451575.jpg not downloaded yet
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7866%252F20407866%252Finterior_rear_seats-1774707474112.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7866/20407866/interior_rear_seats-1774707474112.jpg not downloaded yet
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7866%252F20407866%252Finterior_dashboard-1774707550483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7866/20407866/interior_dashboard-1774707550483.jpg not downloaded yet
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7866%252F20407866%252Finstrument_cluster-1774707543715.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7866/20407866/instrument_cluster-1774707543715.jpg not downloaded yet
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7866%252F20407866%252Finterior_boot-1774707799305.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7866/20407866/interior_boot-1774707799305.jpg not downloaded yet
2026-03-29 20:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2324/17702324/docs_service_history-1774706137301.jpg?ixlib=js-3.8.0&auto=format&s=71d661a630703722bbf5b1da47c60959> (referer: None)
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7866%252F20407866%252Fdocs_service_history-1774709972353.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D47bad0e76102f3748a10aa2fa3d1fd7e%27 HTTP/1.1" 200 None
2026-03-29 20:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7866/20407866/docs_service_history-1774709972353.jpg?ixlib=js-3.8.0&auto=format&s=47bad0e76102f3748a10aa2fa3d1fd7e not downloaded yet
2026-03-29 20:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9191/7899191/docs_service_history-1774714936236.jpg?ixlib=js-3.8.0&auto=format&s=be849a013e67ed530640e271b9c37d70> (referer: None)
2026-03-29 20:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20492157.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20184498.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4700757.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9161310>
2026-03-29 20:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1b066ee-6207-54b3-b818-136eba1f16d5/f1b066ee-6207-54b3-b818-136eba1f16d5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2324%252F17702324%252Fdocs_service_history-1774706137301.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D71d661a630703722bbf5b1da47c60959') HTTP/1.1" 204 0
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2324/17702324/docs_service_history-1774706137301.jpg?ixlib=js-3.8.0&auto=format&s=71d661a630703722bbf5b1da47c60959 saved to cache
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1b066ee-6207-54b3-b818-136eba1f16d5
2026-03-29 20:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f937d390>
2026-03-29 20:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_902b7763-a7f1-527b-93b1-556ad912af6a/902b7763-a7f1-527b-93b1-556ad912af6a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9191%252F7899191%252Fdocs_service_history-1774714936236.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbe849a013e67ed530640e271b9c37d70') HTTP/1.1" 204 0
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9191/7899191/docs_service_history-1774714936236.jpg?ixlib=js-3.8.0&auto=format&s=be849a013e67ed530640e271b9c37d70 saved to cache
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 902b7763-a7f1-527b-93b1-556ad912af6a
2026-03-29 20:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03aae4c3-7d34-599e-99a6-814f718d930e with identifier: 20492157
2026-03-29 20:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03aae4c3-7d34-599e-99a6-814f718d930e with scrape type 1
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03aae4c3-7d34-599e-99a6-814f718d930e
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2157%252F20492157%252Fexterior_front_driver-1774715901119.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2157/20492157/exterior_front_driver-1774715901119.jpg not downloaded yet
2026-03-29 20:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93fc2183-d1c8-5105-bb05-4ef76830404b with identifier: 20184498
2026-03-29 20:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93fc2183-d1c8-5105-bb05-4ef76830404b with scrape type 1
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93fc2183-d1c8-5105-bb05-4ef76830404b
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4498%252F20184498%252Fexterior_front_driver-1774706259214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4498/20184498/exterior_front_driver-1774706259214.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2157%252F20492157%252Fexterior_rear_driver-1774715929507.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2157/20492157/exterior_rear_driver-1774715929507.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4498%252F20184498%252Fexterior_rear_driver-1774706614624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4498/20184498/exterior_rear_driver-1774706614624.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2157%252F20492157%252Fexterior_front_passenger-1774786091386.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2157/20492157/exterior_front_passenger-1774786091386.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4498%252F20184498%252Fexterior_front_passenger-1774706611512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4498/20184498/exterior_front_passenger-1774706611512.jpg not downloaded yet
2026-03-29 20:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ddee793-bcce-5453-9327-103e8d3f9f0f with identifier: 4700757
2026-03-29 20:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ddee793-bcce-5453-9327-103e8d3f9f0f with scrape type 1
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ddee793-bcce-5453-9327-103e8d3f9f0f
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0757%252F4700757%252Fexterior_front_driver-1774615751721.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0757/4700757/exterior_front_driver-1774615751721.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2157%252F20492157%252Fexterior_rear_passenger-1774715943261.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2157/20492157/exterior_rear_passenger-1774715943261.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4498%252F20184498%252Fexterior_rear_passenger-1774706610971.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4498/20184498/exterior_rear_passenger-1774706610971.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0757%252F4700757%252Fexterior_rear_driver-1774615877224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0757/4700757/exterior_rear_driver-1774615877224.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2157%252F20492157%252Finterior_front_seats-1774717014938.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2157/20492157/interior_front_seats-1774717014938.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4498%252F20184498%252Finterior_front_seats-1774707086877.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4498/20184498/interior_front_seats-1774707086877.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0757%252F4700757%252Fexterior_front_passenger-1774615898916.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0757/4700757/exterior_front_passenger-1774615898916.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2157%252F20492157%252Finterior_rear_seats-1774716845731.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2157/20492157/interior_rear_seats-1774716845731.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4498%252F20184498%252Finterior_rear_seats-1774707085020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4498/20184498/interior_rear_seats-1774707085020.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0757%252F4700757%252Fexterior_rear_passenger-1774615809732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0757/4700757/exterior_rear_passenger-1774615809732.jpg not downloaded yet
2026-03-29 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485961.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2157%252F20492157%252Finterior_dashboard-1774785304078.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2157/20492157/interior_dashboard-1774785304078.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4498%252F20184498%252Finterior_dashboard-1774707100330.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4498/20184498/interior_dashboard-1774707100330.jpg not downloaded yet
2026-03-29 20:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0757%252F4700757%252Finterior_front_seats-1774617033401.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0757/4700757/interior_front_seats-1774617033401.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2157%252F20492157%252Finterior_boot-1774716900269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2157/20492157/interior_boot-1774716900269.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4498%252F20184498%252Finstrument_cluster-1774709853023.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4498/20184498/instrument_cluster-1774709853023.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0757%252F4700757%252Finterior_rear_seats-1774617068449.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0757/4700757/interior_rear_seats-1774617068449.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2157%252F20492157%252Fdocs_service_history-1774717146305.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5913b5ab06d521597f09fadb90d31265%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2157/20492157/docs_service_history-1774717146305.jpg?ixlib=js-3.8.0&auto=format&s=5913b5ab06d521597f09fadb90d31265 not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4498%252F20184498%252Finterior_boot-1774707088508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4498/20184498/interior_boot-1774707088508.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0757%252F4700757%252Finterior_dashboard-1774616987926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0757/4700757/interior_dashboard-1774616987926.jpg not downloaded yet
2026-03-29 20:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f9f7175-3960-5809-a6f2-43299ac16d9e with identifier: 20485961
2026-03-29 20:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f9f7175-3960-5809-a6f2-43299ac16d9e with scrape type 1
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f9f7175-3960-5809-a6f2-43299ac16d9e
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5961%252F20485961%252Fexterior_front_driver-1774698335183.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5961/20485961/exterior_front_driver-1774698335183.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2157%252F20492157%252Fdocs_service_history-1774717152286.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D82236c3fb18be83eb8a2ce1a92b48cdb%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2157/20492157/docs_service_history-1774717152286.jpg?ixlib=js-3.8.0&auto=format&s=82236c3fb18be83eb8a2ce1a92b48cdb not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4498%252F20184498%252Fdocs_service_history-1774708591626.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df01f7c1caf3f68bf9e12c01a5eabcdbd%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4498/20184498/docs_service_history-1774708591626.jpg?ixlib=js-3.8.0&auto=format&s=f01f7c1caf3f68bf9e12c01a5eabcdbd not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0757%252F4700757%252Finterior_boot-1774616897007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0757/4700757/interior_boot-1774616897007.jpg not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5961%252F20485961%252Fexterior_rear_driver-1774698339307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5961/20485961/exterior_rear_driver-1774698339307.jpg not downloaded yet
2026-03-29 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20431432.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0757%252F4700757%252Fdocs_service_history-1774776231372.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc693631d47d25e48f74b8fe6edf165df%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0757/4700757/docs_service_history-1774776231372.jpg?ixlib=js-3.8.0&auto=format&s=c693631d47d25e48f74b8fe6edf165df not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5961%252F20485961%252Fexterior_front_passenger-1774698341716.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5961/20485961/exterior_front_passenger-1774698341716.jpg not downloaded yet
2026-03-29 20:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0757%252F4700757%252Fdocs_service_history-1774776163554-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D44dffbefa0ac1034d2f7784eb6c35edf%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0757/4700757/docs_service_history-1774776163554-2.jpeg?ixlib=js-3.8.0&auto=format&s=44dffbefa0ac1034d2f7784eb6c35edf not downloaded yet
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5961%252F20485961%252Fexterior_rear_passenger-1774698344473.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5961/20485961/exterior_rear_passenger-1774698344473.jpg not downloaded yet
2026-03-29 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=144&page=4&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20305532.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5961%252F20485961%252Finterior_front_seats-1774699102295.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5961/20485961/interior_front_seats-1774699102295.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5961%252F20485961%252Finterior_rear_seats-1774699092146.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5961/20485961/interior_rear_seats-1774699092146.jpg not downloaded yet
2026-03-29 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20311155.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7866/20407866/interior_dashboard-1774707550483.jpg> (referer: None)
2026-03-29 20:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00960c31-dbde-5dbb-9a20-5199675d3459 with identifier: 20431432
2026-03-29 20:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00960c31-dbde-5dbb-9a20-5199675d3459 with scrape type 1
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00960c31-dbde-5dbb-9a20-5199675d3459
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1432%252F20431432%252Fexterior_front_driver-1774619366639.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1432/20431432/exterior_front_driver-1774619366639.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5961%252F20485961%252Finterior_dashboard-1774699108270.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5961/20485961/interior_dashboard-1774699108270.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1432%252F20431432%252Fexterior_rear_driver-1774619368903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1432/20431432/exterior_rear_driver-1774619368903.jpg not downloaded yet
2026-03-29 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7866/20407866/instrument_cluster-1774707543715.jpg> (referer: None)
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5961%252F20485961%252Finstrument_cluster-1774699150849.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5961/20485961/instrument_cluster-1774699150849.jpg not downloaded yet
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20490005
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 6813303
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20443922
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20487361
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20363550
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 9266502
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 19877308
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719877308%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [motorway.uk] INFO: Scrape type for 19877308: 1
2026-03-29 20:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3ef697-6928-5b72-be4c-d1c15ef506d4 with identifier: 20305532
2026-03-29 20:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3ef697-6928-5b72-be4c-d1c15ef506d4 with scrape type 1
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac3ef697-6928-5b72-be4c-d1c15ef506d4
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5532%252F20305532%252Fexterior_front_driver-1774109574194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5532/20305532/exterior_front_driver-1774109574194.jpg not downloaded yet
2026-03-29 20:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1acb0903-274d-5be2-b0f6-4427c98328d0 with identifier: 20311155
2026-03-29 20:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1acb0903-274d-5be2-b0f6-4427c98328d0 with scrape type 1
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1acb0903-274d-5be2-b0f6-4427c98328d0
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1155%252F20311155%252Fexterior_front_driver-1774616564571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1155/20311155/exterior_front_driver-1774616564571.jpg not downloaded yet
2026-03-29 20:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fade8350>
2026-03-29 20:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca957cc1-e087-52f0-ab38-673dbe500698/ca957cc1-e087-52f0-ab38-673dbe500698_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7866%252F20407866%252Finterior_dashboard-1774707550483.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7866/20407866/interior_dashboard-1774707550483.jpg saved to cache
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca957cc1-e087-52f0-ab38-673dbe500698
2026-03-29 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0757/4700757/docs_service_history-1774776163554-2.jpeg?ixlib=js-3.8.0&auto=format&s=44dffbefa0ac1034d2f7784eb6c35edf> (referer: None)
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1432%252F20431432%252Fexterior_front_passenger-1774619373951.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1432/20431432/exterior_front_passenger-1774619373951.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5961%252F20485961%252Finterior_boot-1774699094781.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5961/20485961/interior_boot-1774699094781.jpg not downloaded yet
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 17678385
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717678385%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [motorway.uk] INFO: Scrape type for 17678385: 1
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5532%252F20305532%252Fexterior_rear_driver-1774109592229.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5532/20305532/exterior_rear_driver-1774109592229.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1155%252F20311155%252Fexterior_rear_driver-1774616572065.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1155/20311155/exterior_rear_driver-1774616572065.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1432%252F20431432%252Fexterior_rear_passenger-1774619375070.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1432/20431432/exterior_rear_passenger-1774619375070.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5961%252F20485961%252Fdocs_service_history-1774699289986.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7e2dccde7787338a4d87e881e708ee60%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5961/20485961/docs_service_history-1774699289986.jpg?ixlib=js-3.8.0&auto=format&s=7e2dccde7787338a4d87e881e708ee60 not downloaded yet
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20457330
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 10427170
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710427170%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [motorway.uk] INFO: Scrape type for 10427170: 1
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5532%252F20305532%252Fexterior_front_passenger-1774109620826.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5532/20305532/exterior_front_passenger-1774109620826.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1155%252F20311155%252Fexterior_front_passenger-1774616596651.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1155/20311155/exterior_front_passenger-1774616596651.jpg not downloaded yet
2026-03-29 20:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e57d50>
2026-03-29 20:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca957cc1-e087-52f0-ab38-673dbe500698/ca957cc1-e087-52f0-ab38-673dbe500698_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7866%252F20407866%252Finstrument_cluster-1774707543715.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7866/20407866/instrument_cluster-1774707543715.jpg saved to cache
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca957cc1-e087-52f0-ab38-673dbe500698
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1432%252F20431432%252Finterior_front_seats-1774622758322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1432/20431432/interior_front_seats-1774622758322.jpg not downloaded yet
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20496977
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20251350
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20431049
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20500887
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20491991
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 19662517
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20437069
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20439564
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720439564%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [motorway.uk] INFO: Scrape type for 20439564: 1
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5532%252F20305532%252Fexterior_rear_passenger-1774109600670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5532/20305532/exterior_rear_passenger-1774109600670.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1155%252F20311155%252Fexterior_rear_passenger-1774616585801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1155/20311155/exterior_rear_passenger-1774616585801.jpg not downloaded yet
2026-03-29 20:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f967a050>
2026-03-29 20:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ddee793-bcce-5453-9327-103e8d3f9f0f/1ddee793-bcce-5453-9327-103e8d3f9f0f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0757%252F4700757%252Fdocs_service_history-1774776163554-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D44dffbefa0ac1034d2f7784eb6c35edf') HTTP/1.1" 204 0
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0757/4700757/docs_service_history-1774776163554-2.jpeg?ixlib=js-3.8.0&auto=format&s=44dffbefa0ac1034d2f7784eb6c35edf saved to cache
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ddee793-bcce-5453-9327-103e8d3f9f0f
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1432%252F20431432%252Finterior_rear_seats-1774624168161.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1432/20431432/interior_rear_seats-1774624168161.jpg not downloaded yet
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 3925743
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20473314
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 19289424
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 13901334
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 19716040
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719716040%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [motorway.uk] INFO: Scrape type for 19716040: 1
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5532%252F20305532%252Finterior_front_seats-1774110048284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5532/20305532/interior_front_seats-1774110048284.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1155%252F20311155%252Finterior_front_seats-1774617638541.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1155/20311155/interior_front_seats-1774617638541.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1432%252F20431432%252Finterior_dashboard-1774620671587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1432/20431432/interior_dashboard-1774620671587.jpg not downloaded yet
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 19665928
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20477540
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720477540%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [motorway.uk] INFO: Scrape type for 20477540: 1
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5532%252F20305532%252Finterior_rear_seats-1774110072350.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5532/20305532/interior_rear_seats-1774110072350.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1155%252F20311155%252Finterior_rear_seats-1774617866250.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1155/20311155/interior_rear_seats-1774617866250.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1432%252F20431432%252Finstrument_cluster-1774620672903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1432/20431432/instrument_cluster-1774620672903.jpg not downloaded yet
2026-03-29 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7866/20407866/interior_rear_seats-1774707474112.jpg> (referer: None)
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20488894
2026-03-29 20:00:56 [motorway.uk] INFO: Found listing with ID: 20392952
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720392952%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [motorway.uk] INFO: Scrape type for 20392952: 1
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5532%252F20305532%252Finterior_dashboard-1774110097417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5532/20305532/interior_dashboard-1774110097417.jpg not downloaded yet
2026-03-29 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1155%252F20311155%252Finterior_dashboard-1774619806893.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1155/20311155/interior_dashboard-1774619806893.jpg not downloaded yet
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1432%252F20431432%252Finterior_boot-1774620654588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1432/20431432/interior_boot-1774620654588.jpg not downloaded yet
2026-03-29 20:00:57 [motorway.uk] INFO: Found listing with ID: 20448956
2026-03-29 20:00:57 [motorway.uk] INFO: Found listing with ID: 4497838
2026-03-29 20:00:57 [motorway.uk] INFO: Found listing with ID: 20408834
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720408834%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [motorway.uk] INFO: Scrape type for 20408834: 1
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5532%252F20305532%252Finterior_boot-1774110125251.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5532/20305532/interior_boot-1774110125251.jpg not downloaded yet
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1155%252F20311155%252Finstrument_cluster-1774617214180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1155/20311155/instrument_cluster-1774617214180.jpg not downloaded yet
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1432%252F20431432%252Fdocs_service_history-1774621148605.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D845737ab3ca56bce94ea199fb2a7b7ef%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1432/20431432/docs_service_history-1774621148605.jpg?ixlib=js-3.8.0&auto=format&s=845737ab3ca56bce94ea199fb2a7b7ef not downloaded yet
2026-03-29 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20500894.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5961/20485961/exterior_rear_passenger-1774698344473.jpg> (referer: None)
2026-03-29 20:00:57 [motorway.uk] INFO: Found listing with ID: 20494023
2026-03-29 20:00:57 [motorway.uk] INFO: Found listing with ID: 19574622
2026-03-29 20:00:57 [motorway.uk] INFO: Found listing with ID: 20483061
2026-03-29 20:00:57 [motorway.uk] INFO: Found listing with ID: 20487257
2026-03-29 20:00:57 [motorway.uk] INFO: Found listing with ID: 19110205
2026-03-29 20:00:57 [motorway.uk] INFO: Found listing with ID: 7326413
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277326413%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [motorway.uk] INFO: Scrape type for 7326413: 1
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5532%252F20305532%252Fdocs_service_history-1774110243066.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc9c0c210f2624fa58b9c2cd5f082c1e1%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5532/20305532/docs_service_history-1774110243066.jpg?ixlib=js-3.8.0&auto=format&s=c9c0c210f2624fa58b9c2cd5f082c1e1 not downloaded yet
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1155%252F20311155%252Finterior_boot-1774618298620.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1155/20311155/interior_boot-1774618298620.jpg not downloaded yet
2026-03-29 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5961/20485961/exterior_front_passenger-1774698341716.jpg> (referer: None)
2026-03-29 20:00:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94aa9d0>
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca957cc1-e087-52f0-ab38-673dbe500698/ca957cc1-e087-52f0-ab38-673dbe500698_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7866%252F20407866%252Finterior_rear_seats-1774707474112.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7866/20407866/interior_rear_seats-1774707474112.jpg saved to cache
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca957cc1-e087-52f0-ab38-673dbe500698
2026-03-29 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5961/20485961/exterior_rear_driver-1774698339307.jpg> (referer: None)
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5532%252F20305532%252Fdocs_service_history-1774110243166.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D640b62eefab88c751d431aa355b6005b%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5532/20305532/docs_service_history-1774110243166.jpg?ixlib=js-3.8.0&auto=format&s=640b62eefab88c751d431aa355b6005b not downloaded yet
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1155%252F20311155%252Fdocs_service_history-1774623936437.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddf9e2adf5f5efb35a42673499aeafbe2%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1155/20311155/docs_service_history-1774623936437.png?ixlib=js-3.8.0&auto=format&s=df9e2adf5f5efb35a42673499aeafbe2 not downloaded yet
2026-03-29 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4498/20184498/interior_rear_seats-1774707085020.jpg> (referer: None)
2026-03-29 20:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fbcbd4e-0e88-5728-82d1-b855632041dc with identifier: 20500894
2026-03-29 20:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fbcbd4e-0e88-5728-82d1-b855632041dc with scrape type 1
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9fbcbd4e-0e88-5728-82d1-b855632041dc
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0894%252F20500894%252Fexterior_front_driver-1774779360512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0894/20500894/exterior_front_driver-1774779360512.jpg not downloaded yet
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb8390>
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f9f7175-3960-5809-a6f2-43299ac16d9e/8f9f7175-3960-5809-a6f2-43299ac16d9e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5961%252F20485961%252Fexterior_rear_passenger-1774698344473.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5961/20485961/exterior_rear_passenger-1774698344473.jpg saved to cache
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f9f7175-3960-5809-a6f2-43299ac16d9e
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f911cd10>
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f9f7175-3960-5809-a6f2-43299ac16d9e/8f9f7175-3960-5809-a6f2-43299ac16d9e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5961%252F20485961%252Fexterior_front_passenger-1774698341716.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5961/20485961/exterior_front_passenger-1774698341716.jpg saved to cache
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f9f7175-3960-5809-a6f2-43299ac16d9e
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0894%252F20500894%252Fexterior_rear_driver-1774781133540.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0894/20500894/exterior_rear_driver-1774781133540.jpg not downloaded yet
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f931d090>
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f9f7175-3960-5809-a6f2-43299ac16d9e/8f9f7175-3960-5809-a6f2-43299ac16d9e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5961%252F20485961%252Fexterior_rear_driver-1774698339307.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5961/20485961/exterior_rear_driver-1774698339307.jpg saved to cache
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f9f7175-3960-5809-a6f2-43299ac16d9e
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf6b090>
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93fc2183-d1c8-5105-bb05-4ef76830404b/93fc2183-d1c8-5105-bb05-4ef76830404b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4498%252F20184498%252Finterior_rear_seats-1774707085020.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4498/20184498/interior_rear_seats-1774707085020.jpg saved to cache
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93fc2183-d1c8-5105-bb05-4ef76830404b
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0894%252F20500894%252Fexterior_front_passenger-1774779347709.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0894/20500894/exterior_front_passenger-1774779347709.jpg not downloaded yet
2026-03-29 20:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20449304.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0894%252F20500894%252Fexterior_rear_passenger-1774781159100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0894/20500894/exterior_rear_passenger-1774781159100.jpg not downloaded yet
2026-03-29 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20413933.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0894%252F20500894%252Finterior_front_seats-1774780349249.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0894/20500894/interior_front_seats-1774780349249.jpg not downloaded yet
2026-03-29 20:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20477592.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0894%252F20500894%252Finterior_rear_seats-1774780365534.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0894/20500894/interior_rear_seats-1774780365534.jpg not downloaded yet
2026-03-29 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7866/20407866/interior_boot-1774707799305.jpg> (referer: None)
2026-03-29 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1155/20311155/exterior_front_driver-1774616564571.jpg> (referer: None)
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0894%252F20500894%252Finterior_dashboard-1774781194226.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0894/20500894/interior_dashboard-1774781194226.jpg not downloaded yet
2026-03-29 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1432/20431432/exterior_front_passenger-1774619373951.jpg> (referer: None)
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0894%252F20500894%252Finterior_boot-1774779583374.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0894/20500894/interior_boot-1774779583374.jpg not downloaded yet
2026-03-29 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5532/20305532/docs_service_history-1774110243166.jpg?ixlib=js-3.8.0&auto=format&s=640b62eefab88c751d431aa355b6005b> (referer: None)
2026-03-29 20:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad with identifier: 20449304
2026-03-29 20:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad with scrape type 1
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20449304%252Fexterior_front_driver-1774700927540.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20449304/exterior_front_driver-1774700927540.jpg not downloaded yet
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0894%252F20500894%252Fdocs_service_history-1774779921157.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3b3d18d71438bae89ee499d76e0c51c3%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0894/20500894/docs_service_history-1774779921157.jpg?ixlib=js-3.8.0&auto=format&s=3b3d18d71438bae89ee499d76e0c51c3 not downloaded yet
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20449304%252Fexterior_rear_driver-1774700760601.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20449304/exterior_rear_driver-1774700760601.jpg not downloaded yet
2026-03-29 20:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 032cad62-ed12-595e-aca2-d44684bdcd0c with identifier: 20413933
2026-03-29 20:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 032cad62-ed12-595e-aca2-d44684bdcd0c with scrape type 1
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 032cad62-ed12-595e-aca2-d44684bdcd0c
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3933%252F20413933%252Fexterior_front_driver-1774720271020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3933/20413933/exterior_front_driver-1774720271020.jpg not downloaded yet
2026-03-29 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1155/20311155/docs_service_history-1774623936437.png?ixlib=js-3.8.0&auto=format&s=df9e2adf5f5efb35a42673499aeafbe2> (referer: None)
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0894%252F20500894%252Fdocs_service_history-1774779929389.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6330f6e6c8b6c51cb1926878a4fc10c8%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0894/20500894/docs_service_history-1774779929389.jpg?ixlib=js-3.8.0&auto=format&s=6330f6e6c8b6c51cb1926878a4fc10c8 not downloaded yet
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20449304%252Fexterior_front_passenger-1774701085563.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20449304/exterior_front_passenger-1774701085563.jpg not downloaded yet
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3933%252F20413933%252Fexterior_rear_driver-1774720193895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3933/20413933/exterior_rear_driver-1774720193895.jpg not downloaded yet
2026-03-29 20:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70c46a71-96de-5f0e-b337-191561bbe02d with identifier: 20477592
2026-03-29 20:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70c46a71-96de-5f0e-b337-191561bbe02d with scrape type 1
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70c46a71-96de-5f0e-b337-191561bbe02d
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7592%252F20477592%252Fexterior_front_driver-1774695259390.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7592/20477592/exterior_front_driver-1774695259390.jpeg not downloaded yet
2026-03-29 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5961/20485961/interior_front_seats-1774699102295.jpg> (referer: None)
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9304%252F20449304%252Fexterior_rear_passenger-1774704457805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9304/20449304/exterior_rear_passenger-1774704457805.jpg not downloaded yet
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3933%252F20413933%252Fexterior_front_passenger-1774720333602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3933/20413933/exterior_front_passenger-1774720333602.jpg not downloaded yet
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7592%252F20477592%252Fexterior_rear_driver-1774695255843.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7592/20477592/exterior_rear_driver-1774695255843.jpeg not downloaded yet
2026-03-29 20:00:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa094bd0>
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca957cc1-e087-52f0-ab38-673dbe500698/ca957cc1-e087-52f0-ab38-673dbe500698_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7866%252F20407866%252Finterior_boot-1774707799305.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7866/20407866/interior_boot-1774707799305.jpg saved to cache
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca957cc1-e087-52f0-ab38-673dbe500698
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf7df10>
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb0903-274d-5be2-b0f6-4427c98328d0/1acb0903-274d-5be2-b0f6-4427c98328d0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1155%252F20311155%252Fexterior_front_driver-1774616564571.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1155/20311155/exterior_front_driver-1774616564571.jpg saved to cache
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1acb0903-274d-5be2-b0f6-4427c98328d0
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa113050>
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00960c31-dbde-5dbb-9a20-5199675d3459/00960c31-dbde-5dbb-9a20-5199675d3459_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1432%252F20431432%252Fexterior_front_passenger-1774619373951.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1432/20431432/exterior_front_passenger-1774619373951.jpg saved to cache
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00960c31-dbde-5dbb-9a20-5199675d3459
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f934ce90>
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3ef697-6928-5b72-be4c-d1c15ef506d4/ac3ef697-6928-5b72-be4c-d1c15ef506d4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5532%252F20305532%252Fdocs_service_history-1774110243166.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D640b62eefab88c751d431aa355b6005b') HTTP/1.1" 204 0
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5532/20305532/docs_service_history-1774110243166.jpg?ixlib=js-3.8.0&auto=format&s=640b62eefab88c751d431aa355b6005b saved to cache
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac3ef697-6928-5b72-be4c-d1c15ef506d4
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9304%252F20449304%252Finterior_front_seats-1774701662457.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9304/20449304/interior_front_seats-1774701662457.jpg not downloaded yet
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3933%252F20413933%252Fexterior_rear_passenger-1774720297175.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3933/20413933/exterior_rear_passenger-1774720297175.jpg not downloaded yet
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7592%252F20477592%252Fexterior_front_passenger-1774695357786.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7592/20477592/exterior_front_passenger-1774695357786.jpeg not downloaded yet
2026-03-29 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8876821.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9304%252F20449304%252Finterior_rear_seats-1774701470546.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9304/20449304/interior_rear_seats-1774701470546.jpg not downloaded yet
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3933%252F20413933%252Finterior_front_seats-1774721086796.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3933/20413933/interior_front_seats-1774721086796.jpg not downloaded yet
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7592%252F20477592%252Fexterior_rear_passenger-1774695431916.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7592/20477592/exterior_rear_passenger-1774695431916.jpeg not downloaded yet
2026-03-29 20:00:58 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:00:58 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 65445
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9027b90>
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb0903-274d-5be2-b0f6-4427c98328d0/1acb0903-274d-5be2-b0f6-4427c98328d0_image_9.png HTTP/1.1" 201 0
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1155%252F20311155%252Fdocs_service_history-1774623936437.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddf9e2adf5f5efb35a42673499aeafbe2') HTTP/1.1" 204 0
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1155/20311155/docs_service_history-1774623936437.png?ixlib=js-3.8.0&auto=format&s=df9e2adf5f5efb35a42673499aeafbe2 saved to cache
2026-03-29 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1acb0903-274d-5be2-b0f6-4427c98328d0
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c60350>
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f9f7175-3960-5809-a6f2-43299ac16d9e/8f9f7175-3960-5809-a6f2-43299ac16d9e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5961%252F20485961%252Finterior_front_seats-1774699102295.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5961/20485961/interior_front_seats-1774699102295.jpg saved to cache
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f9f7175-3960-5809-a6f2-43299ac16d9e
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9304%252F20449304%252Finterior_dashboard-1774703031575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9304/20449304/interior_dashboard-1774703031575.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3933%252F20413933%252Finterior_rear_seats-1774721435860.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3933/20413933/interior_rear_seats-1774721435860.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7592%252F20477592%252Finterior_front_seats-1774695615891.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7592/20477592/interior_front_seats-1774695615891.jpeg not downloaded yet
2026-03-29 20:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20444990.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 705bf3c4-31e3-5036-85bf-926e34f13abb with identifier: 8876821
2026-03-29 20:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 705bf3c4-31e3-5036-85bf-926e34f13abb with scrape type 1
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 705bf3c4-31e3-5036-85bf-926e34f13abb
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6821%252F8876821%252Fexterior_front_driver-1774688715744.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6821/8876821/exterior_front_driver-1774688715744.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9304%252F20449304%252Finstrument_cluster-1774703051123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9304/20449304/instrument_cluster-1774703051123.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3933%252F20413933%252Finterior_dashboard-1774791490823.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3933/20413933/interior_dashboard-1774791490823.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7592%252F20477592%252Finterior_dashboard-1774695706657.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7592/20477592/interior_dashboard-1774695706657.jpeg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6821%252F8876821%252Fexterior_rear_driver-1774688358841.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6821/8876821/exterior_rear_driver-1774688358841.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9304%252F20449304%252Finterior_boot-1774704573969.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9304/20449304/interior_boot-1774704573969.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3933%252F20413933%252Finstrument_cluster-1774791470293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3933/20413933/instrument_cluster-1774791470293.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7592%252F20477592%252Finstrument_cluster-1774695777485.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7592/20477592/instrument_cluster-1774695777485.jpeg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6821%252F8876821%252Fexterior_front_passenger-1774696263775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6821/8876821/exterior_front_passenger-1774696263775.jpg not downloaded yet
2026-03-29 20:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0894/20500894/exterior_front_driver-1774779360512.jpg> (referer: None)
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20449304%252Fwheels_front_driver-1774701254511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20449304/wheels_front_driver-1774701254511.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3933%252F20413933%252Finterior_boot-1774721192738.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3933/20413933/interior_boot-1774721192738.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7592%252F20477592%252Finterior_boot-1774695743926.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7592/20477592/interior_boot-1774695743926.jpeg not downloaded yet
2026-03-29 20:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7866/20407866/docs_service_history-1774709972353.jpg?ixlib=js-3.8.0&auto=format&s=47bad0e76102f3748a10aa2fa3d1fd7e> (referer: None)
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6821%252F8876821%252Fexterior_rear_passenger-1774688386685.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6821/8876821/exterior_rear_passenger-1774688386685.jpg not downloaded yet
2026-03-29 20:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 600e20f1-67f3-5fb3-ac5e-8e06785350c7 with identifier: 20444990
2026-03-29 20:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7 with scrape type 1
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Fexterior_front_driver-1774613935506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_front_driver-1774613935506.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3933%252F20413933%252Fdocs_service_history-1774791555727.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6e4da6faf7cf1ed754e3feb8881c7189%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3933/20413933/docs_service_history-1774791555727.jpg?ixlib=js-3.8.0&auto=format&s=6e4da6faf7cf1ed754e3feb8881c7189 not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7592%252F20477592%252F20477592-docs_service_history-default-1774702163822.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6620f3208ec4581fb6226d12b07f0425%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7592/20477592/20477592-docs_service_history-default-1774702163822.png?ixlib=js-3.8.0&auto=format&s=6620f3208ec4581fb6226d12b07f0425 not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6821%252F8876821%252Finterior_front_seats-1774689296586.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6821/8876821/interior_front_seats-1774689296586.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Fexterior_rear_driver-1774613957233.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_rear_driver-1774613957233.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7592%252F20477592%252F20477592-docs_service_history-default-1774702198123.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6c94df0b0c8768dda46683f90a4d20c6%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7592/20477592/20477592-docs_service_history-default-1774702198123.png?ixlib=js-3.8.0&auto=format&s=6c94df0b0c8768dda46683f90a4d20c6 not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6821%252F8876821%252Finterior_rear_seats-1774689425687.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6821/8876821/interior_rear_seats-1774689425687.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Fexterior_front_passenger-1774613990896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_front_passenger-1774613990896.jpg not downloaded yet
2026-03-29 20:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=180&page=5&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9303310>
2026-03-29 20:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbcbd4e-0e88-5728-82d1-b855632041dc/9fbcbd4e-0e88-5728-82d1-b855632041dc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0894%252F20500894%252Fexterior_front_driver-1774779360512.jpg') HTTP/1.1" 204 0
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0894/20500894/exterior_front_driver-1774779360512.jpg saved to cache
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fbcbd4e-0e88-5728-82d1-b855632041dc
2026-03-29 20:00:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:00:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:00:59 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:00:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faffa910>
2026-03-29 20:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca957cc1-e087-52f0-ab38-673dbe500698/ca957cc1-e087-52f0-ab38-673dbe500698_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7866%252F20407866%252Fdocs_service_history-1774709972353.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D47bad0e76102f3748a10aa2fa3d1fd7e') HTTP/1.1" 204 0
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7866/20407866/docs_service_history-1774709972353.jpg?ixlib=js-3.8.0&auto=format&s=47bad0e76102f3748a10aa2fa3d1fd7e saved to cache
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca957cc1-e087-52f0-ab38-673dbe500698
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6821%252F8876821%252Finterior_dashboard-1774696305533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6821/8876821/interior_dashboard-1774696305533.jpg not downloaded yet
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Fexterior_rear_passenger-1774613972772.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_rear_passenger-1774613972772.jpg not downloaded yet
2026-03-29 20:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0894/20500894/exterior_front_passenger-1774779347709.jpg> (referer: None)
2026-03-29 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1155/20311155/interior_rear_seats-1774617866250.jpg> (referer: None)
2026-03-29 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7592/20477592/exterior_front_passenger-1774695357786.jpeg> (referer: None)
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6821%252F8876821%252Finterior_boot-1774696321819.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6821/8876821/interior_boot-1774696321819.jpg not downloaded yet
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4990%252F20444990%252Finterior_front_seats-1774705965532.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4990/20444990/interior_front_seats-1774705965532.jpg not downloaded yet
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 12933192
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712933192%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [motorway.uk] INFO: Scrape type for 12933192: 1
2026-03-29 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7592/20477592/exterior_rear_driver-1774695255843.jpeg> (referer: None)
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6821%252F8876821%252Fdocs_service_history-1774692807416.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D974c6421ffb1440d51b1ec8532cb9270%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6821/8876821/docs_service_history-1774692807416.jpg?ixlib=js-3.8.0&auto=format&s=974c6421ffb1440d51b1ec8532cb9270 not downloaded yet
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4990%252F20444990%252Finterior_rear_seats-1774705998774.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4990/20444990/interior_rear_seats-1774705998774.jpg not downloaded yet
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 19413644
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20447824
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20458673
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20493712
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 19203575
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20421091
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 13065298
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 18832352
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 19439933
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20275909
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720275909%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [motorway.uk] INFO: Scrape type for 20275909: 2
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6821%252F8876821%252Fdamage_scratches-1774688835588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6821/8876821/damage_scratches-1774688835588.jpg not downloaded yet
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Finterior_dashboard-1774706045273.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/interior_dashboard-1774706045273.jpg not downloaded yet
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20423182
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20445222
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20488693
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 19816072
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719816072%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [motorway.uk] INFO: Scrape type for 19816072: 1
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae70e10>
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbcbd4e-0e88-5728-82d1-b855632041dc/9fbcbd4e-0e88-5728-82d1-b855632041dc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0894%252F20500894%252Fexterior_front_passenger-1774779347709.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0894/20500894/exterior_front_passenger-1774779347709.jpg saved to cache
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9fbcbd4e-0e88-5728-82d1-b855632041dc
2026-03-29 20:01:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f938a190>
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb0903-274d-5be2-b0f6-4427c98328d0/1acb0903-274d-5be2-b0f6-4427c98328d0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1155%252F20311155%252Finterior_rear_seats-1774617866250.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1155/20311155/interior_rear_seats-1774617866250.jpg saved to cache
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1acb0903-274d-5be2-b0f6-4427c98328d0
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facf3850>
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70c46a71-96de-5f0e-b337-191561bbe02d/70c46a71-96de-5f0e-b337-191561bbe02d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7592%252F20477592%252Fexterior_front_passenger-1774695357786.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7592/20477592/exterior_front_passenger-1774695357786.jpeg saved to cache
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70c46a71-96de-5f0e-b337-191561bbe02d
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Finstrument_cluster-1774706036859.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/instrument_cluster-1774706036859.jpg not downloaded yet
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20478238
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720478238%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [motorway.uk] INFO: Scrape type for 20478238: 1
2026-03-29 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7592/20477592/exterior_front_driver-1774695259390.jpeg> (referer: None)
2026-03-29 20:01:00 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (16059304) larger than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7592/20477592/20477592-docs_service_history-default-1774702198123.png?ixlib=js-3.8.0&auto=format&s=6c94df0b0c8768dda46683f90a4d20c6>.
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa00f190>
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70c46a71-96de-5f0e-b337-191561bbe02d/70c46a71-96de-5f0e-b337-191561bbe02d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7592%252F20477592%252Fexterior_rear_driver-1774695255843.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7592/20477592/exterior_rear_driver-1774695255843.jpeg saved to cache
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70c46a71-96de-5f0e-b337-191561bbe02d
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4990%252F20444990%252Finterior_boot-1774705845954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4990/20444990/interior_boot-1774705845954.jpg not downloaded yet
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 13689897
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713689897%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [motorway.uk] INFO: Scrape type for 13689897: 1
2026-03-29 20:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0894/20500894/exterior_rear_driver-1774781133540.jpg> (referer: None)
2026-03-29 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0894/20500894/exterior_rear_passenger-1774781159100.jpg> (referer: None)
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Fwheels_front_driver-1774614166011.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/wheels_front_driver-1774614166011.jpg not downloaded yet
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20446195
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 17461058
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717461058%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [motorway.uk] INFO: Scrape type for 17461058: 1
2026-03-29 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9304/20449304/exterior_front_passenger-1774701085563.jpg> (referer: None)
2026-03-29 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3933/20413933/exterior_front_passenger-1774720333602.jpg> (referer: None)
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20421275
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 3909564
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 19490864
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 18327972
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20286049
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 4371469
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20404359
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 9314864
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20489620
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489620%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [motorway.uk] INFO: Scrape type for 20489620: 1
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89d7b10>
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70c46a71-96de-5f0e-b337-191561bbe02d/70c46a71-96de-5f0e-b337-191561bbe02d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7592%252F20477592%252Fexterior_front_driver-1774695259390.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7592/20477592/exterior_front_driver-1774695259390.jpeg saved to cache
2026-03-29 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70c46a71-96de-5f0e-b337-191561bbe02d
2026-03-29 20:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3933/20413933/exterior_rear_driver-1774720193895.jpg> (referer: None)
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 18663443
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 18821611
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718821611%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [motorway.uk] INFO: Scrape type for 18821611: 1
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 5937182
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 19115404
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 20341600
2026-03-29 20:01:00 [motorway.uk] INFO: Found listing with ID: 19718816
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719718816%27 HTTP/1.1" 200 None
2026-03-29 20:01:00 [motorway.uk] INFO: Scrape type for 19718816: 1
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89d4310>
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbcbd4e-0e88-5728-82d1-b855632041dc/9fbcbd4e-0e88-5728-82d1-b855632041dc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0894%252F20500894%252Fexterior_rear_driver-1774781133540.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0894/20500894/exterior_rear_driver-1774781133540.jpg saved to cache
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9fbcbd4e-0e88-5728-82d1-b855632041dc
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9648ad0>
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fbcbd4e-0e88-5728-82d1-b855632041dc/9fbcbd4e-0e88-5728-82d1-b855632041dc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0894%252F20500894%252Fexterior_rear_passenger-1774781159100.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0894/20500894/exterior_rear_passenger-1774781159100.jpg saved to cache
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9fbcbd4e-0e88-5728-82d1-b855632041dc
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f929d190>
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad/3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20449304%252Fexterior_front_passenger-1774701085563.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20449304/exterior_front_passenger-1774701085563.jpg saved to cache
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae17ad0>
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_032cad62-ed12-595e-aca2-d44684bdcd0c/032cad62-ed12-595e-aca2-d44684bdcd0c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3933%252F20413933%252Fexterior_front_passenger-1774720333602.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3933/20413933/exterior_front_passenger-1774720333602.jpg saved to cache
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 032cad62-ed12-595e-aca2-d44684bdcd0c
2026-03-29 20:01:01 [motorway.uk] INFO: Found listing with ID: 19360225
2026-03-29 20:01:01 [motorway.uk] INFO: Found listing with ID: 20098323
2026-03-29 20:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabd09d0>
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_032cad62-ed12-595e-aca2-d44684bdcd0c/032cad62-ed12-595e-aca2-d44684bdcd0c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3933%252F20413933%252Fexterior_rear_driver-1774720193895.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3933/20413933/exterior_rear_driver-1774720193895.jpg saved to cache
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 032cad62-ed12-595e-aca2-d44684bdcd0c
2026-03-29 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_front_passenger-1774613990896.jpg> (referer: None)
2026-03-29 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_rear_driver-1774613957233.jpg> (referer: None)
2026-03-29 20:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9304/20449304/exterior_rear_passenger-1774704457805.jpg> (referer: None)
2026-03-29 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7592/20477592/interior_front_seats-1774695615891.jpeg> (referer: None)
2026-03-29 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6821/8876821/interior_rear_seats-1774689425687.jpg> (referer: None)
2026-03-29 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1155/20311155/interior_boot-1774618298620.jpg> (referer: None)
2026-03-29 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4990/20444990/instrument_cluster-1774706036859.jpg> (referer: None)
2026-03-29 20:01:01 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7592/20477592/20477592-docs_service_history-default-1774702198123.png?ixlib=js-3.8.0&auto=format&s=6c94df0b0c8768dda46683f90a4d20c6>.
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf99290>
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Fexterior_front_passenger-1774613990896.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_front_passenger-1774613990896.jpg saved to cache
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9049550>
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Fexterior_rear_driver-1774613957233.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_rear_driver-1774613957233.jpg saved to cache
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf74510>
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad/3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9304%252F20449304%252Fexterior_rear_passenger-1774704457805.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9304/20449304/exterior_rear_passenger-1774704457805.jpg saved to cache
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad
2026-03-29 20:01:01 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:01:01 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:01:01 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000<\x12\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03=\x8c\x0001\x9c\x00\x00\x00\x00'
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf92210>
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70c46a71-96de-5f0e-b337-191561bbe02d/70c46a71-96de-5f0e-b337-191561bbe02d_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7592%252F20477592%252Finterior_front_seats-1774695615891.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7592/20477592/interior_front_seats-1774695615891.jpeg saved to cache
2026-03-29 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70c46a71-96de-5f0e-b337-191561bbe02d
2026-03-29 20:01:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac1d390>
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6821%252F8876821%252Finterior_rear_seats-1774689425687.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6821/8876821/interior_rear_seats-1774689425687.jpg saved to cache
2026-03-29 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 705bf3c4-31e3-5036-85bf-926e34f13abb
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf90350>
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1acb0903-274d-5be2-b0f6-4427c98328d0/1acb0903-274d-5be2-b0f6-4427c98328d0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1155%252F20311155%252Finterior_boot-1774618298620.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1155/20311155/interior_boot-1774618298620.jpg saved to cache
2026-03-29 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1acb0903-274d-5be2-b0f6-4427c98328d0
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d4610>
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Finstrument_cluster-1774706036859.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/instrument_cluster-1774706036859.jpg saved to cache
2026-03-29 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7
2026-03-29 20:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4990/20444990/interior_dashboard-1774706045273.jpg> (referer: None)
2026-03-29 20:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4990/20444990/wheels_front_driver-1774614166011.jpg> (referer: None)
2026-03-29 20:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7592/20477592/20477592-docs_service_history-default-1774702198123.png?ixlib=js-3.8.0&auto=format&s=6c94df0b0c8768dda46683f90a4d20c6> (referer: None)
2026-03-29 20:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6821/8876821/docs_service_history-1774692807416.jpg?ixlib=js-3.8.0&auto=format&s=974c6421ffb1440d51b1ec8532cb9270> (referer: None)
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa116590>
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Finterior_dashboard-1774706045273.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/interior_dashboard-1774706045273.jpg saved to cache
2026-03-29 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90d7410>
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Fwheels_front_driver-1774614166011.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/wheels_front_driver-1774614166011.jpg saved to cache
2026-03-29 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7
2026-03-29 20:01:02 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:01:02 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-29 20:01:02 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90b47d0>
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70c46a71-96de-5f0e-b337-191561bbe02d/70c46a71-96de-5f0e-b337-191561bbe02d_image_9.png HTTP/1.1" 201 0
2026-03-29 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7592%252F20477592%252F20477592-docs_service_history-default-1774702198123.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6c94df0b0c8768dda46683f90a4d20c6') HTTP/1.1" 204 0
2026-03-29 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7592/20477592/20477592-docs_service_history-default-1774702198123.png?ixlib=js-3.8.0&auto=format&s=6c94df0b0c8768dda46683f90a4d20c6 saved to cache
2026-03-29 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70c46a71-96de-5f0e-b337-191561bbe02d
2026-03-29 20:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e63810>
2026-03-29 20:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6821%252F8876821%252Fdocs_service_history-1774692807416.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D974c6421ffb1440d51b1ec8532cb9270') HTTP/1.1" 204 0
2026-03-29 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6821/8876821/docs_service_history-1774692807416.jpg?ixlib=js-3.8.0&auto=format&s=974c6421ffb1440d51b1ec8532cb9270 saved to cache
2026-03-29 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 705bf3c4-31e3-5036-85bf-926e34f13abb
2026-03-29 20:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=216&page=6&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6821/8876821/damage_scratches-1774688835588.jpg> (referer: None)
2026-03-29 20:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4990/20444990/interior_boot-1774705845954.jpg> (referer: None)
2026-03-29 20:01:03 [motorway.uk] INFO: Found listing with ID: 20487615
2026-03-29 20:01:03 [motorway.uk] INFO: Found listing with ID: 20488394
2026-03-29 20:01:03 [motorway.uk] INFO: Found listing with ID: 20464062
2026-03-29 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720464062%27 HTTP/1.1" 200 None
2026-03-29 20:01:03 [motorway.uk] INFO: Scrape type for 20464062: 1
2026-03-29 20:01:03 [motorway.uk] INFO: Found listing with ID: 20134898
2026-03-29 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720134898%27 HTTP/1.1" 200 None
2026-03-29 20:01:03 [motorway.uk] INFO: Scrape type for 20134898: 1
2026-03-29 20:01:03 [motorway.uk] INFO: Found listing with ID: 19440586
2026-03-29 20:01:03 [motorway.uk] INFO: Found listing with ID: 19452010
2026-03-29 20:01:03 [motorway.uk] INFO: Found listing with ID: 10749345
2026-03-29 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710749345%27 HTTP/1.1" 200 None
2026-03-29 20:01:03 [motorway.uk] INFO: Scrape type for 10749345: 1
2026-03-29 20:01:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac25410>
2026-03-29 20:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6821%252F8876821%252Fdamage_scratches-1774688835588.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6821/8876821/damage_scratches-1774688835588.jpg saved to cache
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 705bf3c4-31e3-5036-85bf-926e34f13abb
2026-03-29 20:01:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabd0bd0>
2026-03-29 20:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4990%252F20444990%252Finterior_boot-1774705845954.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4990/20444990/interior_boot-1774705845954.jpg saved to cache
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7
2026-03-29 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4990/20444990/interior_rear_seats-1774705998774.jpg> (referer: None)
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 19842266
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20386031
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20499683
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20118034
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720118034%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [motorway.uk] INFO: Scrape type for 20118034: 1
2026-03-29 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17461058.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489620.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20172802
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720172802%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [motorway.uk] INFO: Scrape type for 20172802: 1
2026-03-29 20:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20497223
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720497223%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [motorway.uk] INFO: Scrape type for 20497223: 1
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 19286556
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719286556%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [motorway.uk] INFO: Scrape type for 19286556: 1
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20489789
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 12967935
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712967935%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [motorway.uk] INFO: Scrape type for 12967935: 1
2026-03-29 20:01:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f929f150>
2026-03-29 20:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4990%252F20444990%252Finterior_rear_seats-1774705998774.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4990/20444990/interior_rear_seats-1774705998774.jpg saved to cache
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20254078
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 7263451
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 18322763
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20406653
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20490670
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20502991
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720502991%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [motorway.uk] INFO: Scrape type for 20502991: 1
2026-03-29 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20478238.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20372589
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20158404
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 18562849
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20417323
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20485001
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20303214
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20459750
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20491811
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491811%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [motorway.uk] INFO: Scrape type for 20491811: 1
2026-03-29 20:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19816072.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20475595
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20127568
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 19344017
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719344017%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [motorway.uk] INFO: Scrape type for 19344017: 1
2026-03-29 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99c53734-619e-5b43-94d7-8aab539246a4 with identifier: 17461058
2026-03-29 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c53734-619e-5b43-94d7-8aab539246a4 with scrape type 1
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99c53734-619e-5b43-94d7-8aab539246a4
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1058%252F17461058%252Fexterior_front_driver-1773507329612.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_front_driver-1773507329612.jpg not downloaded yet
2026-03-29 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 573ed996-5ee5-5067-a474-41cb30fa1283 with identifier: 20489620
2026-03-29 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 573ed996-5ee5-5067-a474-41cb30fa1283 with scrape type 1
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 573ed996-5ee5-5067-a474-41cb30fa1283
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9620%252F20489620%252Fexterior_front_driver-1774708113599.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_front_driver-1774708113599.jpg not downloaded yet
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20260509
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 20189241
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720189241%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [motorway.uk] INFO: Scrape type for 20189241: 1
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1058%252F17461058%252Fexterior_rear_driver-1773507191875.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_rear_driver-1773507191875.jpg not downloaded yet
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9620%252F20489620%252Fexterior_rear_driver-1774708139185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_rear_driver-1774708139185.jpg not downloaded yet
2026-03-29 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_rear_passenger-1774613972772.jpg> (referer: None)
2026-03-29 20:01:04 [motorway.uk] INFO: Found listing with ID: 12732265
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712732265%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [motorway.uk] INFO: Scrape type for 12732265: 0
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1058%252F17461058%252Fexterior_front_passenger-1773507071016.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_front_passenger-1773507071016.jpg not downloaded yet
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9620%252F20489620%252Fexterior_front_passenger-1774708204632.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_front_passenger-1774708204632.jpg not downloaded yet
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1058%252F17461058%252Fexterior_rear_passenger-1773507059549.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_rear_passenger-1773507059549.jpg not downloaded yet
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9620%252F20489620%252Fexterior_rear_passenger-1774708185972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_rear_passenger-1774708185972.jpg not downloaded yet
2026-03-29 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7861f396-f52c-582c-81ee-a4b5d0be8df2 with identifier: 20478238
2026-03-29 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7861f396-f52c-582c-81ee-a4b5d0be8df2 with scrape type 1
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7861f396-f52c-582c-81ee-a4b5d0be8df2
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8238%252F20478238%252Fexterior_front_driver-1774779455780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_front_driver-1774779455780.jpg not downloaded yet
2026-03-29 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9062080-17fb-5f42-b4d5-3bc95e460639 with identifier: 19816072
2026-03-29 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9062080-17fb-5f42-b4d5-3bc95e460639 with scrape type 1
2026-03-29 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9062080-17fb-5f42-b4d5-3bc95e460639
2026-03-29 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6072%252F19816072%252Fexterior_front_driver-1774706708183.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6072/19816072/exterior_front_driver-1774706708183.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1058%252F17461058%252Finterior_front_seats-1773507835325.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1058/17461058/interior_front_seats-1773507835325.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9620%252F20489620%252Finterior_front_seats-1774709035558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9620/20489620/interior_front_seats-1774709035558.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8238%252F20478238%252Fexterior_rear_driver-1774779469606.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_rear_driver-1774779469606.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6072%252F19816072%252Fexterior_rear_driver-1774780335564.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6072/19816072/exterior_rear_driver-1774780335564.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1058%252F17461058%252Finterior_rear_seats-1773507800470.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1058/17461058/interior_rear_seats-1773507800470.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9620%252F20489620%252Finterior_rear_seats-1774709050162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9620/20489620/interior_rear_seats-1774709050162.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8238%252F20478238%252Fexterior_front_passenger-1774779491580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_front_passenger-1774779491580.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6072%252F19816072%252Fexterior_front_passenger-1774780351524.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6072/19816072/exterior_front_passenger-1774780351524.jpg not downloaded yet
2026-03-29 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d7450>
2026-03-29 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Fexterior_rear_passenger-1774613972772.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_rear_passenger-1774613972772.jpg saved to cache
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1058%252F17461058%252Finterior_dashboard-1774776045184.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1058/17461058/interior_dashboard-1774776045184.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9620%252F20489620%252Finterior_dashboard-1774715211809.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9620/20489620/interior_dashboard-1774715211809.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8238%252F20478238%252Fexterior_rear_passenger-1774779477258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_rear_passenger-1774779477258.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6072%252F19816072%252Fexterior_rear_passenger-1774706736063.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6072/19816072/exterior_rear_passenger-1774706736063.jpg not downloaded yet
2026-03-29 20:01:05 [scrapy.extensions.logstats] INFO: Crawled 50 pages (at 50 pages/min), scraped 13 items (at 13 items/min)
2026-03-29 20:01:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 243MiB
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1058%252F17461058%252Finterior_boot-1773507722801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1058/17461058/interior_boot-1773507722801.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9620%252F20489620%252Finstrument_cluster-1774715293061.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9620/20489620/instrument_cluster-1774715293061.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8238%252F20478238%252Finterior_front_seats-1774779997232.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8238/20478238/interior_front_seats-1774779997232.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6072%252F19816072%252Finterior_front_seats-1774707007865.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6072/19816072/interior_front_seats-1774707007865.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1058%252F17461058%252Fdocs_service_history-1773508348797.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3dcacf226775a20d624e505e64349c47%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1058/17461058/docs_service_history-1773508348797.jpg?ixlib=js-3.8.0&auto=format&s=3dcacf226775a20d624e505e64349c47 not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9620%252F20489620%252Finterior_boot-1774709156755.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9620/20489620/interior_boot-1774709156755.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8238%252F20478238%252Finterior_rear_seats-1774780841637.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8238/20478238/interior_rear_seats-1774780841637.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6072%252F19816072%252Finterior_rear_seats-1774707027076.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6072/19816072/interior_rear_seats-1774707027076.jpg not downloaded yet
2026-03-29 20:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6821/8876821/interior_dashboard-1774696305533.jpg> (referer: None)
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1058%252F17461058%252Fdamage_scratches-1773507465669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1058/17461058/damage_scratches-1773507465669.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9620%252F20489620%252Fdocs_service_history-1774714795216.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D97ed6ed20bed896a15f1393fdea1b287%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9620/20489620/docs_service_history-1774714795216.jpg?ixlib=js-3.8.0&auto=format&s=97ed6ed20bed896a15f1393fdea1b287 not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8238%252F20478238%252Finterior_dashboard-1774782411130.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8238/20478238/interior_dashboard-1774782411130.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6072%252F19816072%252Finterior_dashboard-1774707027249.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6072/19816072/interior_dashboard-1774707027249.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8238%252F20478238%252Finstrument_cluster-1774780075536.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8238/20478238/instrument_cluster-1774780075536.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6072%252F19816072%252Finstrument_cluster-1774780252466.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6072/19816072/instrument_cluster-1774780252466.jpg not downloaded yet
2026-03-29 20:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6821/8876821/interior_boot-1774696321819.jpg> (referer: None)
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8238%252F20478238%252Finterior_boot-1774780072498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8238/20478238/interior_boot-1774780072498.jpg not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6072%252F19816072%252Finterior_boot-1774707045790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6072/19816072/interior_boot-1774707045790.jpg not downloaded yet
2026-03-29 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca9950>
2026-03-29 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6821%252F8876821%252Finterior_dashboard-1774696305533.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6821/8876821/interior_dashboard-1774696305533.jpg saved to cache
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 705bf3c4-31e3-5036-85bf-926e34f13abb
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8238%252F20478238%252Fdocs_service_history-1774783206440.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db7f3e7b6ce4ae535f59358b755f00341%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8238/20478238/docs_service_history-1774783206440.jpg?ixlib=js-3.8.0&auto=format&s=b7f3e7b6ce4ae535f59358b755f00341 not downloaded yet
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6072%252F19816072%252Fdocs_service_history-1774779526177.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7e5e4fd1163dbe98d4ff81781fb6a77a%27 HTTP/1.1" 200 None
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6072/19816072/docs_service_history-1774779526177.jpg?ixlib=js-3.8.0&auto=format&s=7e5e4fd1163dbe98d4ff81781fb6a77a not downloaded yet
2026-03-29 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca8690>
2026-03-29 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6821%252F8876821%252Finterior_boot-1774696321819.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6821/8876821/interior_boot-1774696321819.jpg saved to cache
2026-03-29 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 705bf3c4-31e3-5036-85bf-926e34f13abb
2026-03-29 20:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6821/8876821/interior_front_seats-1774689296586.jpg> (referer: None)
2026-03-29 20:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_front_driver-1774708113599.jpg> (referer: None)
2026-03-29 20:01:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cee010>
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6821%252F8876821%252Finterior_front_seats-1774689296586.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6821/8876821/interior_front_seats-1774689296586.jpg saved to cache
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 705bf3c4-31e3-5036-85bf-926e34f13abb
2026-03-29 20:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6072/19816072/interior_front_seats-1774707007865.jpg> (referer: None)
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cdc810>
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9620%252F20489620%252Fexterior_front_driver-1774708113599.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_front_driver-1774708113599.jpg saved to cache
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 573ed996-5ee5-5067-a474-41cb30fa1283
2026-03-29 20:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4990/20444990/interior_front_seats-1774705965532.jpg> (referer: None)
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e08610>
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6072%252F19816072%252Finterior_front_seats-1774707007865.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6072/19816072/interior_front_seats-1774707007865.jpg saved to cache
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9062080-17fb-5f42-b4d5-3bc95e460639
2026-03-29 20:01:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cf2fd0>
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4990%252F20444990%252Finterior_front_seats-1774705965532.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4990/20444990/interior_front_seats-1774705965532.jpg saved to cache
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7
2026-03-29 20:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8238/20478238/docs_service_history-1774783206440.jpg?ixlib=js-3.8.0&auto=format&s=b7f3e7b6ce4ae535f59358b755f00341> (referer: None)
2026-03-29 20:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6072/19816072/docs_service_history-1774779526177.jpg?ixlib=js-3.8.0&auto=format&s=7e5e4fd1163dbe98d4ff81781fb6a77a> (referer: None)
2026-03-29 20:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19718816.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ce7690>
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8238%252F20478238%252Fdocs_service_history-1774783206440.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db7f3e7b6ce4ae535f59358b755f00341') HTTP/1.1" 204 0
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8238/20478238/docs_service_history-1774783206440.jpg?ixlib=js-3.8.0&auto=format&s=b7f3e7b6ce4ae535f59358b755f00341 saved to cache
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7861f396-f52c-582c-81ee-a4b5d0be8df2
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ccb6d0>
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6072%252F19816072%252Fdocs_service_history-1774779526177.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7e5e4fd1163dbe98d4ff81781fb6a77a') HTTP/1.1" 204 0
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6072/19816072/docs_service_history-1774779526177.jpg?ixlib=js-3.8.0&auto=format&s=7e5e4fd1163dbe98d4ff81781fb6a77a saved to cache
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9062080-17fb-5f42-b4d5-3bc95e460639
2026-03-29 20:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3ba96c5-7202-5850-b6ba-dee37c9c0815 with identifier: 19718816
2026-03-29 20:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ba96c5-7202-5850-b6ba-dee37c9c0815 with scrape type 1
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3ba96c5-7202-5850-b6ba-dee37c9c0815
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8816%252F19718816%252Fexterior_front_driver-1774710335911.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8816/19718816/exterior_front_driver-1774710335911.jpg not downloaded yet
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8816%252F19718816%252Fexterior_rear_driver-1774708423070.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8816/19718816/exterior_rear_driver-1774708423070.jpg not downloaded yet
2026-03-29 20:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6072/19816072/instrument_cluster-1774780252466.jpg> (referer: None)
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8816%252F19718816%252Fexterior_front_passenger-1774708447159.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8816/19718816/exterior_front_passenger-1774708447159.jpg not downloaded yet
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8816%252F19718816%252Fexterior_rear_passenger-1774708435331.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8816/19718816/exterior_rear_passenger-1774708435331.jpg not downloaded yet
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8816%252F19718816%252Finterior_front_seats-1774708875322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8816/19718816/interior_front_seats-1774708875322.jpg not downloaded yet
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8816%252F19718816%252Finterior_rear_seats-1774708819707.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8816/19718816/interior_rear_seats-1774708819707.jpg not downloaded yet
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8816%252F19718816%252Finterior_dashboard-1774710371367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8816/19718816/interior_dashboard-1774710371367.jpg not downloaded yet
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8816%252F19718816%252Finterior_boot-1774708841822.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8816/19718816/interior_boot-1774708841822.jpg not downloaded yet
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8816%252F19718816%252Fdocs_service_history-1774709031304.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df58c7edb62edf9e21fbb64f9fcb17649%27 HTTP/1.1" 200 None
2026-03-29 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/19718816/docs_service_history-1774709031304.jpg?ixlib=js-3.8.0&auto=format&s=f58c7edb62edf9e21fbb64f9fcb17649 not downloaded yet
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cf9fd0>
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6072%252F19816072%252Finstrument_cluster-1774780252466.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6072/19816072/instrument_cluster-1774780252466.jpg saved to cache
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9062080-17fb-5f42-b4d5-3bc95e460639
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8816%252F19718816%252Fdocs_service_history-1774709031535.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0a2c44ce4bd76c374ace83e7226b1636%27 HTTP/1.1" 200 None
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/19718816/docs_service_history-1774709031535.jpg?ixlib=js-3.8.0&auto=format&s=0a2c44ce4bd76c374ace83e7226b1636 not downloaded yet
2026-03-29 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6072/19816072/interior_dashboard-1774707027249.jpg> (referer: None)
2026-03-29 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6072/19816072/interior_boot-1774707045790.jpg> (referer: None)
2026-03-29 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8238/20478238/interior_dashboard-1774782411130.jpg> (referer: None)
2026-03-29 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8238/20478238/instrument_cluster-1774780075536.jpg> (referer: None)
2026-03-29 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8238/20478238/interior_boot-1774780072498.jpg> (referer: None)
2026-03-29 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8816/19718816/exterior_front_driver-1774710335911.jpg> (referer: None)
2026-03-29 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/19718816/docs_service_history-1774709031535.jpg?ixlib=js-3.8.0&auto=format&s=0a2c44ce4bd76c374ace83e7226b1636> (referer: None)
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa7f6d0>
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6072%252F19816072%252Finterior_dashboard-1774707027249.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6072/19816072/interior_dashboard-1774707027249.jpg saved to cache
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9062080-17fb-5f42-b4d5-3bc95e460639
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8dfbd10>
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6072%252F19816072%252Finterior_boot-1774707045790.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6072/19816072/interior_boot-1774707045790.jpg saved to cache
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9062080-17fb-5f42-b4d5-3bc95e460639
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c7c290>
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8238%252F20478238%252Finterior_dashboard-1774782411130.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8238/20478238/interior_dashboard-1774782411130.jpg saved to cache
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7861f396-f52c-582c-81ee-a4b5d0be8df2
2026-03-29 20:01:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8df97d0>
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8238%252F20478238%252Finstrument_cluster-1774780075536.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8238/20478238/instrument_cluster-1774780075536.jpg saved to cache
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7861f396-f52c-582c-81ee-a4b5d0be8df2
2026-03-29 20:01:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cb0510>
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8238%252F20478238%252Finterior_boot-1774780072498.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8238/20478238/interior_boot-1774780072498.jpg saved to cache
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7861f396-f52c-582c-81ee-a4b5d0be8df2
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cb2c10>
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8816%252F19718816%252Fexterior_front_driver-1774710335911.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8816/19718816/exterior_front_driver-1774710335911.jpg saved to cache
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3ba96c5-7202-5850-b6ba-dee37c9c0815
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb8e50>
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8816%252F19718816%252Fdocs_service_history-1774709031535.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0a2c44ce4bd76c374ace83e7226b1636') HTTP/1.1" 204 0
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/19718816/docs_service_history-1774709031535.jpg?ixlib=js-3.8.0&auto=format&s=0a2c44ce4bd76c374ace83e7226b1636 saved to cache
2026-03-29 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3ba96c5-7202-5850-b6ba-dee37c9c0815
2026-03-29 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13689897.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10749345.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/19718816/docs_service_history-1774709031304.jpg?ixlib=js-3.8.0&auto=format&s=f58c7edb62edf9e21fbb64f9fcb17649> (referer: None)
2026-03-29 20:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20134898.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20275909.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8929ef3e-878e-587f-ade2-5b8c64d1c411 with identifier: 13689897
2026-03-29 20:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8929ef3e-878e-587f-ade2-5b8c64d1c411 with scrape type 1
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8929ef3e-878e-587f-ade2-5b8c64d1c411
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9897%252F13689897%252Fexterior_front_driver-1774366422296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_front_driver-1774366422296.jpg not downloaded yet
2026-03-29 20:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef1e13cf-e6f4-5031-aa0b-b29eae6d752b with identifier: 10749345
2026-03-29 20:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b with scrape type 1
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9345%252F10749345%252Fexterior_front_driver-1774770000294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_front_driver-1774770000294.jpg not downloaded yet
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9897%252F13689897%252Fexterior_rear_driver-1774366383613.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_rear_driver-1774366383613.jpg not downloaded yet
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9345%252F10749345%252Fexterior_rear_driver-1774770019686.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_rear_driver-1774770019686.jpg not downloaded yet
2026-03-29 20:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20118034.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9620/20489620/docs_service_history-1774714795216.jpg?ixlib=js-3.8.0&auto=format&s=97ed6ed20bed896a15f1393fdea1b287> (referer: None)
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9897%252F13689897%252Fexterior_front_passenger-1774366406798.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_front_passenger-1774366406798.jpg not downloaded yet
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9345%252F10749345%252Fexterior_front_passenger-1774770017878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_front_passenger-1774770017878.jpg not downloaded yet
2026-03-29 20:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010da7d0>
2026-03-29 20:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8816%252F19718816%252Fdocs_service_history-1774709031304.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df58c7edb62edf9e21fbb64f9fcb17649') HTTP/1.1" 204 0
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/19718816/docs_service_history-1774709031304.jpg?ixlib=js-3.8.0&auto=format&s=f58c7edb62edf9e21fbb64f9fcb17649 saved to cache
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3ba96c5-7202-5850-b6ba-dee37c9c0815
2026-03-29 20:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05a87505-7635-581b-86b0-46de87939bb3 with identifier: 20134898
2026-03-29 20:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05a87505-7635-581b-86b0-46de87939bb3 with scrape type 1
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05a87505-7635-581b-86b0-46de87939bb3
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4898%252F20134898%252Fexterior_front_driver-1773059574331.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_front_driver-1773059574331.jpg not downloaded yet
2026-03-29 20:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f212fbbd-12e6-50b8-be68-90e7a852cae6 with identifier: 20275909
2026-03-29 20:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f212fbbd-12e6-50b8-be68-90e7a852cae6 with scrape type 2
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f212fbbd-12e6-50b8-be68-90e7a852cae6 with scrape type 2
2026-03-29 20:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f212fbbd-12e6-50b8-be68-90e7a852cae6, identifier: 20275909
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9897%252F13689897%252Fexterior_rear_passenger-1774366400500.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_rear_passenger-1774366400500.jpg not downloaded yet
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9345%252F10749345%252Fexterior_rear_passenger-1774770011090.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_rear_passenger-1774770011090.jpg not downloaded yet
2026-03-29 20:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f212fbbd-12e6-50b8-be68-90e7a852cae6 with identifier: 20275909
2026-03-29 20:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f212fbbd-12e6-50b8-be68-90e7a852cae6 with identifier: 20275909
2026-03-29 20:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f212fbbd-12e6-50b8-be68-90e7a852cae6 with identifier: 20275909 to the API
2026-03-29 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20275909.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'f212fbbd-12e6-50b8-be68-90e7a852cae6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RB09 RAZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20275909',
'listing': 'auction',
'location': 'Hampshire Eastleigh',
'make': 'Lexus',
'model': 'NX 300',
'odometer': 41300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 19682,
'price_includes_vat': False,
'registration_date': '2019-03-18',
'seats_number': None,
'seller_name': None,
'title': 'Lexus NX 300H F Sport CVT',
'transmission': 'automatic',
'trim': 'H F Sport CVT',
'vin': 'JTJBJRBZ102119120',
'year': 2019}
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720275909%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [motorway.uk] INFO: Saving data for 20275909: {'auction_closing_time': 1774884600.0, 'created_time': 1774728050.705516, 'last_price_update_time': 1774814469.194947}
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20275909') HTTP/1.1" 204 0
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4898%252F20134898%252Fexterior_rear_driver-1773059422122.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_rear_driver-1773059422122.jpg not downloaded yet
2026-03-29 20:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12933192.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9897%252F13689897%252Finterior_front_seats-1774451934649.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9897/13689897/interior_front_seats-1774451934649.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9345%252F10749345%252Finterior_front_seats-1774771213134.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9345/10749345/interior_front_seats-1774771213134.jpg not downloaded yet
2026-03-29 20:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20464062.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade9cef4-7ce9-55e3-8837-21e0949238bb with identifier: 20118034
2026-03-29 20:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade9cef4-7ce9-55e3-8837-21e0949238bb with scrape type 1
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ade9cef4-7ce9-55e3-8837-21e0949238bb
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8034%252F20118034%252Fexterior_front_driver-1773230007616.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_front_driver-1773230007616.jpg not downloaded yet
2026-03-29 20:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa141c50>
2026-03-29 20:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9620%252F20489620%252Fdocs_service_history-1774714795216.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D97ed6ed20bed896a15f1393fdea1b287') HTTP/1.1" 204 0
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9620/20489620/docs_service_history-1774714795216.jpg?ixlib=js-3.8.0&auto=format&s=97ed6ed20bed896a15f1393fdea1b287 saved to cache
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 573ed996-5ee5-5067-a474-41cb30fa1283
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4898%252F20134898%252Fexterior_front_passenger-1773059628082.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_front_passenger-1773059628082.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9897%252F13689897%252Finterior_rear_seats-1774456611602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9897/13689897/interior_rear_seats-1774456611602.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9345%252F10749345%252Finterior_rear_seats-1774771210806.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9345/10749345/interior_rear_seats-1774771210806.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8034%252F20118034%252Fexterior_rear_driver-1773230087097.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_rear_driver-1773230087097.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4898%252F20134898%252Fexterior_rear_passenger-1773059383204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_rear_passenger-1773059383204.jpg not downloaded yet
2026-03-29 20:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b51c9f46-b7d4-5eec-876f-8463ae7f2388 with identifier: 12933192
2026-03-29 20:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51c9f46-b7d4-5eec-876f-8463ae7f2388 with scrape type 1
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b51c9f46-b7d4-5eec-876f-8463ae7f2388
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3192%252F12933192%252Fexterior_front_driver-1774707351049.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_front_driver-1774707351049.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9897%252F13689897%252Finterior_dashboard-1774692381106.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9897/13689897/interior_dashboard-1774692381106.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9345%252F10749345%252Finterior_dashboard-1774771232244.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9345/10749345/interior_dashboard-1774771232244.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8034%252F20118034%252Fexterior_front_passenger-1773230203494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_front_passenger-1773230203494.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4898%252F20134898%252Finterior_front_seats-1773057783093.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4898/20134898/interior_front_seats-1773057783093.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3192%252F12933192%252Fexterior_rear_driver-1774707383436.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_rear_driver-1774707383436.jpg not downloaded yet
2026-03-29 20:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be282954-cfe2-586b-b784-816fddd90e9f with identifier: 20464062
2026-03-29 20:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be282954-cfe2-586b-b784-816fddd90e9f with scrape type 1
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be282954-cfe2-586b-b784-816fddd90e9f
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4062%252F20464062%252Fexterior_front_driver-1774702744266.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_front_driver-1774702744266.jpeg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9897%252F13689897%252Finstrument_cluster-1774367240322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9897/13689897/instrument_cluster-1774367240322.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9345%252F10749345%252Finstrument_cluster-1774771168297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9345/10749345/instrument_cluster-1774771168297.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8034%252F20118034%252Fexterior_rear_passenger-1773230157165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_rear_passenger-1773230157165.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4898%252F20134898%252Finterior_rear_seats-1773057863183.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4898/20134898/interior_rear_seats-1773057863183.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3192%252F12933192%252Fexterior_front_passenger-1774707423592.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_front_passenger-1774707423592.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4062%252F20464062%252Fexterior_rear_driver-1774702285415.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_rear_driver-1774702285415.jpeg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9897%252F13689897%252Finterior_boot-1774692393166.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9897/13689897/interior_boot-1774692393166.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9345%252F10749345%252Finterior_boot-1774771215095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9345/10749345/interior_boot-1774771215095.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8034%252F20118034%252Finterior_front_seats-1773230924086.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8034/20118034/interior_front_seats-1773230924086.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4898%252F20134898%252Finterior_dashboard-1773058233559.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4898/20134898/interior_dashboard-1773058233559.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3192%252F12933192%252Fexterior_rear_passenger-1774707400601.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_rear_passenger-1774707400601.jpg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4062%252F20464062%252Fexterior_front_passenger-1774702261708.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_front_passenger-1774702261708.jpeg not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9897%252F13689897%252Fdocs_service_history-1774459493704.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D740689c6e7af30b88df25b78b9f46307%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9897/13689897/docs_service_history-1774459493704.jpg?ixlib=js-3.8.0&auto=format&s=740689c6e7af30b88df25b78b9f46307 not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9345%252F10749345%252Fdocs_service_history-1774771556113.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df4fdc927df9923d92c5a2b32acb93e6b%27 HTTP/1.1" 200 None
2026-03-29 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9345/10749345/docs_service_history-1774771556113.jpg?ixlib=js-3.8.0&auto=format&s=f4fdc927df9923d92c5a2b32acb93e6b not downloaded yet
2026-03-29 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8034%252F20118034%252Finterior_rear_seats-1773231172439.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8034/20118034/interior_rear_seats-1773231172439.jpg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4898%252F20134898%252Finstrument_cluster-1773057156906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4898/20134898/instrument_cluster-1773057156906.jpg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3192%252F12933192%252Finterior_front_seats-1774708421659.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3192/12933192/interior_front_seats-1774708421659.jpg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4062%252F20464062%252Fexterior_rear_passenger-1774702259784.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_rear_passenger-1774702259784.jpeg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8034%252F20118034%252Finterior_dashboard-1773231029459.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8034/20118034/interior_dashboard-1773231029459.jpg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4898%252F20134898%252Finterior_boot-1773057742122.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4898/20134898/interior_boot-1773057742122.jpg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3192%252F12933192%252Finterior_rear_seats-1774708433865.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3192/12933192/interior_rear_seats-1774708433865.jpg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4062%252F20464062%252F20464062-interior_front_seats-modified-1774706958936.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4062/20464062/20464062-interior_front_seats-modified-1774706958936.jpeg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8034%252F20118034%252Finstrument_cluster-1773231070685.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8034/20118034/instrument_cluster-1773231070685.jpg not downloaded yet
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6072/19816072/interior_rear_seats-1774707027076.jpg> (referer: None)
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Foriented%252F4898%252F20134898%252Fdocs_service_history-1773058754430.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2397bc3c45e5f525dff78cc1a5ba01de%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/oriented/4898/20134898/docs_service_history-1773058754430.jpg?ixlib=js-3.8.0&auto=format&s=2397bc3c45e5f525dff78cc1a5ba01de not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3192%252F12933192%252Finterior_dashboard-1774708567624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3192/12933192/interior_dashboard-1774708567624.jpg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4062%252F20464062%252Finterior_rear_seats-1774702438487.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4062/20464062/interior_rear_seats-1774702438487.jpeg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8034%252F20118034%252Finterior_boot-1773231047932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8034/20118034/interior_boot-1773231047932.jpg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3192%252F12933192%252Finstrument_cluster-1774708520656.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3192/12933192/instrument_cluster-1774708520656.jpg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4062%252F20464062%252Finterior_dashboard-1774702461751.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4062/20464062/interior_dashboard-1774702461751.jpeg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8034%252F20118034%252Fdocs_service_history-1773233052351.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd38dc406ab945f9c4785f87f137bebc9%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8034/20118034/docs_service_history-1773233052351.jpg?ixlib=js-3.8.0&auto=format&s=d38dc406ab945f9c4785f87f137bebc9 not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3192%252F12933192%252Finterior_boot-1774708480860.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3192/12933192/interior_boot-1774708480860.jpg not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4062%252F20464062%252Finterior_boot-1774703492161.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4062/20464062/interior_boot-1774703492161.jpeg not downloaded yet
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94794d0>
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6072%252F19816072%252Finterior_rear_seats-1774707027076.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6072/19816072/interior_rear_seats-1774707027076.jpg saved to cache
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9062080-17fb-5f42-b4d5-3bc95e460639
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3192%252F12933192%252Fdocs_service_history-1774708852151.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D015f34c55e91a34c6b088621905a771f%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3192/12933192/docs_service_history-1774708852151.jpg?ixlib=js-3.8.0&auto=format&s=015f34c55e91a34c6b088621905a771f not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4062%252F20464062%252Fdocs_service_history-1774558552934.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2729f50334faa767eda918cc1eaeb980%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4062/20464062/docs_service_history-1774558552934.jpeg?ixlib=js-3.8.0&auto=format&s=2729f50334faa767eda918cc1eaeb980 not downloaded yet
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4062%252F20464062%252Fdocs_service_history-1774558552916.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D52d6a9bc740e5af3518a1ed182aa0e77%27 HTTP/1.1" 200 None
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4062/20464062/docs_service_history-1774558552916.jpeg?ixlib=js-3.8.0&auto=format&s=52d6a9bc740e5af3518a1ed182aa0e77 not downloaded yet
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_rear_driver-1774770019686.jpg> (referer: None)
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8816/19718816/exterior_rear_driver-1774708423070.jpg> (referer: None)
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8816/19718816/exterior_front_passenger-1774708447159.jpg> (referer: None)
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_rear_passenger-1774770011090.jpg> (referer: None)
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8816/19718816/exterior_rear_passenger-1774708435331.jpg> (referer: None)
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_rear_driver-1774366383613.jpg> (referer: None)
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8816/19718816/interior_dashboard-1774710371367.jpg> (referer: None)
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_rear_driver-1773059422122.jpg> (referer: None)
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8816/19718816/interior_rear_seats-1774708819707.jpg> (referer: None)
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8816/19718816/interior_front_seats-1774708875322.jpg> (referer: None)
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1058/17461058/damage_scratches-1773507465669.jpg> (referer: None)
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8816/19718816/interior_boot-1774708841822.jpg> (referer: None)
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4062/20464062/docs_service_history-1774558552934.jpeg?ixlib=js-3.8.0&auto=format&s=2729f50334faa767eda918cc1eaeb980> (referer: None)
2026-03-29 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4062/20464062/docs_service_history-1774558552916.jpeg?ixlib=js-3.8.0&auto=format&s=52d6a9bc740e5af3518a1ed182aa0e77> (referer: None)
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8823850>
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9345%252F10749345%252Fexterior_rear_driver-1774770019686.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_rear_driver-1774770019686.jpg saved to cache
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8af7b10>
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8816%252F19718816%252Fexterior_rear_driver-1774708423070.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8816/19718816/exterior_rear_driver-1774708423070.jpg saved to cache
2026-03-29 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3ba96c5-7202-5850-b6ba-dee37c9c0815
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89e8350>
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8816%252F19718816%252Fexterior_front_passenger-1774708447159.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8816/19718816/exterior_front_passenger-1774708447159.jpg saved to cache
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3ba96c5-7202-5850-b6ba-dee37c9c0815
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0f7c10>
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9345%252F10749345%252Fexterior_rear_passenger-1774770011090.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_rear_passenger-1774770011090.jpg saved to cache
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadef1d0>
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8816%252F19718816%252Fexterior_rear_passenger-1774708435331.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8816/19718816/exterior_rear_passenger-1774708435331.jpg saved to cache
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3ba96c5-7202-5850-b6ba-dee37c9c0815
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0f5150>
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9897%252F13689897%252Fexterior_rear_driver-1774366383613.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_rear_driver-1774366383613.jpg saved to cache
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8929ef3e-878e-587f-ade2-5b8c64d1c411
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadee910>
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8816%252F19718816%252Finterior_dashboard-1774710371367.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8816/19718816/interior_dashboard-1774710371367.jpg saved to cache
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3ba96c5-7202-5850-b6ba-dee37c9c0815
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9183090>
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4898%252F20134898%252Fexterior_rear_driver-1773059422122.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_rear_driver-1773059422122.jpg saved to cache
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05a87505-7635-581b-86b0-46de87939bb3
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadec110>
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8816%252F19718816%252Finterior_rear_seats-1774708819707.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8816/19718816/interior_rear_seats-1774708819707.jpg saved to cache
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3ba96c5-7202-5850-b6ba-dee37c9c0815
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faded950>
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8816%252F19718816%252Finterior_front_seats-1774708875322.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8816/19718816/interior_front_seats-1774708875322.jpg saved to cache
2026-03-29 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3ba96c5-7202-5850-b6ba-dee37c9c0815
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9182110>
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1058%252F17461058%252Fdamage_scratches-1773507465669.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1058/17461058/damage_scratches-1773507465669.jpg saved to cache
2026-03-29 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99c53734-619e-5b43-94d7-8aab539246a4
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89e8a90>
2026-03-29 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8816%252F19718816%252Finterior_boot-1774708841822.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8816/19718816/interior_boot-1774708841822.jpg saved to cache
2026-03-29 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3ba96c5-7202-5850-b6ba-dee37c9c0815
2026-03-29 20:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3ba96c5-7202-5850-b6ba-dee37c9c0815, skipping ID generation
2026-03-29 20:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ba96c5-7202-5850-b6ba-dee37c9c0815 with scrape type 1
2026-03-29 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3ba96c5-7202-5850-b6ba-dee37c9c0815 sending to next pipeline
2026-03-29 20:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a3ba96c5-7202-5850-b6ba-dee37c9c0815, identifier: 19718816
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c14b50>
2026-03-29 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4062%252F20464062%252Fdocs_service_history-1774558552934.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2729f50334faa767eda918cc1eaeb980') HTTP/1.1" 204 0
2026-03-29 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4062/20464062/docs_service_history-1774558552934.jpeg?ixlib=js-3.8.0&auto=format&s=2729f50334faa767eda918cc1eaeb980 saved to cache
2026-03-29 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be282954-cfe2-586b-b784-816fddd90e9f
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8803610>
2026-03-29 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4062%252F20464062%252Fdocs_service_history-1774558552916.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D52d6a9bc740e5af3518a1ed182aa0e77') HTTP/1.1" 204 0
2026-03-29 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4062/20464062/docs_service_history-1774558552916.jpeg?ixlib=js-3.8.0&auto=format&s=52d6a9bc740e5af3518a1ed182aa0e77 saved to cache
2026-03-29 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be282954-cfe2-586b-b784-816fddd90e9f
2026-03-29 20:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a3ba96c5-7202-5850-b6ba-dee37c9c0815 with identifier: 19718816
2026-03-29 20:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a3ba96c5-7202-5850-b6ba-dee37c9c0815 with identifier: 19718816
2026-03-29 20:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a3ba96c5-7202-5850-b6ba-dee37c9c0815 with identifier: 19718816 to the API
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8816/19718816/interior_boot-1774708841822.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a3ba96c5-7202-5850-b6ba-dee37c9c0815',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LC19 OCD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19718816',
'listing': 'auction',
'location': 'Surrey Guildford',
'make': 'Porsche',
'model': 'Macan',
'odometer': 38000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2861443,
'Height': 2733,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8816/19718816/exterior_front_driver-1774710335911.jpg',
'Width': 3644},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2203359,
'Height': 2581,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8816/19718816/exterior_rear_driver-1774708423070.jpg',
'Width': 3441},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2443747,
'Height': 2806,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8816/19718816/exterior_front_passenger-1774708447159.jpg',
'Width': 3741},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2483195,
'Height': 2888,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8816/19718816/exterior_rear_passenger-1774708435331.jpg',
'Width': 3850},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3845178,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8816/19718816/interior_front_seats-1774708875322.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3586341,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8816/19718816/interior_rear_seats-1774708819707.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2939666,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8816/19718816/interior_dashboard-1774710371367.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4815939,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8816/19718816/interior_boot-1774708841822.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 691601,
'Height': 3548,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/19718816/docs_service_history-1774709031304.jpg?ixlib=js-3.8.0&auto=format&s=f58c7edb62edf9e21fbb64f9fcb17649',
'Width': 2456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ba96c5-7202-5850-b6ba-dee37c9c0815/a3ba96c5-7202-5850-b6ba-dee37c9c0815_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640640,
'Height': 3480,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/19718816/docs_service_history-1774709031535.jpg?ixlib=js-3.8.0&auto=format&s=0a2c44ce4bd76c374ace83e7226b1636',
'Width': 2429}],
'price': 31849,
'price_includes_vat': False,
'registration_date': '2019-05-03',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Macan S S-A',
'transmission': 'automatic',
'trim': 'S S-A',
'vin': 'WP1ZZZ95ZKLB25089',
'year': 2019}
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719718816%27 HTTP/1.1" 200 None
2026-03-29 20:01:12 [motorway.uk] INFO: Saving data for 19718816: {'created_time': 1774814472.947904, 'last_price_update_time': 1774814472.947916, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19718816') HTTP/1.1" 204 0
2026-03-29 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20502991.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4062/20464062/20464062-interior_front_seats-modified-1774706958936.jpeg> (referer: None)
2026-03-29 20:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6767baf3-fedb-58e3-b2ad-e2ef20d582e9 with identifier: 20502991
2026-03-29 20:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9 with scrape type 1
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2991%252F20502991%252Fexterior_front_driver-1774786429659.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_front_driver-1774786429659.jpg not downloaded yet
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2991%252F20502991%252Fexterior_rear_driver-1774786533779.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_rear_driver-1774786533779.jpg not downloaded yet
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2991%252F20502991%252Fexterior_front_passenger-1774786565675.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_front_passenger-1774786565675.jpg not downloaded yet
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f91819d0>
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4062%252F20464062%252F20464062-interior_front_seats-modified-1774706958936.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4062/20464062/20464062-interior_front_seats-modified-1774706958936.jpeg saved to cache
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be282954-cfe2-586b-b784-816fddd90e9f
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2991%252F20502991%252Fexterior_rear_passenger-1774786534120.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_rear_passenger-1774786534120.jpg not downloaded yet
2026-03-29 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20491811.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2991%252F20502991%252Finterior_front_seats-1774787057646.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2991/20502991/interior_front_seats-1774787057646.jpg not downloaded yet
2026-03-29 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8034/20118034/docs_service_history-1773233052351.jpg?ixlib=js-3.8.0&auto=format&s=d38dc406ab945f9c4785f87f137bebc9> (referer: None)
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2991%252F20502991%252Finterior_rear_seats-1774787069389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2991/20502991/interior_rear_seats-1774787069389.jpg not downloaded yet
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2991%252F20502991%252Finterior_dashboard-1774796530551.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2991/20502991/interior_dashboard-1774796530551.jpg not downloaded yet
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2991%252F20502991%252Finstrument_cluster-1774787169287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2991/20502991/instrument_cluster-1774787169287.jpg not downloaded yet
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2991%252F20502991%252Finterior_boot-1774787124772.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2991/20502991/interior_boot-1774787124772.jpg not downloaded yet
2026-03-29 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/oriented/4898/20134898/docs_service_history-1773058754430.jpg?ixlib=js-3.8.0&auto=format&s=2397bc3c45e5f525dff78cc1a5ba01de> (referer: None)
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2991%252F20502991%252Fdocs_service_history-1774787527964.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df93c9de8bbb73df7d3580fcae7db0bce%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2991/20502991/docs_service_history-1774787527964.jpg?ixlib=js-3.8.0&auto=format&s=f93c9de8bbb73df7d3580fcae7db0bce not downloaded yet
2026-03-29 20:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e07fcea-96b9-581d-bf56-185811ae97f5 with identifier: 20491811
2026-03-29 20:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e07fcea-96b9-581d-bf56-185811ae97f5 with scrape type 1
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e07fcea-96b9-581d-bf56-185811ae97f5
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F20491811%252Fexterior_front_driver-1774715161464.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/20491811/exterior_front_driver-1774715161464.jpg not downloaded yet
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1811%252F20491811%252Fexterior_rear_driver-1774772497854.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1811/20491811/exterior_rear_driver-1774772497854.jpg not downloaded yet
2026-03-29 20:01:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f34f90>
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8034%252F20118034%252Fdocs_service_history-1773233052351.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd38dc406ab945f9c4785f87f137bebc9') HTTP/1.1" 204 0
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8034/20118034/docs_service_history-1773233052351.jpg?ixlib=js-3.8.0&auto=format&s=d38dc406ab945f9c4785f87f137bebc9 saved to cache
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ade9cef4-7ce9-55e3-8837-21e0949238bb
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1811%252F20491811%252Fexterior_front_passenger-1774774312605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1811/20491811/exterior_front_passenger-1774774312605.jpg not downloaded yet
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F20491811%252Fexterior_rear_passenger-1774715202502.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/20491811/exterior_rear_passenger-1774715202502.jpg not downloaded yet
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9472010>
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Foriented%252F4898%252F20134898%252Fdocs_service_history-1773058754430.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2397bc3c45e5f525dff78cc1a5ba01de') HTTP/1.1" 204 0
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/oriented/4898/20134898/docs_service_history-1773058754430.jpg?ixlib=js-3.8.0&auto=format&s=2397bc3c45e5f525dff78cc1a5ba01de saved to cache
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05a87505-7635-581b-86b0-46de87939bb3
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1811%252F20491811%252Finterior_front_seats-1774716967996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1811/20491811/interior_front_seats-1774716967996.jpg not downloaded yet
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F20491811%252Finterior_dashboard-1774716991132.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/20491811/interior_dashboard-1774716991132.jpg not downloaded yet
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F20491811%252Finstrument_cluster-1774717026884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/20491811/instrument_cluster-1774717026884.jpg not downloaded yet
2026-03-29 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8034/20118034/interior_dashboard-1773231029459.jpg> (referer: None)
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1811%252F20491811%252Finterior_boot-1774717724544.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1811/20491811/interior_boot-1774717724544.jpg not downloaded yet
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1811%252F20491811%252Fdocs_service_history-1774718134354.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D30c6b517076b0be472c96a9858c2c54f%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1811/20491811/docs_service_history-1774718134354.jpg?ixlib=js-3.8.0&auto=format&s=30c6b517076b0be472c96a9858c2c54f not downloaded yet
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1811%252F20491811%252Fdocs_service_history-1774718144688.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5936679e2c58ca5f499f157f7664d6ff%27 HTTP/1.1" 200 None
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1811/20491811/docs_service_history-1774718144688.jpg?ixlib=js-3.8.0&auto=format&s=5936679e2c58ca5f499f157f7664d6ff not downloaded yet
2026-03-29 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4062/20464062/interior_dashboard-1774702461751.jpeg> (referer: None)
2026-03-29 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8034/20118034/instrument_cluster-1773231070685.jpg> (referer: None)
2026-03-29 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3192/12933192/instrument_cluster-1774708520656.jpg> (referer: None)
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb3410>
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8034%252F20118034%252Finterior_dashboard-1773231029459.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8034/20118034/interior_dashboard-1773231029459.jpg saved to cache
2026-03-29 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ade9cef4-7ce9-55e3-8837-21e0949238bb
2026-03-29 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4062/20464062/interior_rear_seats-1774702438487.jpeg> (referer: None)
2026-03-29 20:01:13 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:01:13 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:01:13 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00$j\x85\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xbcY\x00$`\x93\x00\x00\x00\x00'
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8bfcf10>
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4062%252F20464062%252Finterior_dashboard-1774702461751.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4062/20464062/interior_dashboard-1774702461751.jpeg saved to cache
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be282954-cfe2-586b-b784-816fddd90e9f
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f937f090>
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8034%252F20118034%252Finstrument_cluster-1773231070685.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8034/20118034/instrument_cluster-1773231070685.jpg saved to cache
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ade9cef4-7ce9-55e3-8837-21e0949238bb
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faef1a50>
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3192%252F12933192%252Finstrument_cluster-1774708520656.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3192/12933192/instrument_cluster-1774708520656.jpg saved to cache
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b51c9f46-b7d4-5eec-876f-8463ae7f2388
2026-03-29 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8034/20118034/interior_boot-1773231047932.jpg> (referer: None)
2026-03-29 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_rear_passenger-1774786534120.jpg> (referer: None)
2026-03-29 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1811/20491811/docs_service_history-1774718144688.jpg?ixlib=js-3.8.0&auto=format&s=5936679e2c58ca5f499f157f7664d6ff> (referer: None)
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00"\x90\x1a\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x1e\xa3\x00"\x86(\x00\x00\x00\x00'
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8fb8e90>
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4062%252F20464062%252Finterior_rear_seats-1774702438487.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4062/20464062/interior_rear_seats-1774702438487.jpeg saved to cache
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be282954-cfe2-586b-b784-816fddd90e9f
2026-03-29 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3192/12933192/docs_service_history-1774708852151.jpg?ixlib=js-3.8.0&auto=format&s=015f34c55e91a34c6b088621905a771f> (referer: None)
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f934f9d0>
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8034%252F20118034%252Finterior_boot-1773231047932.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8034/20118034/interior_boot-1773231047932.jpg saved to cache
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ade9cef4-7ce9-55e3-8837-21e0949238bb
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f925a490>
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2991%252F20502991%252Fexterior_rear_passenger-1774786534120.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_rear_passenger-1774786534120.jpg saved to cache
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f937e4d0>
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1811%252F20491811%252Fdocs_service_history-1774718144688.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5936679e2c58ca5f499f157f7664d6ff') HTTP/1.1" 204 0
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1811/20491811/docs_service_history-1774718144688.jpg?ixlib=js-3.8.0&auto=format&s=5936679e2c58ca5f499f157f7664d6ff saved to cache
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e07fcea-96b9-581d-bf56-185811ae97f5
2026-03-29 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_front_passenger-1774786565675.jpg> (referer: None)
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac94950>
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3192%252F12933192%252Fdocs_service_history-1774708852151.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D015f34c55e91a34c6b088621905a771f') HTTP/1.1" 204 0
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3192/12933192/docs_service_history-1774708852151.jpg?ixlib=js-3.8.0&auto=format&s=015f34c55e91a34c6b088621905a771f saved to cache
2026-03-29 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b51c9f46-b7d4-5eec-876f-8463ae7f2388
2026-03-29 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3192/12933192/interior_boot-1774708480860.jpg> (referer: None)
2026-03-29 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3192/12933192/interior_dashboard-1774708567624.jpg> (referer: None)
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90274d0>
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2991%252F20502991%252Fexterior_front_passenger-1774786565675.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_front_passenger-1774786565675.jpg saved to cache
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9
2026-03-29 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3192/12933192/interior_rear_seats-1774708433865.jpg> (referer: None)
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf6b590>
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3192%252F12933192%252Finterior_boot-1774708480860.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3192/12933192/interior_boot-1774708480860.jpg saved to cache
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b51c9f46-b7d4-5eec-876f-8463ae7f2388
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8fb9310>
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3192%252F12933192%252Finterior_dashboard-1774708567624.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3192/12933192/interior_dashboard-1774708567624.jpg saved to cache
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b51c9f46-b7d4-5eec-876f-8463ae7f2388
2026-03-29 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4062/20464062/interior_boot-1774703492161.jpeg> (referer: None)
2026-03-29 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1811/20491811/docs_service_history-1774718134354.jpg?ixlib=js-3.8.0&auto=format&s=30c6b517076b0be472c96a9858c2c54f> (referer: None)
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700dae5d0>
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3192%252F12933192%252Finterior_rear_seats-1774708433865.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3192/12933192/interior_rear_seats-1774708433865.jpg saved to cache
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b51c9f46-b7d4-5eec-876f-8463ae7f2388
2026-03-29 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1811/20491811/exterior_front_passenger-1774774312605.jpg> (referer: None)
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00Gs\xac\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x80\xb0\x00Gi\xba\x00\x00\x00\x00'
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700da1010>
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4062%252F20464062%252Finterior_boot-1774703492161.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4062/20464062/interior_boot-1774703492161.jpeg saved to cache
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be282954-cfe2-586b-b784-816fddd90e9f
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700de11d0>
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1811%252F20491811%252Fdocs_service_history-1774718134354.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D30c6b517076b0be472c96a9858c2c54f') HTTP/1.1" 204 0
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1811/20491811/docs_service_history-1774718134354.jpg?ixlib=js-3.8.0&auto=format&s=30c6b517076b0be472c96a9858c2c54f saved to cache
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e07fcea-96b9-581d-bf56-185811ae97f5
2026-03-29 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4898/20134898/interior_boot-1773057742122.jpg> (referer: None)
2026-03-29 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1811/20491811/exterior_rear_passenger-1774715202502.jpg> (referer: None)
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94c0f10>
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1811%252F20491811%252Fexterior_front_passenger-1774774312605.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1811/20491811/exterior_front_passenger-1774774312605.jpg saved to cache
2026-03-29 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e07fcea-96b9-581d-bf56-185811ae97f5
2026-03-29 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1811/20491811/exterior_rear_driver-1774772497854.jpg> (referer: None)
2026-03-29 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1811/20491811/exterior_front_driver-1774715161464.jpg> (referer: None)
2026-03-29 20:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1811/20491811/instrument_cluster-1774717026884.jpg> (referer: None)
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89a0550>
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4898%252F20134898%252Finterior_boot-1773057742122.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4898/20134898/interior_boot-1773057742122.jpg saved to cache
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05a87505-7635-581b-86b0-46de87939bb3
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa10350>
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F20491811%252Fexterior_rear_passenger-1774715202502.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/20491811/exterior_rear_passenger-1774715202502.jpg saved to cache
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e07fcea-96b9-581d-bf56-185811ae97f5
2026-03-29 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1811/20491811/interior_dashboard-1774716991132.jpg> (referer: None)
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9163290>
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1811%252F20491811%252Fexterior_rear_driver-1774772497854.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1811/20491811/exterior_rear_driver-1774772497854.jpg saved to cache
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e07fcea-96b9-581d-bf56-185811ae97f5
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93e0610>
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F20491811%252Fexterior_front_driver-1774715161464.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/20491811/exterior_front_driver-1774715161464.jpg saved to cache
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e07fcea-96b9-581d-bf56-185811ae97f5
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f911ef50>
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F20491811%252Finstrument_cluster-1774717026884.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/20491811/instrument_cluster-1774717026884.jpg saved to cache
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e07fcea-96b9-581d-bf56-185811ae97f5
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8fba450>
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1811%252F20491811%252Finterior_dashboard-1774716991132.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1811/20491811/interior_dashboard-1774716991132.jpg saved to cache
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e07fcea-96b9-581d-bf56-185811ae97f5
2026-03-29 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2991/20502991/interior_boot-1774787124772.jpg> (referer: None)
2026-03-29 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1811/20491811/interior_boot-1774717724544.jpg> (referer: None)
2026-03-29 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1811/20491811/interior_front_seats-1774716967996.jpg> (referer: None)
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa10e50>
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2991%252F20502991%252Finterior_boot-1774787124772.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2991/20502991/interior_boot-1774787124772.jpg saved to cache
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8bfe810>
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1811%252F20491811%252Finterior_boot-1774717724544.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1811/20491811/interior_boot-1774717724544.jpg saved to cache
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e07fcea-96b9-581d-bf56-185811ae97f5
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf6bc50>
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1811%252F20491811%252Finterior_front_seats-1774716967996.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1811/20491811/interior_front_seats-1774716967996.jpg saved to cache
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e07fcea-96b9-581d-bf56-185811ae97f5
2026-03-29 20:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e07fcea-96b9-581d-bf56-185811ae97f5, skipping ID generation
2026-03-29 20:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e07fcea-96b9-581d-bf56-185811ae97f5 with scrape type 1
2026-03-29 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e07fcea-96b9-581d-bf56-185811ae97f5 sending to next pipeline
2026-03-29 20:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1e07fcea-96b9-581d-bf56-185811ae97f5, identifier: 20491811
2026-03-29 20:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1e07fcea-96b9-581d-bf56-185811ae97f5 with identifier: 20491811
2026-03-29 20:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1e07fcea-96b9-581d-bf56-185811ae97f5 with identifier: 20491811
2026-03-29 20:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1e07fcea-96b9-581d-bf56-185811ae97f5 with identifier: 20491811 to the API
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/1811/20491811/interior_front_seats-1774716967996.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '1e07fcea-96b9-581d-bf56-185811ae97f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM71 FKB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20491811',
'listing': 'auction',
'location': 'None None',
'make': 'Vauxhall',
'model': 'Movano',
'odometer': 79000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1059673,
'Height': 2396,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1811/20491811/exterior_front_driver-1774715161464.jpg',
'Width': 3194},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1038846,
'Height': 2005,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1811/20491811/exterior_rear_driver-1774772497854.jpg',
'Width': 2673},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577803,
'Height': 1867,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1811/20491811/exterior_front_passenger-1774774312605.jpg',
'Width': 2489},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 827151,
'Height': 2457,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1811/20491811/exterior_rear_passenger-1774715202502.jpg',
'Width': 3276},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2771002,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1811/20491811/interior_front_seats-1774716967996.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1320801,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1811/20491811/interior_dashboard-1774716991132.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2710024,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1811/20491811/instrument_cluster-1774717026884.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2798353,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1811/20491811/interior_boot-1774717724544.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535596,
'Height': 1584,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1811/20491811/docs_service_history-1774718134354.jpg?ixlib=js-3.8.0&auto=format&s=30c6b517076b0be472c96a9858c2c54f',
'Width': 2960},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07fcea-96b9-581d-bf56-185811ae97f5/1e07fcea-96b9-581d-bf56-185811ae97f5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454587,
'Height': 1708,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1811/20491811/docs_service_history-1774718144688.jpg?ixlib=js-3.8.0&auto=format&s=5936679e2c58ca5f499f157f7664d6ff',
'Width': 2648}],
'price': 8560,
'price_includes_vat': False,
'registration_date': '2021-11-18',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Movano L2H2 F3500 CDTI',
'transmission': 'manual',
'trim': 'L2H2 F3500 CDTI',
'vin': 'W0VMR8607MB266760',
'year': 2021}
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491811%27 HTTP/1.1" 200 None
2026-03-29 20:01:17 [motorway.uk] INFO: Saving data for 20491811: {'created_time': 1774814477.620981, 'last_price_update_time': 1774814477.620993, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20491811') HTTP/1.1" 204 0
2026-03-29 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9345/10749345/docs_service_history-1774771556113.jpg?ixlib=js-3.8.0&auto=format&s=f4fdc927df9923d92c5a2b32acb93e6b> (referer: None)
2026-03-29 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9897/13689897/docs_service_history-1774459493704.jpg?ixlib=js-3.8.0&auto=format&s=740689c6e7af30b88df25b78b9f46307> (referer: None)
2026-03-29 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2991/20502991/docs_service_history-1774787527964.jpg?ixlib=js-3.8.0&auto=format&s=f93c9de8bbb73df7d3580fcae7db0bce> (referer: None)
2026-03-29 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2991/20502991/instrument_cluster-1774787169287.jpg> (referer: None)
2026-03-29 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2991/20502991/interior_dashboard-1774796530551.jpg> (referer: None)
2026-03-29 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_rear_passenger-1774702259784.jpeg> (referer: None)
2026-03-29 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_rear_driver-1774786533779.jpg> (referer: None)
2026-03-29 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_front_driver-1774786429659.jpg> (referer: None)
2026-03-29 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3192/12933192/interior_front_seats-1774708421659.jpg> (referer: None)
2026-03-29 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4898/20134898/instrument_cluster-1773057156906.jpg> (referer: None)
2026-03-29 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa10790>
2026-03-29 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9345%252F10749345%252Fdocs_service_history-1774771556113.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df4fdc927df9923d92c5a2b32acb93e6b') HTTP/1.1" 204 0
2026-03-29 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9345/10749345/docs_service_history-1774771556113.jpg?ixlib=js-3.8.0&auto=format&s=f4fdc927df9923d92c5a2b32acb93e6b saved to cache
2026-03-29 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b
2026-03-29 20:01:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb0b10>
2026-03-29 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9897%252F13689897%252Fdocs_service_history-1774459493704.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D740689c6e7af30b88df25b78b9f46307') HTTP/1.1" 204 0
2026-03-29 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9897/13689897/docs_service_history-1774459493704.jpg?ixlib=js-3.8.0&auto=format&s=740689c6e7af30b88df25b78b9f46307 saved to cache
2026-03-29 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8929ef3e-878e-587f-ade2-5b8c64d1c411
2026-03-29 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f923bed0>
2026-03-29 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2991%252F20502991%252Fdocs_service_history-1774787527964.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df93c9de8bbb73df7d3580fcae7db0bce') HTTP/1.1" 204 0
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2991/20502991/docs_service_history-1774787527964.jpg?ixlib=js-3.8.0&auto=format&s=f93c9de8bbb73df7d3580fcae7db0bce saved to cache
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9248310>
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2991%252F20502991%252Finstrument_cluster-1774787169287.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2991/20502991/instrument_cluster-1774787169287.jpg saved to cache
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f923aa90>
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2991%252F20502991%252Finterior_dashboard-1774796530551.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2991/20502991/interior_dashboard-1774796530551.jpg saved to cache
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f926bd50>
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4062%252F20464062%252Fexterior_rear_passenger-1774702259784.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_rear_passenger-1774702259784.jpeg saved to cache
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be282954-cfe2-586b-b784-816fddd90e9f
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89a34d0>
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2991%252F20502991%252Fexterior_rear_driver-1774786533779.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_rear_driver-1774786533779.jpg saved to cache
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f920a050>
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2991%252F20502991%252Fexterior_front_driver-1774786429659.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_front_driver-1774786429659.jpg saved to cache
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f959a850>
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3192%252F12933192%252Finterior_front_seats-1774708421659.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3192/12933192/interior_front_seats-1774708421659.jpg saved to cache
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b51c9f46-b7d4-5eec-876f-8463ae7f2388
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9248dd0>
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4898%252F20134898%252Finstrument_cluster-1773057156906.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4898/20134898/instrument_cluster-1773057156906.jpg saved to cache
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05a87505-7635-581b-86b0-46de87939bb3
2026-03-29 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8034/20118034/interior_rear_seats-1773231172439.jpg> (referer: None)
2026-03-29 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2991/20502991/interior_front_seats-1774787057646.jpg> (referer: None)
2026-03-29 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2991/20502991/interior_rear_seats-1774787069389.jpg> (referer: None)
2026-03-29 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_rear_driver-1774702285415.jpeg> (referer: None)
2026-03-29 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_front_passenger-1774702261708.jpeg> (referer: None)
2026-03-29 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_rear_passenger-1774707400601.jpg> (referer: None)
2026-03-29 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4898/20134898/interior_dashboard-1773058233559.jpg> (referer: None)
2026-03-29 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9897/13689897/interior_boot-1774692393166.jpg> (referer: None)
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f92487d0>
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8034%252F20118034%252Finterior_rear_seats-1773231172439.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8034/20118034/interior_rear_seats-1773231172439.jpg saved to cache
2026-03-29 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ade9cef4-7ce9-55e3-8837-21e0949238bb
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d0650>
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2991%252F20502991%252Finterior_front_seats-1774787057646.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2991/20502991/interior_front_seats-1774787057646.jpg saved to cache
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0a00d0>
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2991%252F20502991%252Finterior_rear_seats-1774787069389.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2991/20502991/interior_rear_seats-1774787069389.jpg saved to cache
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9
2026-03-29 20:01:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6767baf3-fedb-58e3-b2ad-e2ef20d582e9, skipping ID generation
2026-03-29 20:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9 with scrape type 1
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6767baf3-fedb-58e3-b2ad-e2ef20d582e9 sending to next pipeline
2026-03-29 20:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6767baf3-fedb-58e3-b2ad-e2ef20d582e9, identifier: 20502991
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabd7390>
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4062%252F20464062%252Fexterior_rear_driver-1774702285415.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_rear_driver-1774702285415.jpeg saved to cache
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be282954-cfe2-586b-b784-816fddd90e9f
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae6cad0>
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4062%252F20464062%252Fexterior_front_passenger-1774702261708.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_front_passenger-1774702261708.jpeg saved to cache
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be282954-cfe2-586b-b784-816fddd90e9f
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89a38d0>
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3192%252F12933192%252Fexterior_rear_passenger-1774707400601.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_rear_passenger-1774707400601.jpg saved to cache
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b51c9f46-b7d4-5eec-876f-8463ae7f2388
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9268690>
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4898%252F20134898%252Finterior_dashboard-1773058233559.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4898/20134898/interior_dashboard-1773058233559.jpg saved to cache
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05a87505-7635-581b-86b0-46de87939bb3
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93e0410>
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9897%252F13689897%252Finterior_boot-1774692393166.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9897/13689897/interior_boot-1774692393166.jpg saved to cache
2026-03-29 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8929ef3e-878e-587f-ade2-5b8c64d1c411
2026-03-29 20:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6767baf3-fedb-58e3-b2ad-e2ef20d582e9 with identifier: 20502991
2026-03-29 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6767baf3-fedb-58e3-b2ad-e2ef20d582e9 with identifier: 20502991
2026-03-29 20:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6767baf3-fedb-58e3-b2ad-e2ef20d582e9 with identifier: 20502991 to the API
2026-03-29 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2991/20502991/interior_rear_seats-1774787069389.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '6767baf3-fedb-58e3-b2ad-e2ef20d582e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EN18 VCJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20502991',
'listing': 'auction',
'location': 'Essex Tilbury',
'make': 'Ford',
'model': 'Kuga',
'odometer': 76453,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1984973,
'Height': 2722,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_front_driver-1774786429659.jpg',
'Width': 3629},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1537421,
'Height': 2588,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_rear_driver-1774786533779.jpg',
'Width': 3451},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1432563,
'Height': 2585,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_front_passenger-1774786565675.jpg',
'Width': 3447},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1166735,
'Height': 2392,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2991/20502991/exterior_rear_passenger-1774786534120.jpg',
'Width': 3189},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3680543,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2991/20502991/interior_front_seats-1774787057646.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3201213,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2991/20502991/interior_rear_seats-1774787069389.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2130140,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2991/20502991/interior_dashboard-1774796530551.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1330565,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2991/20502991/instrument_cluster-1774787169287.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3065920,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2991/20502991/interior_boot-1774787124772.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6767baf3-fedb-58e3-b2ad-e2ef20d582e9/6767baf3-fedb-58e3-b2ad-e2ef20d582e9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 803213,
'Height': 2817,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2991/20502991/docs_service_history-1774787527964.jpg?ixlib=js-3.8.0&auto=format&s=f93c9de8bbb73df7d3580fcae7db0bce',
'Width': 1974}],
'price': 9867,
'price_includes_vat': False,
'registration_date': '2018-07-30',
'seats_number': None,
'seller_name': None,
'title': 'Ford Kuga Vignale TDCI 4X4 Auto',
'transmission': 'automatic',
'trim': 'Vignale TDCI 4X4 Auto',
'vin': 'WF0AXXWPMAJU42528',
'year': 2018}
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720502991%27 HTTP/1.1" 200 None
2026-03-29 20:01:20 [motorway.uk] INFO: Saving data for 20502991: {'created_time': 1774814480.27677, 'last_price_update_time': 1774814480.276781, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20502991') HTTP/1.1" 204 0
2026-03-29 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8034/20118034/interior_front_seats-1773230924086.jpg> (referer: None)
2026-03-29 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9345/10749345/interior_boot-1774771215095.jpg> (referer: None)
2026-03-29 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_front_driver-1774702744266.jpeg> (referer: None)
2026-03-29 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_rear_passenger-1773230157165.jpg> (referer: None)
2026-03-29 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9345/10749345/instrument_cluster-1774771168297.jpg> (referer: None)
2026-03-29 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9897/13689897/instrument_cluster-1774367240322.jpg> (referer: None)
2026-03-29 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4898/20134898/interior_rear_seats-1773057863183.jpg> (referer: None)
2026-03-29 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_front_passenger-1774707423592.jpg> (referer: None)
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab39d50>
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8034%252F20118034%252Finterior_front_seats-1773230924086.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8034/20118034/interior_front_seats-1773230924086.jpg saved to cache
2026-03-29 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ade9cef4-7ce9-55e3-8837-21e0949238bb
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cf3bd0>
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9345%252F10749345%252Finterior_boot-1774771215095.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9345/10749345/interior_boot-1774771215095.jpg saved to cache
2026-03-29 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9137f50>
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4062%252F20464062%252Fexterior_front_driver-1774702744266.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_front_driver-1774702744266.jpeg saved to cache
2026-03-29 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be282954-cfe2-586b-b784-816fddd90e9f
2026-03-29 20:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be282954-cfe2-586b-b784-816fddd90e9f, skipping ID generation
2026-03-29 20:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be282954-cfe2-586b-b784-816fddd90e9f with scrape type 1
2026-03-29 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be282954-cfe2-586b-b784-816fddd90e9f sending to next pipeline
2026-03-29 20:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: be282954-cfe2-586b-b784-816fddd90e9f, identifier: 20464062
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab3b790>
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8034%252F20118034%252Fexterior_rear_passenger-1773230157165.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_rear_passenger-1773230157165.jpg saved to cache
2026-03-29 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ade9cef4-7ce9-55e3-8837-21e0949238bb
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e40150>
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9345%252F10749345%252Finstrument_cluster-1774771168297.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9345/10749345/instrument_cluster-1774771168297.jpg saved to cache
2026-03-29 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b
2026-03-29 20:01:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cf23d0>
2026-03-29 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9897%252F13689897%252Finstrument_cluster-1774367240322.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9897/13689897/instrument_cluster-1774367240322.jpg saved to cache
2026-03-29 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8929ef3e-878e-587f-ade2-5b8c64d1c411
2026-03-29 20:01:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa13210>
2026-03-29 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4898%252F20134898%252Finterior_rear_seats-1773057863183.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4898/20134898/interior_rear_seats-1773057863183.jpg saved to cache
2026-03-29 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05a87505-7635-581b-86b0-46de87939bb3
2026-03-29 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9227310>
2026-03-29 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3192%252F12933192%252Fexterior_front_passenger-1774707423592.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_front_passenger-1774707423592.jpg saved to cache
2026-03-29 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b51c9f46-b7d4-5eec-876f-8463ae7f2388
2026-03-29 20:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: be282954-cfe2-586b-b784-816fddd90e9f with identifier: 20464062
2026-03-29 20:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: be282954-cfe2-586b-b784-816fddd90e9f with identifier: 20464062
2026-03-29 20:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: be282954-cfe2-586b-b784-816fddd90e9f with identifier: 20464062 to the API
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_front_driver-1774702744266.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'be282954-cfe2-586b-b784-816fddd90e9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA22 KWK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20464062',
'listing': 'auction',
'location': 'Lincolnshire Market Rasen',
'make': 'Ford',
'model': 'Ranger',
'odometer': 36386,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2807861,
'Height': 2988,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_front_driver-1774702744266.jpeg',
'Width': 3984},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1897947,
'Height': 2474,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_rear_driver-1774702285415.jpeg',
'Width': 3299},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2108548,
'Height': 2729,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_front_passenger-1774702261708.jpeg',
'Width': 3639},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2193188,
'Height': 2878,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4062/20464062/exterior_rear_passenger-1774702259784.jpeg',
'Width': 3837},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2604235,
'Height': 2904,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4062/20464062/20464062-interior_front_seats-modified-1774706958936.jpeg',
'Width': 3872},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2404029,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4062/20464062/interior_rear_seats-1774702438487.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2565854,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4062/20464062/interior_dashboard-1774702461751.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4781148,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4062/20464062/interior_boot-1774703492161.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118767,
'Height': 1792,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4062/20464062/docs_service_history-1774558552934.jpeg?ixlib=js-3.8.0&auto=format&s=2729f50334faa767eda918cc1eaeb980',
'Width': 828},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be282954-cfe2-586b-b784-816fddd90e9f/be282954-cfe2-586b-b784-816fddd90e9f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129296,
'Height': 1792,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4062/20464062/docs_service_history-1774558552916.jpeg?ixlib=js-3.8.0&auto=format&s=52d6a9bc740e5af3518a1ed182aa0e77',
'Width': 828}],
'price': 21464,
'price_includes_vat': False,
'registration_date': '2022-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Ford Ranger Wildtrak Ecoblue 4X4 A',
'transmission': 'automatic',
'trim': 'Wildtrak Ecoblue 4X4 A',
'vin': '6FPPXXMJ2PMD50486',
'year': 2022}
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720464062%27 HTTP/1.1" 200 None
2026-03-29 20:01:21 [motorway.uk] INFO: Saving data for 20464062: {'created_time': 1774814481.838349, 'last_price_update_time': 1774814481.83836, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20464062') HTTP/1.1" 204 0
2026-03-29 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_rear_driver-1773230087097.jpg> (referer: None)
2026-03-29 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_front_passenger-1773230203494.jpg> (referer: None)
2026-03-29 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_rear_passenger-1773059383204.jpg> (referer: None)
2026-03-29 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_rear_driver-1774707383436.jpg> (referer: None)
2026-03-29 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9897/13689897/interior_dashboard-1774692381106.jpg> (referer: None)
2026-03-29 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_front_driver-1774707351049.jpg> (referer: None)
2026-03-29 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9345/10749345/interior_dashboard-1774771232244.jpg> (referer: None)
2026-03-29 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4898/20134898/interior_front_seats-1773057783093.jpg> (referer: None)
2026-03-29 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_front_driver-1773059574331.jpg> (referer: None)
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c9f310>
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8034%252F20118034%252Fexterior_rear_driver-1773230087097.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_rear_driver-1773230087097.jpg saved to cache
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ade9cef4-7ce9-55e3-8837-21e0949238bb
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faef1690>
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8034%252F20118034%252Fexterior_front_passenger-1773230203494.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_front_passenger-1773230203494.jpg saved to cache
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ade9cef4-7ce9-55e3-8837-21e0949238bb
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9239c90>
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4898%252F20134898%252Fexterior_rear_passenger-1773059383204.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_rear_passenger-1773059383204.jpg saved to cache
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05a87505-7635-581b-86b0-46de87939bb3
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faad7610>
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3192%252F12933192%252Fexterior_rear_driver-1774707383436.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_rear_driver-1774707383436.jpg saved to cache
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b51c9f46-b7d4-5eec-876f-8463ae7f2388
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadeb410>
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9897%252F13689897%252Finterior_dashboard-1774692381106.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9897/13689897/interior_dashboard-1774692381106.jpg saved to cache
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8929ef3e-878e-587f-ade2-5b8c64d1c411
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9660310>
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3192%252F12933192%252Fexterior_front_driver-1774707351049.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_front_driver-1774707351049.jpg saved to cache
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b51c9f46-b7d4-5eec-876f-8463ae7f2388
2026-03-29 20:01:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b51c9f46-b7d4-5eec-876f-8463ae7f2388, skipping ID generation
2026-03-29 20:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51c9f46-b7d4-5eec-876f-8463ae7f2388 with scrape type 1
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b51c9f46-b7d4-5eec-876f-8463ae7f2388 sending to next pipeline
2026-03-29 20:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b51c9f46-b7d4-5eec-876f-8463ae7f2388, identifier: 12933192
2026-03-29 20:01:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cda310>
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9345%252F10749345%252Finterior_dashboard-1774771232244.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9345/10749345/interior_dashboard-1774771232244.jpg saved to cache
2026-03-29 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b
2026-03-29 20:01:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9320110>
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4898%252F20134898%252Finterior_front_seats-1773057783093.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4898/20134898/interior_front_seats-1773057783093.jpg saved to cache
2026-03-29 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05a87505-7635-581b-86b0-46de87939bb3
2026-03-29 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cda910>
2026-03-29 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4898%252F20134898%252Fexterior_front_driver-1773059574331.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_front_driver-1773059574331.jpg saved to cache
2026-03-29 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05a87505-7635-581b-86b0-46de87939bb3
2026-03-29 20:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b51c9f46-b7d4-5eec-876f-8463ae7f2388 with identifier: 12933192
2026-03-29 20:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b51c9f46-b7d4-5eec-876f-8463ae7f2388 with identifier: 12933192
2026-03-29 20:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b51c9f46-b7d4-5eec-876f-8463ae7f2388 with identifier: 12933192 to the API
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_front_driver-1774707351049.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'b51c9f46-b7d4-5eec-876f-8463ae7f2388',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HL19 YSH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/12933192',
'listing': 'auction',
'location': 'Surrey Leatherhead',
'make': 'BMW',
'model': 'X3',
'odometer': 59765,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2706441,
'Height': 2699,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_front_driver-1774707351049.jpg',
'Width': 3599},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2178116,
'Height': 2540,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_rear_driver-1774707383436.jpg',
'Width': 3386},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3045106,
'Height': 2834,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_front_passenger-1774707423592.jpg',
'Width': 3779},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1930493,
'Height': 2446,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3192/12933192/exterior_rear_passenger-1774707400601.jpg',
'Width': 3261},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4104404,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3192/12933192/interior_front_seats-1774708421659.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3704150,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3192/12933192/interior_rear_seats-1774708433865.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3228839,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3192/12933192/interior_dashboard-1774708567624.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2788070,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3192/12933192/instrument_cluster-1774708520656.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4794060,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3192/12933192/interior_boot-1774708480860.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51c9f46-b7d4-5eec-876f-8463ae7f2388/b51c9f46-b7d4-5eec-876f-8463ae7f2388_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1278550,
'Height': 875,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3192/12933192/docs_service_history-1774708852151.jpg?ixlib=js-3.8.0&auto=format&s=015f34c55e91a34c6b088621905a771f',
'Width': 1842}],
'price': 23704,
'price_includes_vat': False,
'registration_date': '2019-06-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW X3 xDrive 30d M Sport Auto',
'transmission': 'automatic',
'trim': 'xDrive 30d M Sport Auto',
'vin': 'WBATX76040ND01107',
'year': 2019}
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712933192%27 HTTP/1.1" 200 None
2026-03-29 20:01:23 [motorway.uk] INFO: Saving data for 12933192: {'created_time': 1774814483.569846, 'last_price_update_time': 1774814483.569856, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='12933192') HTTP/1.1" 204 0
2026-03-29 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_front_driver-1773230007616.jpg> (referer: None)
2026-03-29 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_front_passenger-1774770017878.jpg> (referer: None)
2026-03-29 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_front_passenger-1773059628082.jpg> (referer: None)
2026-03-29 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_rear_passenger-1774366400500.jpg> (referer: None)
2026-03-29 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9897/13689897/interior_rear_seats-1774456611602.jpg> (referer: None)
2026-03-29 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9345/10749345/interior_rear_seats-1774771210806.jpg> (referer: None)
2026-03-29 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9897/13689897/interior_front_seats-1774451934649.jpg> (referer: None)
2026-03-29 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fe4dd0>
2026-03-29 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8034%252F20118034%252Fexterior_front_driver-1773230007616.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_front_driver-1773230007616.jpg saved to cache
2026-03-29 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ade9cef4-7ce9-55e3-8837-21e0949238bb
2026-03-29 20:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ade9cef4-7ce9-55e3-8837-21e0949238bb, skipping ID generation
2026-03-29 20:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade9cef4-7ce9-55e3-8837-21e0949238bb with scrape type 1
2026-03-29 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ade9cef4-7ce9-55e3-8837-21e0949238bb sending to next pipeline
2026-03-29 20:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ade9cef4-7ce9-55e3-8837-21e0949238bb, identifier: 20118034
2026-03-29 20:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ade9cef4-7ce9-55e3-8837-21e0949238bb with identifier: 20118034
2026-03-29 20:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ade9cef4-7ce9-55e3-8837-21e0949238bb with identifier: 20118034
2026-03-29 20:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ade9cef4-7ce9-55e3-8837-21e0949238bb with identifier: 20118034 to the API
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_front_driver-1773230007616.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ade9cef4-7ce9-55e3-8837-21e0949238bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GX69 SXT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20118034',
'listing': 'auction',
'location': 'East Sussex Hailsham',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 69007,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2158128,
'Height': 2818,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_front_driver-1773230007616.jpg',
'Width': 3757},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1691230,
'Height': 2581,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_rear_driver-1773230087097.jpg',
'Width': 3441},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1799996,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_front_passenger-1773230203494.jpg',
'Width': 3455},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1884023,
'Height': 2549,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8034/20118034/exterior_rear_passenger-1773230157165.jpg',
'Width': 3398},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2993310,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8034/20118034/interior_front_seats-1773230924086.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3479959,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8034/20118034/interior_rear_seats-1773231172439.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1701232,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8034/20118034/interior_dashboard-1773231029459.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2484187,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8034/20118034/instrument_cluster-1773231070685.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4686403,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8034/20118034/interior_boot-1773231047932.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ade9cef4-7ce9-55e3-8837-21e0949238bb/ade9cef4-7ce9-55e3-8837-21e0949238bb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154457,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8034/20118034/docs_service_history-1773233052351.jpg?ixlib=js-3.8.0&auto=format&s=d38dc406ab945f9c4785f87f137bebc9',
'Width': 595}],
'price': 21741,
'price_includes_vat': False,
'registration_date': '2019-09-25',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery HSE SDV6 Auto',
'transmission': 'automatic',
'trim': 'HSE SDV6 Auto',
'vin': 'SALRA2AK4K2407268',
'year': 2019}
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720118034%27 HTTP/1.1" 200 None
2026-03-29 20:01:24 [motorway.uk] INFO: Saving data for 20118034: {'created_time': 1774814484.371378, 'last_price_update_time': 1774814484.371388, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20118034') HTTP/1.1" 204 0
2026-03-29 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9345/10749345/interior_front_seats-1774771213134.jpg> (referer: None)
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010dd910>
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9345%252F10749345%252Fexterior_front_passenger-1774770017878.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_front_passenger-1774770017878.jpg saved to cache
2026-03-29 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93a79d0>
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4898%252F20134898%252Fexterior_front_passenger-1773059628082.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_front_passenger-1773059628082.jpg saved to cache
2026-03-29 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05a87505-7635-581b-86b0-46de87939bb3
2026-03-29 20:01:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05a87505-7635-581b-86b0-46de87939bb3, skipping ID generation
2026-03-29 20:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05a87505-7635-581b-86b0-46de87939bb3 with scrape type 1
2026-03-29 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05a87505-7635-581b-86b0-46de87939bb3 sending to next pipeline
2026-03-29 20:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 05a87505-7635-581b-86b0-46de87939bb3, identifier: 20134898
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e90950>
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9897%252F13689897%252Fexterior_rear_passenger-1774366400500.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_rear_passenger-1774366400500.jpg saved to cache
2026-03-29 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8929ef3e-878e-587f-ade2-5b8c64d1c411
2026-03-29 20:01:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae3c810>
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9897%252F13689897%252Finterior_rear_seats-1774456611602.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9897/13689897/interior_rear_seats-1774456611602.jpg saved to cache
2026-03-29 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8929ef3e-878e-587f-ade2-5b8c64d1c411
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e415d0>
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9345%252F10749345%252Finterior_rear_seats-1774771210806.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9345/10749345/interior_rear_seats-1774771210806.jpg saved to cache
2026-03-29 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae3cfd0>
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9897%252F13689897%252Finterior_front_seats-1774451934649.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9897/13689897/interior_front_seats-1774451934649.jpg saved to cache
2026-03-29 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8929ef3e-878e-587f-ade2-5b8c64d1c411
2026-03-29 20:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 05a87505-7635-581b-86b0-46de87939bb3 with identifier: 20134898
2026-03-29 20:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 05a87505-7635-581b-86b0-46de87939bb3 with identifier: 20134898
2026-03-29 20:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 05a87505-7635-581b-86b0-46de87939bb3 with identifier: 20134898 to the API
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_front_passenger-1773059628082.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '05a87505-7635-581b-86b0-46de87939bb3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'OV68 YKX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20134898',
'listing': 'auction',
'location': 'Oxfordshire Wallingford',
'make': 'Vauxhall',
'model': 'Adam',
'odometer': 24000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2406865,
'Height': 2953,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_front_driver-1773059574331.jpg',
'Width': 3937},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2224010,
'Height': 2780,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_rear_driver-1773059422122.jpg',
'Width': 3706},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1737389,
'Height': 2709,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_front_passenger-1773059628082.jpg',
'Width': 3612},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2000467,
'Height': 2727,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4898/20134898/exterior_rear_passenger-1773059383204.jpg',
'Width': 3636},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4486667,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4898/20134898/interior_front_seats-1773057783093.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5258302,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4898/20134898/interior_rear_seats-1773057863183.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2746526,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4898/20134898/interior_dashboard-1773058233559.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3436257,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4898/20134898/instrument_cluster-1773057156906.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3860208,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4898/20134898/interior_boot-1773057742122.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05a87505-7635-581b-86b0-46de87939bb3/05a87505-7635-581b-86b0-46de87939bb3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 740151,
'Height': 1556,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/oriented/4898/20134898/docs_service_history-1773058754430.jpg?ixlib=js-3.8.0&auto=format&s=2397bc3c45e5f525dff78cc1a5ba01de',
'Width': 4539}],
'price': 5873,
'price_includes_vat': False,
'registration_date': '2019-01-09',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Adam JAM',
'transmission': 'manual',
'trim': 'JAM',
'vin': 'W0V0MAP08K6004372',
'year': 2019}
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720134898%27 HTTP/1.1" 200 None
2026-03-29 20:01:25 [motorway.uk] INFO: Saving data for 20134898: {'created_time': 1774814485.705565, 'last_price_update_time': 1774814485.70558, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20134898') HTTP/1.1" 204 0
2026-03-29 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9620/20489620/instrument_cluster-1774715293061.jpg> (referer: None)
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ce5650>
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9345%252F10749345%252Finterior_front_seats-1774771213134.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9345/10749345/interior_front_seats-1774771213134.jpg saved to cache
2026-03-29 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f85990>
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9620%252F20489620%252Finstrument_cluster-1774715293061.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9620/20489620/instrument_cluster-1774715293061.jpg saved to cache
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 573ed996-5ee5-5067-a474-41cb30fa1283
2026-03-29 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_front_passenger-1774366406798.jpg> (referer: None)
2026-03-29 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_front_driver-1774366422296.jpg> (referer: None)
2026-03-29 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_front_driver-1774770000294.jpg> (referer: None)
2026-03-29 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9620/20489620/interior_boot-1774709156755.jpg> (referer: None)
2026-03-29 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8238/20478238/interior_front_seats-1774779997232.jpg> (referer: None)
2026-03-29 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1058/17461058/docs_service_history-1773508348797.jpg?ixlib=js-3.8.0&auto=format&s=3dcacf226775a20d624e505e64349c47> (referer: None)
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0753d0>
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9897%252F13689897%252Fexterior_front_passenger-1774366406798.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_front_passenger-1774366406798.jpg saved to cache
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8929ef3e-878e-587f-ade2-5b8c64d1c411
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e38350>
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9897%252F13689897%252Fexterior_front_driver-1774366422296.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_front_driver-1774366422296.jpg saved to cache
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8929ef3e-878e-587f-ade2-5b8c64d1c411
2026-03-29 20:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8929ef3e-878e-587f-ade2-5b8c64d1c411, skipping ID generation
2026-03-29 20:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8929ef3e-878e-587f-ade2-5b8c64d1c411 with scrape type 1
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8929ef3e-878e-587f-ade2-5b8c64d1c411 sending to next pipeline
2026-03-29 20:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8929ef3e-878e-587f-ade2-5b8c64d1c411, identifier: 13689897
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f937e450>
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9345%252F10749345%252Fexterior_front_driver-1774770000294.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_front_driver-1774770000294.jpg saved to cache
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b
2026-03-29 20:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef1e13cf-e6f4-5031-aa0b-b29eae6d752b, skipping ID generation
2026-03-29 20:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b with scrape type 1
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef1e13cf-e6f4-5031-aa0b-b29eae6d752b sending to next pipeline
2026-03-29 20:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ef1e13cf-e6f4-5031-aa0b-b29eae6d752b, identifier: 10749345
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa077250>
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9620%252F20489620%252Finterior_boot-1774709156755.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9620/20489620/interior_boot-1774709156755.jpg saved to cache
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 573ed996-5ee5-5067-a474-41cb30fa1283
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cda410>
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8238%252F20478238%252Finterior_front_seats-1774779997232.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8238/20478238/interior_front_seats-1774779997232.jpg saved to cache
2026-03-29 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7861f396-f52c-582c-81ee-a4b5d0be8df2
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9031d10>
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1058%252F17461058%252Fdocs_service_history-1773508348797.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3dcacf226775a20d624e505e64349c47') HTTP/1.1" 204 0
2026-03-29 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1058/17461058/docs_service_history-1773508348797.jpg?ixlib=js-3.8.0&auto=format&s=3dcacf226775a20d624e505e64349c47 saved to cache
2026-03-29 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99c53734-619e-5b43-94d7-8aab539246a4
2026-03-29 20:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8929ef3e-878e-587f-ade2-5b8c64d1c411 with identifier: 13689897
2026-03-29 20:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8929ef3e-878e-587f-ade2-5b8c64d1c411 with identifier: 13689897
2026-03-29 20:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8929ef3e-878e-587f-ade2-5b8c64d1c411 with identifier: 13689897 to the API
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_front_driver-1774366422296.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8929ef3e-878e-587f-ade2-5b8c64d1c411',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HJ70 YSD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13689897',
'listing': 'auction',
'location': 'Wiltshire Salisbury',
'make': 'Ford',
'model': 'Ranger',
'odometer': 50155,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2153909,
'Height': 2760,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_front_driver-1774366422296.jpg',
'Width': 3680},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2155994,
'Height': 3011,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_rear_driver-1774366383613.jpg',
'Width': 4014},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1795880,
'Height': 2651,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_front_passenger-1774366406798.jpg',
'Width': 3534},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2366659,
'Height': 2784,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9897/13689897/exterior_rear_passenger-1774366400500.jpg',
'Width': 3712},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3650128,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9897/13689897/interior_front_seats-1774451934649.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2938106,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9897/13689897/interior_rear_seats-1774456611602.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2467483,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9897/13689897/interior_dashboard-1774692381106.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2768343,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9897/13689897/instrument_cluster-1774367240322.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3940958,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9897/13689897/interior_boot-1774692393166.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8929ef3e-878e-587f-ade2-5b8c64d1c411/8929ef3e-878e-587f-ade2-5b8c64d1c411_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285386,
'Height': 1792,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9897/13689897/docs_service_history-1774459493704.jpg?ixlib=js-3.8.0&auto=format&s=740689c6e7af30b88df25b78b9f46307',
'Width': 828}],
'price': 16341,
'price_includes_vat': False,
'registration_date': '2020-11-05',
'seats_number': None,
'seller_name': None,
'title': 'Ford Ranger Wildtrak Ecoblue 4X4 A',
'transmission': 'automatic',
'trim': 'Wildtrak Ecoblue 4X4 A',
'vin': '6FPPXXMJ2PLL33105',
'year': 2020}
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713689897%27 HTTP/1.1" 200 None
2026-03-29 20:01:27 [motorway.uk] INFO: Saving data for 13689897: {'created_time': 1774814487.515804, 'last_price_update_time': 1774814487.515815, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13689897') HTTP/1.1" 204 0
2026-03-29 20:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ef1e13cf-e6f4-5031-aa0b-b29eae6d752b with identifier: 10749345
2026-03-29 20:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ef1e13cf-e6f4-5031-aa0b-b29eae6d752b with identifier: 10749345
2026-03-29 20:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ef1e13cf-e6f4-5031-aa0b-b29eae6d752b with identifier: 10749345 to the API
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_front_driver-1774770000294.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ef1e13cf-e6f4-5031-aa0b-b29eae6d752b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KK19 JBY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10749345',
'listing': 'auction',
'location': 'None Wrexham',
'make': 'Volvo',
'model': 'XC60',
'odometer': 35205,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1543199,
'Height': 2475,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_front_driver-1774770000294.jpg',
'Width': 3300},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1515358,
'Height': 2400,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_rear_driver-1774770019686.jpg',
'Width': 3200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1706616,
'Height': 2702,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_front_passenger-1774770017878.jpg',
'Width': 3603},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1683284,
'Height': 2642,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9345/10749345/exterior_rear_passenger-1774770011090.jpg',
'Width': 3522},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3947712,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9345/10749345/interior_front_seats-1774771213134.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3125516,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9345/10749345/interior_rear_seats-1774771210806.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3257620,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9345/10749345/interior_dashboard-1774771232244.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2589091,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9345/10749345/instrument_cluster-1774771168297.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3305707,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9345/10749345/interior_boot-1774771215095.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef1e13cf-e6f4-5031-aa0b-b29eae6d752b/ef1e13cf-e6f4-5031-aa0b-b29eae6d752b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260515,
'Height': 1211,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9345/10749345/docs_service_history-1774771556113.jpg?ixlib=js-3.8.0&auto=format&s=f4fdc927df9923d92c5a2b32acb93e6b',
'Width': 3294}],
'price': 20644,
'price_includes_vat': False,
'registration_date': '2019-06-03',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC60 R-DESIGN D4 Auto',
'transmission': 'automatic',
'trim': 'R-DESIGN D4 Auto',
'vin': 'YV1UZA8VDL1411206',
'year': 2019}
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710749345%27 HTTP/1.1" 200 None
2026-03-29 20:01:27 [motorway.uk] INFO: Saving data for 10749345: {'created_time': 1774814487.885308, 'last_price_update_time': 1774814487.885318, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10749345') HTTP/1.1" 204 0
2026-03-29 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8238/20478238/interior_rear_seats-1774780841637.jpg> (referer: None)
2026-03-29 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_front_passenger-1774779491580.jpg> (referer: None)
2026-03-29 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_rear_passenger-1774779477258.jpg> (referer: None)
2026-03-29 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6072/19816072/exterior_rear_passenger-1774706736063.jpg> (referer: None)
2026-03-29 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1058/17461058/interior_dashboard-1774776045184.jpg> (referer: None)
2026-03-29 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6072/19816072/exterior_front_passenger-1774780351524.jpg> (referer: None)
2026-03-29 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9620/20489620/interior_dashboard-1774715211809.jpg> (referer: None)
2026-03-29 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1058/17461058/interior_rear_seats-1773507800470.jpg> (referer: None)
2026-03-29 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1058/17461058/interior_boot-1773507722801.jpg> (referer: None)
2026-03-29 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9620/20489620/interior_rear_seats-1774709050162.jpg> (referer: None)
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cfad90>
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8238%252F20478238%252Finterior_rear_seats-1774780841637.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8238/20478238/interior_rear_seats-1774780841637.jpg saved to cache
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7861f396-f52c-582c-81ee-a4b5d0be8df2
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa53750>
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8238%252F20478238%252Fexterior_front_passenger-1774779491580.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_front_passenger-1774779491580.jpg saved to cache
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7861f396-f52c-582c-81ee-a4b5d0be8df2
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa138950>
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8238%252F20478238%252Fexterior_rear_passenger-1774779477258.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_rear_passenger-1774779477258.jpg saved to cache
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7861f396-f52c-582c-81ee-a4b5d0be8df2
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa2dbd0>
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6072%252F19816072%252Fexterior_rear_passenger-1774706736063.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6072/19816072/exterior_rear_passenger-1774706736063.jpg saved to cache
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9062080-17fb-5f42-b4d5-3bc95e460639
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa13a990>
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1058%252F17461058%252Finterior_dashboard-1774776045184.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1058/17461058/interior_dashboard-1774776045184.jpg saved to cache
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99c53734-619e-5b43-94d7-8aab539246a4
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca37d0>
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6072%252F19816072%252Fexterior_front_passenger-1774780351524.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6072/19816072/exterior_front_passenger-1774780351524.jpg saved to cache
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9062080-17fb-5f42-b4d5-3bc95e460639
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa13bc10>
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9620%252F20489620%252Finterior_dashboard-1774715211809.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9620/20489620/interior_dashboard-1774715211809.jpg saved to cache
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 573ed996-5ee5-5067-a474-41cb30fa1283
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa2f4d0>
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1058%252F17461058%252Finterior_rear_seats-1773507800470.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1058/17461058/interior_rear_seats-1773507800470.jpg saved to cache
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99c53734-619e-5b43-94d7-8aab539246a4
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa13a490>
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1058%252F17461058%252Finterior_boot-1773507722801.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1058/17461058/interior_boot-1773507722801.jpg saved to cache
2026-03-29 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99c53734-619e-5b43-94d7-8aab539246a4
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90a38d0>
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9620%252F20489620%252Finterior_rear_seats-1774709050162.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9620/20489620/interior_rear_seats-1774709050162.jpg saved to cache
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 573ed996-5ee5-5067-a474-41cb30fa1283
2026-03-29 20:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6072/19816072/exterior_front_driver-1774706708183.jpg> (referer: None)
2026-03-29 20:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_front_driver-1774779455780.jpg> (referer: None)
2026-03-29 20:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_rear_driver-1774779469606.jpg> (referer: None)
2026-03-29 20:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1058/17461058/interior_front_seats-1773507835325.jpg> (referer: None)
2026-03-29 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6072/19816072/exterior_rear_driver-1774780335564.jpg> (referer: None)
2026-03-29 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_rear_passenger-1774708185972.jpg> (referer: None)
2026-03-29 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9620/20489620/interior_front_seats-1774709035558.jpg> (referer: None)
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa13b650>
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6072%252F19816072%252Fexterior_front_driver-1774706708183.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6072/19816072/exterior_front_driver-1774706708183.jpg saved to cache
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9062080-17fb-5f42-b4d5-3bc95e460639
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f919de10>
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8238%252F20478238%252Fexterior_front_driver-1774779455780.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_front_driver-1774779455780.jpg saved to cache
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7861f396-f52c-582c-81ee-a4b5d0be8df2
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae6ff10>
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8238%252F20478238%252Fexterior_rear_driver-1774779469606.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_rear_driver-1774779469606.jpg saved to cache
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7861f396-f52c-582c-81ee-a4b5d0be8df2
2026-03-29 20:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7861f396-f52c-582c-81ee-a4b5d0be8df2, skipping ID generation
2026-03-29 20:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7861f396-f52c-582c-81ee-a4b5d0be8df2 with scrape type 1
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7861f396-f52c-582c-81ee-a4b5d0be8df2 sending to next pipeline
2026-03-29 20:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7861f396-f52c-582c-81ee-a4b5d0be8df2, identifier: 20478238
2026-03-29 20:01:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:01:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e0b750>
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1058%252F17461058%252Finterior_front_seats-1773507835325.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1058/17461058/interior_front_seats-1773507835325.jpg saved to cache
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99c53734-619e-5b43-94d7-8aab539246a4
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9389fd0>
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6072%252F19816072%252Fexterior_rear_driver-1774780335564.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6072/19816072/exterior_rear_driver-1774780335564.jpg saved to cache
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9062080-17fb-5f42-b4d5-3bc95e460639
2026-03-29 20:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e9062080-17fb-5f42-b4d5-3bc95e460639, skipping ID generation
2026-03-29 20:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9062080-17fb-5f42-b4d5-3bc95e460639 with scrape type 1
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9062080-17fb-5f42-b4d5-3bc95e460639 sending to next pipeline
2026-03-29 20:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e9062080-17fb-5f42-b4d5-3bc95e460639, identifier: 19816072
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f86f10>
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9620%252F20489620%252Fexterior_rear_passenger-1774708185972.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_rear_passenger-1774708185972.jpg saved to cache
2026-03-29 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 573ed996-5ee5-5067-a474-41cb30fa1283
2026-03-29 20:01:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9388f10>
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9620%252F20489620%252Finterior_front_seats-1774709035558.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9620/20489620/interior_front_seats-1774709035558.jpg saved to cache
2026-03-29 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 573ed996-5ee5-5067-a474-41cb30fa1283
2026-03-29 20:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7861f396-f52c-582c-81ee-a4b5d0be8df2 with identifier: 20478238
2026-03-29 20:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7861f396-f52c-582c-81ee-a4b5d0be8df2 with identifier: 20478238
2026-03-29 20:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7861f396-f52c-582c-81ee-a4b5d0be8df2 with identifier: 20478238 to the API
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_rear_driver-1774779469606.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7861f396-f52c-582c-81ee-a4b5d0be8df2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CK20 YXW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20478238',
'listing': 'auction',
'location': 'Lincolnshire Lincoln',
'make': 'Audi',
'model': 'Q2',
'odometer': 50311,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1800366,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_front_driver-1774779455780.jpg',
'Width': 3455},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1446098,
'Height': 2412,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_rear_driver-1774779469606.jpg',
'Width': 3216},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1198829,
'Height': 2186,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_front_passenger-1774779491580.jpg',
'Width': 2914},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1397265,
'Height': 2429,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8238/20478238/exterior_rear_passenger-1774779477258.jpg',
'Width': 3238},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4110228,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8238/20478238/interior_front_seats-1774779997232.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3472829,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8238/20478238/interior_rear_seats-1774780841637.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2270345,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8238/20478238/interior_dashboard-1774782411130.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2653483,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8238/20478238/instrument_cluster-1774780075536.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3403311,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8238/20478238/interior_boot-1774780072498.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7861f396-f52c-582c-81ee-a4b5d0be8df2/7861f396-f52c-582c-81ee-a4b5d0be8df2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1584906,
'Height': 3652,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8238/20478238/docs_service_history-1774783206440.jpg?ixlib=js-3.8.0&auto=format&s=b7f3e7b6ce4ae535f59358b755f00341',
'Width': 2739}],
'price': 12081,
'price_includes_vat': False,
'registration_date': '2020-07-09',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q2 S Line 35 TFSI',
'transmission': 'manual',
'trim': 'S Line 35 TFSI',
'vin': 'WAUZZZGA3LA040228',
'year': 2020}
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720478238%27 HTTP/1.1" 200 None
2026-03-29 20:01:30 [motorway.uk] INFO: Saving data for 20478238: {'created_time': 1774814490.496161, 'last_price_update_time': 1774814490.496171, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20478238') HTTP/1.1" 204 0
2026-03-29 20:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e9062080-17fb-5f42-b4d5-3bc95e460639 with identifier: 19816072
2026-03-29 20:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e9062080-17fb-5f42-b4d5-3bc95e460639 with identifier: 19816072
2026-03-29 20:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e9062080-17fb-5f42-b4d5-3bc95e460639 with identifier: 19816072 to the API
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/6072/19816072/exterior_rear_driver-1774780335564.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'e9062080-17fb-5f42-b4d5-3bc95e460639',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MB19 TGV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19816072',
'listing': 'auction',
'location': 'Essex Chelmsford',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 32261,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1393981,
'Height': 2100,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6072/19816072/exterior_front_driver-1774706708183.jpg',
'Width': 2800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1958016,
'Height': 2321,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6072/19816072/exterior_rear_driver-1774780335564.jpg',
'Width': 3095},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1865432,
'Height': 2199,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6072/19816072/exterior_front_passenger-1774780351524.jpg',
'Width': 2932},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1748583,
'Height': 2403,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6072/19816072/exterior_rear_passenger-1774706736063.jpg',
'Width': 3204},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1462232,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6072/19816072/interior_front_seats-1774707007865.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1196561,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6072/19816072/interior_rear_seats-1774707027076.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1470790,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6072/19816072/interior_dashboard-1774707027249.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309741,
'Height': 1679,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6072/19816072/instrument_cluster-1774780252466.jpg',
'Width': 2239},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2503355,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6072/19816072/interior_boot-1774707045790.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9062080-17fb-5f42-b4d5-3bc95e460639/e9062080-17fb-5f42-b4d5-3bc95e460639_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1708117,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6072/19816072/docs_service_history-1774779526177.jpg?ixlib=js-3.8.0&auto=format&s=7e5e4fd1163dbe98d4ff81781fb6a77a',
'Width': 2880}],
'price': 11275,
'price_includes_vat': False,
'registration_date': '2019-08-15',
'seats_number': None,
'seller_name': None,
'title': 'Ford Mondeo Zetec Edition Ecoblue',
'transmission': 'manual',
'trim': 'Zetec Edition Ecoblue',
'vin': 'WF0EXXWPCEKY57026',
'year': 2019}
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719816072%27 HTTP/1.1" 200 None
2026-03-29 20:01:30 [motorway.uk] INFO: Saving data for 19816072: {'created_time': 1774814490.908563, 'last_price_update_time': 1774814490.908574, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19816072') HTTP/1.1" 204 0
2026-03-29 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_front_driver-1773507329612.jpg> (referer: None)
2026-03-29 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_rear_passenger-1773507059549.jpg> (referer: None)
2026-03-29 20:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_front_passenger-1773507071016.jpg> (referer: None)
2026-03-29 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_rear_driver-1773507191875.jpg> (referer: None)
2026-03-29 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_rear_driver-1774708139185.jpg> (referer: None)
2026-03-29 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_front_passenger-1774708204632.jpg> (referer: None)
2026-03-29 20:01:30 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (14562428) larger than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7592/20477592/20477592-docs_service_history-default-1774702163822.png?ixlib=js-3.8.0&auto=format&s=6620f3208ec4581fb6226d12b07f0425>.
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f92242d0>
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1058%252F17461058%252Fexterior_front_driver-1773507329612.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_front_driver-1773507329612.jpg saved to cache
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99c53734-619e-5b43-94d7-8aab539246a4
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae6d350>
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1058%252F17461058%252Fexterior_rear_passenger-1773507059549.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_rear_passenger-1773507059549.jpg saved to cache
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99c53734-619e-5b43-94d7-8aab539246a4
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9599f10>
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1058%252F17461058%252Fexterior_front_passenger-1773507071016.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_front_passenger-1773507071016.jpg saved to cache
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99c53734-619e-5b43-94d7-8aab539246a4
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010de590>
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1058%252F17461058%252Fexterior_rear_driver-1773507191875.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_rear_driver-1773507191875.jpg saved to cache
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99c53734-619e-5b43-94d7-8aab539246a4
2026-03-29 20:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99c53734-619e-5b43-94d7-8aab539246a4, skipping ID generation
2026-03-29 20:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99c53734-619e-5b43-94d7-8aab539246a4 with scrape type 1
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99c53734-619e-5b43-94d7-8aab539246a4 sending to next pipeline
2026-03-29 20:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 99c53734-619e-5b43-94d7-8aab539246a4, identifier: 17461058
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cc9310>
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9620%252F20489620%252Fexterior_rear_driver-1774708139185.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_rear_driver-1774708139185.jpg saved to cache
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 573ed996-5ee5-5067-a474-41cb30fa1283
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87012ccf90>
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9620%252F20489620%252Fexterior_front_passenger-1774708204632.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_front_passenger-1774708204632.jpg saved to cache
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 573ed996-5ee5-5067-a474-41cb30fa1283
2026-03-29 20:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 573ed996-5ee5-5067-a474-41cb30fa1283, skipping ID generation
2026-03-29 20:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 573ed996-5ee5-5067-a474-41cb30fa1283 with scrape type 1
2026-03-29 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 573ed996-5ee5-5067-a474-41cb30fa1283 sending to next pipeline
2026-03-29 20:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 573ed996-5ee5-5067-a474-41cb30fa1283, identifier: 20489620
2026-03-29 20:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 99c53734-619e-5b43-94d7-8aab539246a4 with identifier: 17461058
2026-03-29 20:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 99c53734-619e-5b43-94d7-8aab539246a4 with identifier: 17461058
2026-03-29 20:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 99c53734-619e-5b43-94d7-8aab539246a4 with identifier: 17461058 to the API
2026-03-29 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_rear_driver-1773507191875.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '99c53734-619e-5b43-94d7-8aab539246a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KD04 GLD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17461058',
'listing': 'auction',
'location': 'Greater Manchester Manchester',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 59000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1197962,
'Height': 2153,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_front_driver-1773507329612.jpg',
'Width': 2871},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1430547,
'Height': 2489,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_rear_driver-1773507191875.jpg',
'Width': 3319},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1458512,
'Height': 2468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_front_passenger-1773507071016.jpg',
'Width': 3290},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1735408,
'Height': 2843,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1058/17461058/exterior_rear_passenger-1773507059549.jpg',
'Width': 3790},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2531877,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1058/17461058/interior_front_seats-1773507835325.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2928129,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1058/17461058/interior_rear_seats-1773507800470.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1706636,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1058/17461058/interior_dashboard-1774776045184.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3021239,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1058/17461058/interior_boot-1773507722801.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6508451,
'Height': 4006,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1058/17461058/docs_service_history-1773508348797.jpg?ixlib=js-3.8.0&auto=format&s=3dcacf226775a20d624e505e64349c47',
'Width': 2647},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99c53734-619e-5b43-94d7-8aab539246a4/99c53734-619e-5b43-94d7-8aab539246a4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4487260,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1058/17461058/damage_scratches-1773507465669.jpg',
'Width': 4032}],
'price': 21932,
'price_includes_vat': False,
'registration_date': '2018-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover R Rover Velar R-DYN HSE P380 A',
'transmission': 'automatic',
'trim': 'R Rover Velar R-DYN HSE P380 A',
'vin': 'SALYA2AV5JA729668',
'year': 2018}
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717461058%27 HTTP/1.1" 200 None
2026-03-29 20:01:32 [motorway.uk] INFO: Saving data for 17461058: {'created_time': 1774814492.308814, 'last_price_update_time': 1774814492.308833, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17461058') HTTP/1.1" 204 0
2026-03-29 20:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 573ed996-5ee5-5067-a474-41cb30fa1283 with identifier: 20489620
2026-03-29 20:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 573ed996-5ee5-5067-a474-41cb30fa1283 with identifier: 20489620
2026-03-29 20:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 573ed996-5ee5-5067-a474-41cb30fa1283 with identifier: 20489620 to the API
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_front_passenger-1774708204632.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '573ed996-5ee5-5067-a474-41cb30fa1283',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YO69 BHK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20489620',
'listing': 'auction',
'location': 'Derbyshire Hope Valley',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 46108,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2121530,
'Height': 2738,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_front_driver-1774708113599.jpg',
'Width': 3651},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1344433,
'Height': 2551,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_rear_driver-1774708139185.jpg',
'Width': 3401},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1694939,
'Height': 2717,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_front_passenger-1774708204632.jpg',
'Width': 3622},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1653044,
'Height': 2697,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9620/20489620/exterior_rear_passenger-1774708185972.jpg',
'Width': 3596},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3344959,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9620/20489620/interior_front_seats-1774709035558.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3587931,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9620/20489620/interior_rear_seats-1774709050162.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2201445,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9620/20489620/interior_dashboard-1774715211809.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275755,
'Height': 1120,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9620/20489620/instrument_cluster-1774715293061.jpg',
'Width': 1493},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3703462,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9620/20489620/interior_boot-1774709156755.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_573ed996-5ee5-5067-a474-41cb30fa1283/573ed996-5ee5-5067-a474-41cb30fa1283_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98887,
'Height': 1165,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9620/20489620/docs_service_history-1774714795216.jpg?ixlib=js-3.8.0&auto=format&s=97ed6ed20bed896a15f1393fdea1b287',
'Width': 874}],
'price': 28075,
'price_includes_vat': False,
'registration_date': '2020-01-29',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery HSE SD6 Auto',
'transmission': 'automatic',
'trim': 'HSE SD6 Auto',
'vin': 'SALRA2AK8L2419814',
'year': 2020}
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489620%27 HTTP/1.1" 200 None
2026-03-29 20:01:32 [motorway.uk] INFO: Saving data for 20489620: {'created_time': 1774814492.694214, 'last_price_update_time': 1774814492.694225, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20489620') HTTP/1.1" 204 0
2026-03-29 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=252&page=7&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6821/8876821/exterior_rear_passenger-1774688386685.jpg> (referer: None)
2026-03-29 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3933/20413933/docs_service_history-1774791555727.jpg?ixlib=js-3.8.0&auto=format&s=6e4da6faf7cf1ed754e3feb8881c7189> (referer: None)
2026-03-29 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_front_driver-1774613935506.jpg> (referer: None)
2026-03-29 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7592/20477592/interior_boot-1774695743926.jpeg> (referer: None)
2026-03-29 20:01:32 [motorway.uk] INFO: Found listing with ID: 20471425
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471425%27 HTTP/1.1" 200 None
2026-03-29 20:01:32 [motorway.uk] INFO: Scrape type for 20471425: 1
2026-03-29 20:01:32 [motorway.uk] INFO: Found listing with ID: 20460179
2026-03-29 20:01:32 [motorway.uk] INFO: Found listing with ID: 20486036
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486036%27 HTTP/1.1" 200 None
2026-03-29 20:01:32 [motorway.uk] INFO: Scrape type for 20486036: 1
2026-03-29 20:01:32 [motorway.uk] INFO: Found listing with ID: 20484858
2026-03-29 20:01:32 [motorway.uk] INFO: Found listing with ID: 20485204
2026-03-29 20:01:32 [motorway.uk] INFO: Found listing with ID: 20487941
2026-03-29 20:01:32 [motorway.uk] INFO: Found listing with ID: 20364057
2026-03-29 20:01:32 [motorway.uk] INFO: Found listing with ID: 20486965
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486965%27 HTTP/1.1" 200 None
2026-03-29 20:01:32 [motorway.uk] INFO: Scrape type for 20486965: 1
2026-03-29 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010df690>
2026-03-29 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6821%252F8876821%252Fexterior_rear_passenger-1774688386685.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6821/8876821/exterior_rear_passenger-1774688386685.jpg saved to cache
2026-03-29 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 705bf3c4-31e3-5036-85bf-926e34f13abb
2026-03-29 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f924a4d0>
2026-03-29 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_032cad62-ed12-595e-aca2-d44684bdcd0c/032cad62-ed12-595e-aca2-d44684bdcd0c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3933%252F20413933%252Fdocs_service_history-1774791555727.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6e4da6faf7cf1ed754e3feb8881c7189') HTTP/1.1" 204 0
2026-03-29 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3933/20413933/docs_service_history-1774791555727.jpg?ixlib=js-3.8.0&auto=format&s=6e4da6faf7cf1ed754e3feb8881c7189 saved to cache
2026-03-29 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 032cad62-ed12-595e-aca2-d44684bdcd0c
2026-03-29 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0c94d0>
2026-03-29 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4990%252F20444990%252Fexterior_front_driver-1774613935506.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_front_driver-1774613935506.jpg saved to cache
2026-03-29 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7
2026-03-29 20:01:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 600e20f1-67f3-5fb3-ac5e-8e06785350c7, skipping ID generation
2026-03-29 20:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7 with scrape type 1
2026-03-29 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 600e20f1-67f3-5fb3-ac5e-8e06785350c7 sending to next pipeline
2026-03-29 20:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 600e20f1-67f3-5fb3-ac5e-8e06785350c7, identifier: 20444990
2026-03-29 20:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 600e20f1-67f3-5fb3-ac5e-8e06785350c7 with identifier: 20444990
2026-03-29 20:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 600e20f1-67f3-5fb3-ac5e-8e06785350c7 with identifier: 20444990
2026-03-29 20:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 600e20f1-67f3-5fb3-ac5e-8e06785350c7 with identifier: 20444990 to the API
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_front_driver-1774613935506.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '600e20f1-67f3-5fb3-ac5e-8e06785350c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FN22 LYH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20444990',
'listing': 'auction',
'location': 'Leicestershire Loughborough',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 16856,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 959229,
'Height': 2369,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_front_driver-1774613935506.jpg',
'Width': 3159},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1269023,
'Height': 2789,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_rear_driver-1774613957233.jpg',
'Width': 3719},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1237485,
'Height': 2681,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_front_passenger-1774613990896.jpg',
'Width': 3574},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1054281,
'Height': 2476,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4990/20444990/exterior_rear_passenger-1774613972772.jpg',
'Width': 3301},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3816140,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4990/20444990/interior_front_seats-1774705965532.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3242646,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4990/20444990/interior_rear_seats-1774705998774.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3021653,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4990/20444990/interior_dashboard-1774706045273.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3165821,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4990/20444990/instrument_cluster-1774706036859.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4404505,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4990/20444990/interior_boot-1774705845954.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_600e20f1-67f3-5fb3-ac5e-8e06785350c7/600e20f1-67f3-5fb3-ac5e-8e06785350c7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1334091,
'Height': 2482,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4990/20444990/wheels_front_driver-1774614166011.jpg',
'Width': 3309}],
'price': 13080,
'price_includes_vat': False,
'registration_date': '2022-04-20',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Kona Premium EV',
'transmission': 'automatic',
'trim': 'Premium EV',
'vin': 'KMHK381GUNU149162',
'year': 2022}
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720444990%27 HTTP/1.1" 200 None
2026-03-29 20:01:33 [motorway.uk] INFO: Saving data for 20444990: {'created_time': 1774814493.590716, 'last_price_update_time': 1774814493.590726, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20444990') HTTP/1.1" 204 0
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 20137059
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720137059%27 HTTP/1.1" 200 None
2026-03-29 20:01:33 [motorway.uk] INFO: Scrape type for 20137059: 1
2026-03-29 20:01:33 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:01:33 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:01:33 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00#\xf1\xd8\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xaf\x07\x00#\xe7b\x00\x00\x00\x00'
2026-03-29 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faef24d0>
2026-03-29 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70c46a71-96de-5f0e-b337-191561bbe02d/70c46a71-96de-5f0e-b337-191561bbe02d_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7592%252F20477592%252Finterior_boot-1774695743926.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7592/20477592/interior_boot-1774695743926.jpeg saved to cache
2026-03-29 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70c46a71-96de-5f0e-b337-191561bbe02d
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 20074064
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 20211024
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 15623720
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 3788757
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 20490856
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 3629062
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273629062%27 HTTP/1.1" 200 None
2026-03-29 20:01:33 [motorway.uk] INFO: Scrape type for 3629062: 1
2026-03-29 20:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 17539370
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717539370%27 HTTP/1.1" 200 None
2026-03-29 20:01:33 [motorway.uk] INFO: Scrape type for 17539370: 1
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 19374986
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719374986%27 HTTP/1.1" 200 None
2026-03-29 20:01:33 [motorway.uk] INFO: Scrape type for 19374986: 1
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 8230018
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 20417498
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 20493011
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 19185609
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 20459030
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 19077638
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 11018452
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 20107109
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 19998396
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719998396%27 HTTP/1.1" 200 None
2026-03-29 20:01:33 [motorway.uk] INFO: Scrape type for 19998396: 1
2026-03-29 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7592/20477592/instrument_cluster-1774695777485.jpeg> (referer: None)
2026-03-29 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3933/20413933/instrument_cluster-1774791470293.jpg> (referer: None)
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 20254074
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 20487479
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 20436997
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720436997%27 HTTP/1.1" 200 None
2026-03-29 20:01:33 [motorway.uk] INFO: Scrape type for 20436997: 1
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 12193651
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 12187861
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712187861%27 HTTP/1.1" 200 None
2026-03-29 20:01:33 [motorway.uk] INFO: Scrape type for 12187861: 1
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 13059915
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 16021572
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 20368083
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 20499187
2026-03-29 20:01:33 [motorway.uk] INFO: Found listing with ID: 11654403
2026-03-29 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6821/8876821/exterior_rear_driver-1774688358841.jpg> (referer: None)
2026-03-29 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9304/20449304/wheels_front_driver-1774701254511.jpg> (referer: None)
2026-03-29 20:01:33 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7592/20477592/20477592-docs_service_history-default-1774702163822.png?ixlib=js-3.8.0&auto=format&s=6620f3208ec4581fb6226d12b07f0425>.
2026-03-29 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9304/20449304/interior_boot-1774704573969.jpg> (referer: None)
2026-03-29 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7592/20477592/20477592-docs_service_history-default-1774702163822.png?ixlib=js-3.8.0&auto=format&s=6620f3208ec4581fb6226d12b07f0425> (referer: None)
2026-03-29 20:01:33 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:01:33 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:01:33 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x18\x97f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xc7\x82\x00\x18\x8c\xf0\x00\x00\x00\x00'
2026-03-29 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9598350>
2026-03-29 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70c46a71-96de-5f0e-b337-191561bbe02d/70c46a71-96de-5f0e-b337-191561bbe02d_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7592%252F20477592%252Finstrument_cluster-1774695777485.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7592/20477592/instrument_cluster-1774695777485.jpeg saved to cache
2026-03-29 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70c46a71-96de-5f0e-b337-191561bbe02d
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f930b310>
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_032cad62-ed12-595e-aca2-d44684bdcd0c/032cad62-ed12-595e-aca2-d44684bdcd0c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3933%252F20413933%252Finstrument_cluster-1774791470293.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3933/20413933/instrument_cluster-1774791470293.jpg saved to cache
2026-03-29 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 032cad62-ed12-595e-aca2-d44684bdcd0c
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f967f650>
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6821%252F8876821%252Fexterior_rear_driver-1774688358841.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6821/8876821/exterior_rear_driver-1774688358841.jpg saved to cache
2026-03-29 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 705bf3c4-31e3-5036-85bf-926e34f13abb
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f955d0>
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad/3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20449304%252Fwheels_front_driver-1774701254511.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20449304/wheels_front_driver-1774701254511.jpg saved to cache
2026-03-29 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad
2026-03-29 20:01:34 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:01:34 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:01:34 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00:3x\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07))\x00:\r<\x00\x00\x00\x00'
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d17950>
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad/3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9304%252F20449304%252Finterior_boot-1774704573969.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9304/20449304/interior_boot-1774704573969.jpg saved to cache
2026-03-29 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad
2026-03-29 20:01:34 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:01:34 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-29 20:01:34 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d14090>
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70c46a71-96de-5f0e-b337-191561bbe02d/70c46a71-96de-5f0e-b337-191561bbe02d_image_8.png HTTP/1.1" 201 0
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7592%252F20477592%252F20477592-docs_service_history-default-1774702163822.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6620f3208ec4581fb6226d12b07f0425') HTTP/1.1" 204 0
2026-03-29 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7592/20477592/20477592-docs_service_history-default-1774702163822.png?ixlib=js-3.8.0&auto=format&s=6620f3208ec4581fb6226d12b07f0425 saved to cache
2026-03-29 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70c46a71-96de-5f0e-b337-191561bbe02d
2026-03-29 20:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6821/8876821/exterior_front_passenger-1774696263775.jpg> (referer: None)
2026-03-29 20:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3933/20413933/interior_boot-1774721192738.jpg> (referer: None)
2026-03-29 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9135750>
2026-03-29 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6821%252F8876821%252Fexterior_front_passenger-1774696263775.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6821/8876821/exterior_front_passenger-1774696263775.jpg saved to cache
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 705bf3c4-31e3-5036-85bf-926e34f13abb
2026-03-29 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20172802.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19344017.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12967935.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20189241.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18821611.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f925b750>
2026-03-29 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_032cad62-ed12-595e-aca2-d44684bdcd0c/032cad62-ed12-595e-aca2-d44684bdcd0c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3933%252F20413933%252Finterior_boot-1774721192738.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3933/20413933/interior_boot-1774721192738.jpg saved to cache
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 032cad62-ed12-595e-aca2-d44684bdcd0c
2026-03-29 20:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19286556.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20497223.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d80abfc-6144-5677-bfc9-eae46e31cf23 with identifier: 20172802
2026-03-29 20:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d80abfc-6144-5677-bfc9-eae46e31cf23 with scrape type 1
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d80abfc-6144-5677-bfc9-eae46e31cf23
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2802%252F20172802%252Fexterior_front_driver-1774720687902.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2802/20172802/exterior_front_driver-1774720687902.jpg not downloaded yet
2026-03-29 20:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12c27ff9-03a9-5991-88c9-4d38ad94ff36 with identifier: 19344017
2026-03-29 20:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12c27ff9-03a9-5991-88c9-4d38ad94ff36 with scrape type 1
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12c27ff9-03a9-5991-88c9-4d38ad94ff36
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4017%252F19344017%252Fexterior_front_driver-1774019496685.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4017/19344017/exterior_front_driver-1774019496685.jpeg not downloaded yet
2026-03-29 20:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71106f11-c40c-578f-b1e9-4d02cc440ae3 with identifier: 12967935
2026-03-29 20:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71106f11-c40c-578f-b1e9-4d02cc440ae3 with scrape type 1
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71106f11-c40c-578f-b1e9-4d02cc440ae3
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7935%252F12967935%252Fexterior_front_driver-1774609242590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7935/12967935/exterior_front_driver-1774609242590.jpg not downloaded yet
2026-03-29 20:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cf97bc4-b8ed-528c-8608-95eb7b3cee85 with identifier: 20189241
2026-03-29 20:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cf97bc4-b8ed-528c-8608-95eb7b3cee85 with scrape type 1
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7cf97bc4-b8ed-528c-8608-95eb7b3cee85
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9241%252F20189241%252Fexterior_front_driver-1774779387005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9241/20189241/exterior_front_driver-1774779387005.jpg not downloaded yet
2026-03-29 20:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a95162e-6239-585e-8427-257e5bc923db with identifier: 18821611
2026-03-29 20:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a95162e-6239-585e-8427-257e5bc923db with scrape type 1
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a95162e-6239-585e-8427-257e5bc923db
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1611%252F18821611%252Fexterior_front_driver-1774708242172.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1611/18821611/exterior_front_driver-1774708242172.jpeg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2802%252F20172802%252Fexterior_rear_driver-1774720717769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2802/20172802/exterior_rear_driver-1774720717769.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4017%252F19344017%252Fexterior_rear_driver-1774019544591.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4017/19344017/exterior_rear_driver-1774019544591.jpeg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7935%252F12967935%252Fexterior_rear_driver-1774609264900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7935/12967935/exterior_rear_driver-1774609264900.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9241%252F20189241%252Fexterior_rear_driver-1773680794084.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9241/20189241/exterior_rear_driver-1773680794084.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1611%252F18821611%252Fexterior_rear_driver-1774708307169.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1611/18821611/exterior_rear_driver-1774708307169.jpeg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2802%252F20172802%252Fexterior_front_passenger-1774720780454.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2802/20172802/exterior_front_passenger-1774720780454.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4017%252F19344017%252Fexterior_front_passenger-1774019520012.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4017/19344017/exterior_front_passenger-1774019520012.jpeg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7935%252F12967935%252Fexterior_front_passenger-1774609253035.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7935/12967935/exterior_front_passenger-1774609253035.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9241%252F20189241%252Fexterior_front_passenger-1773680795487.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9241/20189241/exterior_front_passenger-1773680795487.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1611%252F18821611%252Fexterior_front_passenger-1774708256773.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1611/18821611/exterior_front_passenger-1774708256773.jpeg not downloaded yet
2026-03-29 20:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbbe981b-30fc-51f9-85a5-d5deae559a56 with identifier: 19286556
2026-03-29 20:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbbe981b-30fc-51f9-85a5-d5deae559a56 with scrape type 1
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cbbe981b-30fc-51f9-85a5-d5deae559a56
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6556%252F19286556%252Fexterior_front_driver-1774719520957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6556/19286556/exterior_front_driver-1774719520957.jpg not downloaded yet
2026-03-29 20:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cbf02a5-5d85-5b99-81ac-84dd692313ff with identifier: 20497223
2026-03-29 20:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cbf02a5-5d85-5b99-81ac-84dd692313ff with scrape type 1
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cbf02a5-5d85-5b99-81ac-84dd692313ff
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7223%252F20497223%252Fexterior_front_driver-1774776677853.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7223/20497223/exterior_front_driver-1774776677853.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2802%252F20172802%252Fexterior_rear_passenger-1774720739605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2802/20172802/exterior_rear_passenger-1774720739605.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4017%252F19344017%252Fexterior_rear_passenger-1774019462573.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4017/19344017/exterior_rear_passenger-1774019462573.jpeg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7935%252F12967935%252Fexterior_rear_passenger-1774609281114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7935/12967935/exterior_rear_passenger-1774609281114.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9241%252F20189241%252Fexterior_rear_passenger-1773680791679.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9241/20189241/exterior_rear_passenger-1773680791679.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1611%252F18821611%252Fexterior_rear_passenger-1774708290139.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1611/18821611/exterior_rear_passenger-1774708290139.jpeg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6556%252F19286556%252Fexterior_rear_driver-1774719526391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6556/19286556/exterior_rear_driver-1774719526391.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7223%252F20497223%252Fexterior_rear_driver-1774776754758.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7223/20497223/exterior_rear_driver-1774776754758.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2802%252F20172802%252Finterior_front_seats-1774721416518.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2802/20172802/interior_front_seats-1774721416518.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4017%252F19344017%252Finterior_front_seats-1774019574496.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4017/19344017/interior_front_seats-1774019574496.jpeg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7935%252F12967935%252Finterior_front_seats-1774611992120.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7935/12967935/interior_front_seats-1774611992120.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9241%252F20189241%252Finterior_front_seats-1773681858265.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9241/20189241/interior_front_seats-1773681858265.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1611%252F18821611%252Finterior_front_seats-1774708328760.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1611/18821611/interior_front_seats-1774708328760.jpeg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6556%252F19286556%252Fexterior_front_passenger-1774719511295.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6556/19286556/exterior_front_passenger-1774719511295.jpg not downloaded yet
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7223%252F20497223%252Fexterior_front_passenger-1774776863165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7223/20497223/exterior_front_passenger-1774776863165.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2802%252F20172802%252Finterior_rear_seats-1774721299203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2802/20172802/interior_rear_seats-1774721299203.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4017%252F19344017%252Finterior_rear_seats-1774019624265.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4017/19344017/interior_rear_seats-1774019624265.jpeg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7935%252F12967935%252Finterior_rear_seats-1774609678467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7935/12967935/interior_rear_seats-1774609678467.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9241%252F20189241%252Finterior_rear_seats-1773681771869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9241/20189241/interior_rear_seats-1773681771869.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1611%252F18821611%252Finterior_rear_seats-1774708433846.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1611/18821611/interior_rear_seats-1774708433846.jpeg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6556%252F19286556%252Fexterior_rear_passenger-1774719518506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6556/19286556/exterior_rear_passenger-1774719518506.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7223%252F20497223%252Fexterior_rear_passenger-1774776787100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7223/20497223/exterior_rear_passenger-1774776787100.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2802%252F20172802%252Finterior_dashboard-1774781947105.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2802/20172802/interior_dashboard-1774781947105.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4017%252F19344017%252Finterior_dashboard-1774019701099.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4017/19344017/interior_dashboard-1774019701099.jpeg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7935%252F12967935%252Finterior_dashboard-1774609689104.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7935/12967935/interior_dashboard-1774609689104.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9241%252F20189241%252Finterior_dashboard-1773681791631.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9241/20189241/interior_dashboard-1773681791631.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1611%252F18821611%252Finterior_dashboard-1774708475275.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1611/18821611/interior_dashboard-1774708475275.jpeg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6556%252F19286556%252Finterior_front_seats-1774720365189.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6556/19286556/interior_front_seats-1774720365189.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7223%252F20497223%252Finterior_front_seats-1774777192945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7223/20497223/interior_front_seats-1774777192945.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2802%252F20172802%252Finstrument_cluster-1774782005543.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2802/20172802/instrument_cluster-1774782005543.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4017%252F19344017%252Finstrument_cluster-1774019720580.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4017/19344017/instrument_cluster-1774019720580.jpeg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7935%252F12967935%252Finterior_boot-1774609689326.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7935/12967935/interior_boot-1774609689326.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9241%252F20189241%252Finstrument_cluster-1774779376626.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9241/20189241/instrument_cluster-1774779376626.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1611%252F18821611%252Finstrument_cluster-1774708525377.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1611/18821611/instrument_cluster-1774708525377.jpeg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6556%252F19286556%252Finterior_rear_seats-1774720368903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6556/19286556/interior_rear_seats-1774720368903.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7223%252F20497223%252Finterior_rear_seats-1774777213199.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7223/20497223/interior_rear_seats-1774777213199.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2802%252F20172802%252Finterior_boot-1774781959556.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2802/20172802/interior_boot-1774781959556.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4017%252F19344017%252Finterior_boot-1774019663019.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4017/19344017/interior_boot-1774019663019.jpeg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7935%252F12967935%252Fdocs_service_history-1774609781652.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D547ba1ec1eb5b705ad2ef92c9d557857%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7935/12967935/docs_service_history-1774609781652.jpg?ixlib=js-3.8.0&auto=format&s=547ba1ec1eb5b705ad2ef92c9d557857 not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9241%252F20189241%252Finterior_boot-1773681769352.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9241/20189241/interior_boot-1773681769352.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1611%252F18821611%252Finterior_boot-1774708480200.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1611/18821611/interior_boot-1774708480200.jpeg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6556%252F19286556%252Finterior_dashboard-1774720471257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6556/19286556/interior_dashboard-1774720471257.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7223%252F20497223%252Finterior_dashboard-1774777267380.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7223/20497223/interior_dashboard-1774777267380.jpg not downloaded yet
2026-03-29 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=288&page=8&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2802%252F20172802%252Fdocs_service_history-1774775996856.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0750e7a1328823ef6a4b1401290e57ec%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2802/20172802/docs_service_history-1774775996856.jpg?ixlib=js-3.8.0&auto=format&s=0750e7a1328823ef6a4b1401290e57ec not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4017%252F19344017%252F19344017-docs_service_history-default-1774029188353.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D98a33a6c7479432f11eb6a436f9968f6%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4017/19344017/19344017-docs_service_history-default-1774029188353.png?ixlib=js-3.8.0&auto=format&s=98a33a6c7479432f11eb6a436f9968f6 not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7935%252F12967935%252Fdocs_service_history-1774609810818.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D74010e24c8d7de8b35a6cf9618b30f7f%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7935/12967935/docs_service_history-1774609810818.jpg?ixlib=js-3.8.0&auto=format&s=74010e24c8d7de8b35a6cf9618b30f7f not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9241%252F20189241%252Fdocs_service_history-1774637211655.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df50a99034cbc28fd615f7d471a4ec197%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9241/20189241/docs_service_history-1774637211655.jpg?ixlib=js-3.8.0&auto=format&s=f50a99034cbc28fd615f7d471a4ec197 not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F1611%252F18821611%252Fdocs_service_history-1769287602131.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7583320482a3ece616af731734712f0e%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/1611/18821611/docs_service_history-1769287602131.jpeg?ixlib=js-3.8.0&auto=format&s=7583320482a3ece616af731734712f0e not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6556%252F19286556%252Finstrument_cluster-1774720324909.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6556/19286556/instrument_cluster-1774720324909.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7223%252F20497223%252Finstrument_cluster-1774777334093.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7223/20497223/instrument_cluster-1774777334093.jpg not downloaded yet
2026-03-29 20:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6556%252F19286556%252Finterior_boot-1774720380624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6556/19286556/interior_boot-1774720380624.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7223%252F20497223%252Finterior_boot-1774777387353.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7223/20497223/interior_boot-1774777387353.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6556%252F19286556%252Fdocs_service_history-1774722194480-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2a626f45c45cec66da37cb8da63eb797%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6556/19286556/docs_service_history-1774722194480-2.jpeg?ixlib=js-3.8.0&auto=format&s=2a626f45c45cec66da37cb8da63eb797 not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7223%252F20497223%252Fdocs_service_history-1774777544522.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc7bc856d4e5a2304094f793238e86ae5%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7223/20497223/docs_service_history-1774777544522.jpg?ixlib=js-3.8.0&auto=format&s=c7bc856d4e5a2304094f793238e86ae5 not downloaded yet
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20470032
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 19734640
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20455021
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20237507
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20489983
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20393410
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 19840923
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20462094
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 16271814
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716271814%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [motorway.uk] INFO: Scrape type for 16271814: 1
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 16318590
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20487406
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 19679688
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719679688%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [motorway.uk] INFO: Scrape type for 19679688: 1
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 16422959
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20496326
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720496326%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [motorway.uk] INFO: Scrape type for 20496326: 1
2026-03-29 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20137059.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3933/20413933/interior_dashboard-1774791490823.jpg> (referer: None)
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 14326949
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20457094
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20453358
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 19940066
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719940066%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [motorway.uk] INFO: Scrape type for 19940066: 1
2026-03-29 20:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6821/8876821/exterior_front_driver-1774688715744.jpg> (referer: None)
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 13623460
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 19930182
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719930182%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [motorway.uk] INFO: Scrape type for 19930182: 1
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 19899454
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719899454%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [motorway.uk] INFO: Scrape type for 19899454: 1
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 19785042
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 18874288
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20490925
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 8725249
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20487634
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20485866
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20387201
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 18839860
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 17987243
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 14223294
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20439498
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720439498%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [motorway.uk] INFO: Scrape type for 20439498: 1
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20130616
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 19164973
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 19699947
2026-03-29 20:01:36 [motorway.uk] INFO: Found listing with ID: 20316056
2026-03-29 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9304/20449304/instrument_cluster-1774703051123.jpg> (referer: None)
2026-03-29 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3933/20413933/interior_rear_seats-1774721435860.jpg> (referer: None)
2026-03-29 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7592/20477592/interior_dashboard-1774695706657.jpeg> (referer: None)
2026-03-29 20:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d830cab0-5036-5e8d-801f-771efc6489ca with identifier: 20137059
2026-03-29 20:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d830cab0-5036-5e8d-801f-771efc6489ca with scrape type 1
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d830cab0-5036-5e8d-801f-771efc6489ca
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7059%252F20137059%252Fexterior_front_driver-1774712962960.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_front_driver-1774712962960.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7059%252F20137059%252Fexterior_rear_driver-1774713031314.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_rear_driver-1774713031314.jpg not downloaded yet
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7059%252F20137059%252Fexterior_front_passenger-1774713008419.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_front_passenger-1774713008419.jpg not downloaded yet
2026-03-29 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f9e290>
2026-03-29 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_032cad62-ed12-595e-aca2-d44684bdcd0c/032cad62-ed12-595e-aca2-d44684bdcd0c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3933%252F20413933%252Finterior_dashboard-1774791490823.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3933/20413933/interior_dashboard-1774791490823.jpg saved to cache
2026-03-29 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 032cad62-ed12-595e-aca2-d44684bdcd0c
2026-03-29 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa118110>
2026-03-29 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6821%252F8876821%252Fexterior_front_driver-1774688715744.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6821/8876821/exterior_front_driver-1774688715744.jpg saved to cache
2026-03-29 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 705bf3c4-31e3-5036-85bf-926e34f13abb
2026-03-29 20:01:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 705bf3c4-31e3-5036-85bf-926e34f13abb, skipping ID generation
2026-03-29 20:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 705bf3c4-31e3-5036-85bf-926e34f13abb with scrape type 1
2026-03-29 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 705bf3c4-31e3-5036-85bf-926e34f13abb sending to next pipeline
2026-03-29 20:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 705bf3c4-31e3-5036-85bf-926e34f13abb, identifier: 8876821
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7059%252F20137059%252Fexterior_rear_passenger-1774712994279.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_rear_passenger-1774712994279.jpg not downloaded yet
2026-03-29 20:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 705bf3c4-31e3-5036-85bf-926e34f13abb with identifier: 8876821
2026-03-29 20:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 705bf3c4-31e3-5036-85bf-926e34f13abb with identifier: 8876821
2026-03-29 20:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 705bf3c4-31e3-5036-85bf-926e34f13abb with identifier: 8876821 to the API
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6821/8876821/exterior_front_driver-1774688715744.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '705bf3c4-31e3-5036-85bf-926e34f13abb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LF17 SUX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/8876821',
'listing': 'auction',
'location': 'Greater London Enfield',
'make': 'Honda',
'model': 'CR-V',
'odometer': 66107,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1754007,
'Height': 2530,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6821/8876821/exterior_front_driver-1774688715744.jpg',
'Width': 3373},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1694314,
'Height': 2559,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6821/8876821/exterior_rear_driver-1774688358841.jpg',
'Width': 3412},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1653096,
'Height': 2409,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6821/8876821/exterior_front_passenger-1774696263775.jpg',
'Width': 3212},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1382385,
'Height': 2116,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6821/8876821/exterior_rear_passenger-1774688386685.jpg',
'Width': 2821},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3510966,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6821/8876821/interior_front_seats-1774689296586.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3125528,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6821/8876821/interior_rear_seats-1774689425687.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2022064,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6821/8876821/interior_dashboard-1774696305533.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2289203,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6821/8876821/interior_boot-1774696321819.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 575978,
'Height': 1916,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6821/8876821/docs_service_history-1774692807416.jpg?ixlib=js-3.8.0&auto=format&s=974c6421ffb1440d51b1ec8532cb9270',
'Width': 1437},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_705bf3c4-31e3-5036-85bf-926e34f13abb/705bf3c4-31e3-5036-85bf-926e34f13abb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3437805,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6821/8876821/damage_scratches-1774688835588.jpg',
'Width': 4032}],
'price': 8662,
'price_includes_vat': False,
'registration_date': '2017-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Honda CR-V SR I-DTEC 4X2',
'transmission': 'manual',
'trim': 'SR I-DTEC 4X2',
'vin': 'SHSRE6700GU208310',
'year': 2017}
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278876821%27 HTTP/1.1" 200 None
2026-03-29 20:01:37 [motorway.uk] INFO: Saving data for 8876821: {'created_time': 1774814497.962998, 'last_price_update_time': 1774814497.963013, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='8876821') HTTP/1.1" 204 0
2026-03-29 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7223/20497223/interior_dashboard-1774777267380.jpg> (referer: None)
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7059%252F20137059%252Finterior_front_seats-1774713361641.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7059/20137059/interior_front_seats-1774713361641.jpg not downloaded yet
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7059%252F20137059%252Finterior_rear_seats-1774715985658.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7059/20137059/interior_rear_seats-1774715985658.jpg not downloaded yet
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9314790>
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad/3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9304%252F20449304%252Finstrument_cluster-1774703051123.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9304/20449304/instrument_cluster-1774703051123.jpg saved to cache
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a8ed2e4-fe8c-540b-8a9b-6fe98e33fcad
2026-03-29 20:01:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac1fd90>
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_032cad62-ed12-595e-aca2-d44684bdcd0c/032cad62-ed12-595e-aca2-d44684bdcd0c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3933%252F20413933%252Finterior_rear_seats-1774721435860.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3933/20413933/interior_rear_seats-1774721435860.jpg saved to cache
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 032cad62-ed12-595e-aca2-d44684bdcd0c
2026-03-29 20:01:38 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:01:38 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:01:38 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x005\xccC\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xb8i\x005\xc1\xcd\x00\x00\x00\x00'
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e576d0>
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70c46a71-96de-5f0e-b337-191561bbe02d/70c46a71-96de-5f0e-b337-191561bbe02d_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7592%252F20477592%252Finterior_dashboard-1774695706657.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7592/20477592/interior_dashboard-1774695706657.jpeg saved to cache
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70c46a71-96de-5f0e-b337-191561bbe02d
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7059%252F20137059%252Finterior_dashboard-1774716981439.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7059/20137059/interior_dashboard-1774716981439.jpg not downloaded yet
2026-03-29 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19998396.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3629062.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486965.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12187861.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20436997.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7059%252F20137059%252Finstrument_cluster-1774717707190.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7059/20137059/instrument_cluster-1774717707190.jpg not downloaded yet
2026-03-29 20:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87011ae4d0>
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cbf02a5-5d85-5b99-81ac-84dd692313ff/4cbf02a5-5d85-5b99-81ac-84dd692313ff_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7223%252F20497223%252Finterior_dashboard-1774777267380.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7223/20497223/interior_dashboard-1774777267380.jpg saved to cache
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4cbf02a5-5d85-5b99-81ac-84dd692313ff
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7059%252F20137059%252Finterior_boot-1774713481114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7059/20137059/interior_boot-1774713481114.jpg not downloaded yet
2026-03-29 20:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7059%252F20137059%252Fdocs_service_history-1774717820344.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D25470ab3af12c15c9fd1843f39d741d5%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7059/20137059/docs_service_history-1774717820344.jpg?ixlib=js-3.8.0&auto=format&s=25470ab3af12c15c9fd1843f39d741d5 not downloaded yet
2026-03-29 20:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4c9a5ca-3ae7-5354-9fd2-1f3579157d97 with identifier: 19998396
2026-03-29 20:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97 with scrape type 1
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8396%252F19998396%252Fexterior_front_driver-1774520692193.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_front_driver-1774520692193.jpg not downloaded yet
2026-03-29 20:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7aa56651-1db2-5dc0-80a5-d141f627d833 with identifier: 3629062
2026-03-29 20:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aa56651-1db2-5dc0-80a5-d141f627d833 with scrape type 1
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7aa56651-1db2-5dc0-80a5-d141f627d833
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9062%252F3629062%252Fexterior_front_driver-1774699791411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_front_driver-1774699791411.jpg not downloaded yet
2026-03-29 20:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3b83795-b8da-52c5-adfd-45cceb547866 with identifier: 20486965
2026-03-29 20:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3b83795-b8da-52c5-adfd-45cceb547866 with scrape type 1
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3b83795-b8da-52c5-adfd-45cceb547866
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6965%252F20486965%252Fexterior_front_driver-1774699586318.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_front_driver-1774699586318.jpg not downloaded yet
2026-03-29 20:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df728baa-87aa-5136-9b8a-0d8359291447 with identifier: 12187861
2026-03-29 20:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df728baa-87aa-5136-9b8a-0d8359291447 with scrape type 1
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df728baa-87aa-5136-9b8a-0d8359291447
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7861%252F12187861%252Fexterior_front_driver-1772552479409.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7861/12187861/exterior_front_driver-1772552479409.jpg already downloaded
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7861%252F12187861%252Fexterior_rear_driver-1772552493713.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7861/12187861/exterior_rear_driver-1772552493713.jpg already downloaded
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7861%252F12187861%252Fexterior_front_passenger-1772552524309.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7861/12187861/exterior_front_passenger-1772552524309.jpg already downloaded
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7861%252F12187861%252Fexterior_rear_passenger-1772552502060.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7861/12187861/exterior_rear_passenger-1772552502060.jpg already downloaded
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7861%252F12187861%252Finterior_front_seats-1772620831474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7861/12187861/interior_front_seats-1772620831474.jpg already downloaded
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7861%252F12187861%252Finterior_rear_seats-1772552757065.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7861/12187861/interior_rear_seats-1772552757065.jpg already downloaded
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7861%252F12187861%252Finterior_dashboard-1772552784636.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7861/12187861/interior_dashboard-1772552784636.jpg already downloaded
2026-03-29 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7861%252F12187861%252Finstrument_cluster-1772552860718.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7861/12187861/instrument_cluster-1772552860718.jpg already downloaded
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7861%252F12187861%252Finterior_boot-1772552797184.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7861/12187861/interior_boot-1772552797184.jpg already downloaded
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F7861%252F12187861%252Fdocs_service_history-1772618547263.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0f7d8cffd319c56c717d35c94bc006ca%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/7861/12187861/docs_service_history-1772618547263.jpg?ixlib=js-3.8.0&auto=format&s=0f7d8cffd319c56c717d35c94bc006ca already downloaded
2026-03-29 20:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: df728baa-87aa-5136-9b8a-0d8359291447, identifier: 12187861
2026-03-29 20:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe22ee59-cdcc-56d4-b29a-37052b6c1ce3 with identifier: 20436997
2026-03-29 20:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3 with scrape type 1
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6997%252F20436997%252Fexterior_front_driver-1774692607004.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6997/20436997/exterior_front_driver-1774692607004.jpg not downloaded yet
2026-03-29 20:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: df728baa-87aa-5136-9b8a-0d8359291447 with identifier: 12187861
2026-03-29 20:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: df728baa-87aa-5136-9b8a-0d8359291447 with identifier: 12187861
2026-03-29 20:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: df728baa-87aa-5136-9b8a-0d8359291447 with identifier: 12187861 to the API
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12187861.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'df728baa-87aa-5136-9b8a-0d8359291447',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FY22 UCX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/12187861',
'listing': 'auction',
'location': 'Surrey West Byfleet',
'make': 'Audi',
'model': 'A5',
'odometer': 60100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/7861/12187861/exterior_front_driver-1772552479409.jpg',
'https://motorway-photos-redacted.imgix.net/7861/12187861/exterior_rear_driver-1772552493713.jpg',
'https://motorway-photos-redacted.imgix.net/7861/12187861/exterior_front_passenger-1772552524309.jpg',
'https://motorway-photos-redacted.imgix.net/7861/12187861/exterior_rear_passenger-1772552502060.jpg',
'https://motorway-photos-modified.imgix.net/7861/12187861/interior_front_seats-1772620831474.jpg',
'https://motorway-photos.imgix.net/7861/12187861/interior_rear_seats-1772552757065.jpg',
'https://motorway-photos-redacted.imgix.net/7861/12187861/interior_dashboard-1772552784636.jpg',
'https://motorway-photos-redacted.imgix.net/7861/12187861/instrument_cluster-1772552860718.jpg',
'https://motorway-photos.imgix.net/7861/12187861/interior_boot-1772552797184.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/7861/12187861/docs_service_history-1772618547263.jpg?ixlib=js-3.8.0&auto=format&s=0f7d8cffd319c56c717d35c94bc006ca'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ad6414b-90d5-53ac-9b56-f002366e76f8/6ad6414b-90d5-53ac-9b56-f002366e76f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1581737,
'Height': 2381,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7861/12187861/exterior_front_driver-1772552479409.jpg',
'Width': 3174},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ad6414b-90d5-53ac-9b56-f002366e76f8/6ad6414b-90d5-53ac-9b56-f002366e76f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1742087,
'Height': 2540,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7861/12187861/exterior_rear_driver-1772552493713.jpg',
'Width': 3386},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ad6414b-90d5-53ac-9b56-f002366e76f8/6ad6414b-90d5-53ac-9b56-f002366e76f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1542348,
'Height': 2430,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7861/12187861/exterior_front_passenger-1772552524309.jpg',
'Width': 3240},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ad6414b-90d5-53ac-9b56-f002366e76f8/6ad6414b-90d5-53ac-9b56-f002366e76f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1550153,
'Height': 2523,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7861/12187861/exterior_rear_passenger-1772552502060.jpg',
'Width': 3364},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ad6414b-90d5-53ac-9b56-f002366e76f8/6ad6414b-90d5-53ac-9b56-f002366e76f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1678037,
'Height': 2419,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7861/12187861/interior_front_seats-1772620831474.jpg',
'Width': 3226},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ad6414b-90d5-53ac-9b56-f002366e76f8/6ad6414b-90d5-53ac-9b56-f002366e76f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3928840,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7861/12187861/interior_rear_seats-1772552757065.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ad6414b-90d5-53ac-9b56-f002366e76f8/6ad6414b-90d5-53ac-9b56-f002366e76f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3718438,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7861/12187861/interior_dashboard-1772552784636.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ad6414b-90d5-53ac-9b56-f002366e76f8/6ad6414b-90d5-53ac-9b56-f002366e76f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2557193,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7861/12187861/instrument_cluster-1772552860718.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ad6414b-90d5-53ac-9b56-f002366e76f8/6ad6414b-90d5-53ac-9b56-f002366e76f8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3895934,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7861/12187861/interior_boot-1772552797184.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ad6414b-90d5-53ac-9b56-f002366e76f8/6ad6414b-90d5-53ac-9b56-f002366e76f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292965,
'Height': 1632,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/7861/12187861/docs_service_history-1772618547263.jpg?ixlib=js-3.8.0&auto=format&s=0f7d8cffd319c56c717d35c94bc006ca',
'Width': 1179}],
'price': 21792,
'price_includes_vat': False,
'registration_date': '2022-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Audi A5 S Line 40 TFSI MHEV S-A',
'transmission': 'automatic',
'trim': 'S Line 40 TFSI MHEV S-A',
'vin': 'WAUZZZF56NN004274',
'year': 2022}
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712187861%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [motorway.uk] INFO: Saving data for 12187861: {'created_time': 1774814499.559369, 'last_price_update_time': 1774814499.559379, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='12187861') HTTP/1.1" 204 0
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8396%252F19998396%252Fexterior_rear_driver-1774520686090.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_rear_driver-1774520686090.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9062%252F3629062%252Fexterior_rear_driver-1774699786092.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_rear_driver-1774699786092.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6965%252F20486965%252Fexterior_rear_driver-1774699501519.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_rear_driver-1774699501519.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6997%252F20436997%252Fexterior_rear_driver-1774692628724.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6997/20436997/exterior_rear_driver-1774692628724.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8396%252F19998396%252Fexterior_front_passenger-1774520703417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_front_passenger-1774520703417.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9062%252F3629062%252Fexterior_front_passenger-1774699788675.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_front_passenger-1774699788675.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6965%252F20486965%252Fexterior_front_passenger-1774699541278.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_front_passenger-1774699541278.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6997%252F20436997%252Fexterior_front_passenger-1774695715920.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6997/20436997/exterior_front_passenger-1774695715920.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8396%252F19998396%252Fexterior_rear_passenger-1774520696521.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_rear_passenger-1774520696521.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9062%252F3629062%252Fexterior_rear_passenger-1774699792682.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_rear_passenger-1774699792682.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6965%252F20486965%252Fexterior_rear_passenger-1774699505758.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_rear_passenger-1774699505758.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6997%252F20436997%252Fexterior_rear_passenger-1774692638902.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6997/20436997/exterior_rear_passenger-1774692638902.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8396%252F19998396%252Finterior_front_seats-1774521807768.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8396/19998396/interior_front_seats-1774521807768.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9062%252F3629062%252Finterior_front_seats-1774700093092.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9062/3629062/interior_front_seats-1774700093092.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6965%252F20486965%252Finterior_front_seats-1774700730875.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6965/20486965/interior_front_seats-1774700730875.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6997%252F20436997%252Finterior_front_seats-1774693863285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6997/20436997/interior_front_seats-1774693863285.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8396%252F19998396%252Finterior_rear_seats-1774521553541.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8396/19998396/interior_rear_seats-1774521553541.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9062%252F3629062%252Finterior_rear_seats-1774700094119.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9062/3629062/interior_rear_seats-1774700094119.jpg not downloaded yet
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6965%252F20486965%252Finterior_rear_seats-1774700736846.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6965/20486965/interior_rear_seats-1774700736846.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6997%252F20436997%252Finterior_rear_seats-1774693809527.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6997/20436997/interior_rear_seats-1774693809527.jpg not downloaded yet
2026-03-29 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486036.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8396%252F19998396%252Finterior_dashboard-1774702623830.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8396/19998396/interior_dashboard-1774702623830.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9062%252F3629062%252Finterior_dashboard-1774700106221.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9062/3629062/interior_dashboard-1774700106221.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6965%252F20486965%252Finterior_dashboard-1774700750778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6965/20486965/interior_dashboard-1774700750778.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6997%252F20436997%252Finterior_dashboard-1774693833763.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6997/20436997/interior_dashboard-1774693833763.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8396%252F19998396%252Finstrument_cluster-1774521481443.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8396/19998396/instrument_cluster-1774521481443.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9062%252F3629062%252Finstrument_cluster-1774700159675.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9062/3629062/instrument_cluster-1774700159675.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6965%252F20486965%252Finstrument_cluster-1774700442346.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6965/20486965/instrument_cluster-1774700442346.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6997%252F20436997%252Finstrument_cluster-1774693625010.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6997/20436997/instrument_cluster-1774693625010.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8396%252F19998396%252Finterior_boot-1774521547690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8396/19998396/interior_boot-1774521547690.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9062%252F3629062%252Finterior_boot-1774700095680.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9062/3629062/interior_boot-1774700095680.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6965%252F20486965%252Finterior_boot-1774700734508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6965/20486965/interior_boot-1774700734508.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6997%252F20436997%252Finterior_boot-1774693841991.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6997/20436997/interior_boot-1774693841991.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8396%252F19998396%252Fdocs_service_history-1774698670475-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daabaf9b8f3771385ff7a9de9bb185a7a%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8396/19998396/docs_service_history-1774698670475-1.jpeg?ixlib=js-3.8.0&auto=format&s=aabaf9b8f3771385ff7a9de9bb185a7a not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9062%252F3629062%252Fdocs_service_history-1774700186147.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9e5b8738aabdf69279203033b3b0e702%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9062/3629062/docs_service_history-1774700186147.jpg?ixlib=js-3.8.0&auto=format&s=9e5b8738aabdf69279203033b3b0e702 not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6965%252F20486965%252Fdocs_service_history-1774701072986.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcf52a40006daa4b1ffcbeaf95fdc306e%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6965/20486965/docs_service_history-1774701072986.jpg?ixlib=js-3.8.0&auto=format&s=cf52a40006daa4b1ffcbeaf95fdc306e not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6997%252F20436997%252Fdocs_service_history-1774694956218.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9cdcd83f1b4b63010bf33958f9b6ef97%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6997/20436997/docs_service_history-1774694956218.jpg?ixlib=js-3.8.0&auto=format&s=9cdcd83f1b4b63010bf33958f9b6ef97 not downloaded yet
2026-03-29 20:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f599d6fb-f69c-5556-b070-53fd1431d62c with identifier: 20486036
2026-03-29 20:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f599d6fb-f69c-5556-b070-53fd1431d62c with scrape type 1
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f599d6fb-f69c-5556-b070-53fd1431d62c
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6036%252F20486036%252Fexterior_front_driver-1774698780689.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_front_driver-1774698780689.jpg not downloaded yet
2026-03-29 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_front_driver-1774712962960.jpg> (referer: None)
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6036%252F20486036%252Fexterior_rear_driver-1774698772895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_rear_driver-1774698772895.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6036%252F20486036%252Fexterior_front_passenger-1774698779593.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_front_passenger-1774698779593.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6036%252F20486036%252Fexterior_rear_passenger-1774698777794.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_rear_passenger-1774698777794.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6036%252F20486036%252Finterior_front_seats-1774700186928.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6036/20486036/interior_front_seats-1774700186928.jpg not downloaded yet
2026-03-29 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_rear_passenger-1774712994279.jpg> (referer: None)
2026-03-29 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7059/20137059/instrument_cluster-1774717707190.jpg> (referer: None)
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6036%252F20486036%252Finterior_rear_seats-1774700337910.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6036/20486036/interior_rear_seats-1774700337910.jpg not downloaded yet
2026-03-29 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_front_passenger-1774713008419.jpg> (referer: None)
2026-03-29 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_rear_driver-1774713031314.jpg> (referer: None)
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6036%252F20486036%252Finterior_dashboard-1774699911544.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6036/20486036/interior_dashboard-1774699911544.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6036%252F20486036%252Finstrument_cluster-1774699536891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6036/20486036/instrument_cluster-1774699536891.jpg not downloaded yet
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6036%252F20486036%252Finterior_boot-1774699787587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6036/20486036/interior_boot-1774699787587.jpg not downloaded yet
2026-03-29 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7059/20137059/interior_dashboard-1774716981439.jpg> (referer: None)
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90bb910>
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7059%252F20137059%252Fexterior_front_driver-1774712962960.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_front_driver-1774712962960.jpg saved to cache
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d830cab0-5036-5e8d-801f-771efc6489ca
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6036%252F20486036%252Fdocs_service_history-1774700364260.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd54f53abcd5b692cf2d43ca2c6ce110f%27 HTTP/1.1" 200 None
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6036/20486036/docs_service_history-1774700364260.jpg?ixlib=js-3.8.0&auto=format&s=d54f53abcd5b692cf2d43ca2c6ce110f not downloaded yet
2026-03-29 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7059/20137059/interior_front_seats-1774713361641.jpg> (referer: None)
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8976d10>
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7059%252F20137059%252Fexterior_rear_passenger-1774712994279.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_rear_passenger-1774712994279.jpg saved to cache
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d830cab0-5036-5e8d-801f-771efc6489ca
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c82e90>
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7059%252F20137059%252Finstrument_cluster-1774717707190.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7059/20137059/instrument_cluster-1774717707190.jpg saved to cache
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d830cab0-5036-5e8d-801f-771efc6489ca
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9150090>
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7059%252F20137059%252Fexterior_front_passenger-1774713008419.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_front_passenger-1774713008419.jpg saved to cache
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d830cab0-5036-5e8d-801f-771efc6489ca
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c03510>
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7059%252F20137059%252Fexterior_rear_driver-1774713031314.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_rear_driver-1774713031314.jpg saved to cache
2026-03-29 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d830cab0-5036-5e8d-801f-771efc6489ca
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabd97d0>
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7059%252F20137059%252Finterior_dashboard-1774716981439.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7059/20137059/interior_dashboard-1774716981439.jpg saved to cache
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d830cab0-5036-5e8d-801f-771efc6489ca
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0182d0>
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7059%252F20137059%252Finterior_front_seats-1774713361641.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7059/20137059/interior_front_seats-1774713361641.jpg saved to cache
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d830cab0-5036-5e8d-801f-771efc6489ca
2026-03-29 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7059/20137059/interior_rear_seats-1774715985658.jpg> (referer: None)
2026-03-29 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_front_driver-1774698780689.jpg> (referer: None)
2026-03-29 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6997/20436997/interior_rear_seats-1774693809527.jpg> (referer: None)
2026-03-29 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_rear_passenger-1774698777794.jpg> (referer: None)
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c802d0>
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7059%252F20137059%252Finterior_rear_seats-1774715985658.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7059/20137059/interior_rear_seats-1774715985658.jpg saved to cache
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d830cab0-5036-5e8d-801f-771efc6489ca
2026-03-29 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20471425.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=324&page=9&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c811d0>
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6036%252F20486036%252Fexterior_front_driver-1774698780689.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_front_driver-1774698780689.jpg saved to cache
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f599d6fb-f69c-5556-b070-53fd1431d62c
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae196d0>
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6997%252F20436997%252Finterior_rear_seats-1774693809527.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6997/20436997/interior_rear_seats-1774693809527.jpg saved to cache
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c00610>
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6036%252F20486036%252Fexterior_rear_passenger-1774698777794.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_rear_passenger-1774698777794.jpg saved to cache
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f599d6fb-f69c-5556-b070-53fd1431d62c
2026-03-29 20:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5193134d-3233-5069-ba9a-bf1201dfda7a with identifier: 20471425
2026-03-29 20:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5193134d-3233-5069-ba9a-bf1201dfda7a with scrape type 1
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5193134d-3233-5069-ba9a-bf1201dfda7a
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1425%252F20471425%252Fexterior_front_driver-1774713576469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_front_driver-1774713576469.jpg not downloaded yet
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20418717
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20488067
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20395274
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20486896
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486896%27 HTTP/1.1" 200 None
2026-03-29 20:01:41 [motorway.uk] INFO: Scrape type for 20486896: 1
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1425%252F20471425%252Fexterior_rear_driver-1774713574893.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_rear_driver-1774713574893.jpg not downloaded yet
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20440824
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20375069
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20346137
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720346137%27 HTTP/1.1" 200 None
2026-03-29 20:01:41 [motorway.uk] INFO: Scrape type for 20346137: 1
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1425%252F20471425%252Fexterior_front_passenger-1774713579558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_front_passenger-1774713579558.jpg not downloaded yet
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 18144090
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20494274
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720494274%27 HTTP/1.1" 200 None
2026-03-29 20:01:41 [motorway.uk] INFO: Scrape type for 20494274: 1
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1425%252F20471425%252Fexterior_rear_passenger-1774713580974.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_rear_passenger-1774713580974.jpg not downloaded yet
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 17611268
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20483899
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20483826
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20469913
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20459015
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20471501
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 16772824
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20121550
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 17470157
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717470157%27 HTTP/1.1" 200 None
2026-03-29 20:01:41 [motorway.uk] INFO: Scrape type for 17470157: 0
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 19824525
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20370017
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20382041
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20428604
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20185351
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 14545909
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20188633
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 17103119
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 19976195
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719976195%27 HTTP/1.1" 200 None
2026-03-29 20:01:41 [motorway.uk] INFO: Scrape type for 19976195: 0
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20476001
2026-03-29 20:01:41 [motorway.uk] INFO: Found listing with ID: 20489379
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489379%27 HTTP/1.1" 200 None
2026-03-29 20:01:41 [motorway.uk] INFO: Scrape type for 20489379: 1
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1425%252F20471425%252Finterior_front_seats-1774714005118.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1425/20471425/interior_front_seats-1774714005118.jpg not downloaded yet
2026-03-29 20:01:42 [motorway.uk] INFO: Found listing with ID: 14248545
2026-03-29 20:01:42 [motorway.uk] INFO: Found listing with ID: 20489087
2026-03-29 20:01:42 [motorway.uk] INFO: Found listing with ID: 9706336
2026-03-29 20:01:42 [motorway.uk] INFO: Found listing with ID: 20235497
2026-03-29 20:01:42 [motorway.uk] INFO: Found listing with ID: 19465246
2026-03-29 20:01:42 [motorway.uk] INFO: Found listing with ID: 20474206
2026-03-29 20:01:42 [motorway.uk] INFO: Found listing with ID: 17699246
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717699246%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [motorway.uk] INFO: Scrape type for 17699246: 1
2026-03-29 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20496326.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1425%252F20471425%252Finterior_rear_seats-1774714011058.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1425/20471425/interior_rear_seats-1774714011058.jpg not downloaded yet
2026-03-29 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19679688.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1425%252F20471425%252Finterior_dashboard-1774714717356.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1425/20471425/interior_dashboard-1774714717356.jpg not downloaded yet
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1425%252F20471425%252Finstrument_cluster-1774714046839.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1425/20471425/instrument_cluster-1774714046839.jpg not downloaded yet
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1425%252F20471425%252Finterior_boot-1774714001664.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1425/20471425/interior_boot-1774714001664.jpg not downloaded yet
2026-03-29 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6036/20486036/docs_service_history-1774700364260.jpg?ixlib=js-3.8.0&auto=format&s=d54f53abcd5b692cf2d43ca2c6ce110f> (referer: None)
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1425%252F20471425%252Fdocs_service_history-1774714176720.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D526847649502adfaae7c8a54b63eeaa5%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1425/20471425/docs_service_history-1774714176720.jpg?ixlib=js-3.8.0&auto=format&s=526847649502adfaae7c8a54b63eeaa5 not downloaded yet
2026-03-29 20:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfea1c92-e899-52d4-baee-d6d9130fc43d with identifier: 20496326
2026-03-29 20:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfea1c92-e899-52d4-baee-d6d9130fc43d with scrape type 1
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dfea1c92-e899-52d4-baee-d6d9130fc43d
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6326%252F20496326%252Fexterior_front_driver-1774778588098.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_front_driver-1774778588098.jpg not downloaded yet
2026-03-29 20:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04f3b57f-cd71-560c-a98a-4d8b1b16afb6 with identifier: 19679688
2026-03-29 20:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6 with scrape type 1
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9688%252F19679688%252Fexterior_front_driver-1774547598196.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_front_driver-1774547598196.jpg not downloaded yet
2026-03-29 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6997/20436997/docs_service_history-1774694956218.jpg?ixlib=js-3.8.0&auto=format&s=9cdcd83f1b4b63010bf33958f9b6ef97> (referer: None)
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6326%252F20496326%252Fexterior_rear_driver-1774778637410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_rear_driver-1774778637410.jpg not downloaded yet
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9688%252F19679688%252Fexterior_rear_driver-1774547613407.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_rear_driver-1774547613407.jpg not downloaded yet
2026-03-29 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6036/20486036/interior_boot-1774699787587.jpg> (referer: None)
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6326%252F20496326%252Fexterior_front_passenger-1774778645943.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_front_passenger-1774778645943.jpg not downloaded yet
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9688%252F19679688%252Fexterior_front_passenger-1774547631504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_front_passenger-1774547631504.jpg not downloaded yet
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8645910>
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6036%252F20486036%252Fdocs_service_history-1774700364260.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd54f53abcd5b692cf2d43ca2c6ce110f') HTTP/1.1" 204 0
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6036/20486036/docs_service_history-1774700364260.jpg?ixlib=js-3.8.0&auto=format&s=d54f53abcd5b692cf2d43ca2c6ce110f saved to cache
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f599d6fb-f69c-5556-b070-53fd1431d62c
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6326%252F20496326%252Fexterior_rear_passenger-1774778631626.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_rear_passenger-1774778631626.jpg not downloaded yet
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9688%252F19679688%252Fexterior_rear_passenger-1774544799472.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_rear_passenger-1774544799472.jpg not downloaded yet
2026-03-29 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6036/20486036/interior_dashboard-1774699911544.jpg> (referer: None)
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6326%252F20496326%252Finterior_front_seats-1774779672994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6326/20496326/interior_front_seats-1774779672994.jpg not downloaded yet
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9688%252F19679688%252Finterior_front_seats-1774545521830.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9688/19679688/interior_front_seats-1774545521830.jpg not downloaded yet
2026-03-29 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19940066.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6326%252F20496326%252Finterior_rear_seats-1774779626016.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6326/20496326/interior_rear_seats-1774779626016.jpg not downloaded yet
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9688%252F19679688%252Finterior_rear_seats-1774545411562.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9688/19679688/interior_rear_seats-1774545411562.jpg not downloaded yet
2026-03-29 20:01:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a6ae90>
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6997%252F20436997%252Fdocs_service_history-1774694956218.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9cdcd83f1b4b63010bf33958f9b6ef97') HTTP/1.1" 204 0
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6997/20436997/docs_service_history-1774694956218.jpg?ixlib=js-3.8.0&auto=format&s=9cdcd83f1b4b63010bf33958f9b6ef97 saved to cache
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9586dd0>
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6036%252F20486036%252Finterior_boot-1774699787587.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6036/20486036/interior_boot-1774699787587.jpg saved to cache
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f599d6fb-f69c-5556-b070-53fd1431d62c
2026-03-29 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6036/20486036/interior_rear_seats-1774700337910.jpg> (referer: None)
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6326%252F20496326%252Finterior_dashboard-1774781228123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6326/20496326/interior_dashboard-1774781228123.jpg not downloaded yet
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9688%252F19679688%252Finterior_dashboard-1774545442997.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9688/19679688/interior_dashboard-1774545442997.jpg not downloaded yet
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6326%252F20496326%252Finterior_boot-1774781241196.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6326/20496326/interior_boot-1774781241196.jpg not downloaded yet
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9688%252F19679688%252Finterior_boot-1774545480780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9688/19679688/interior_boot-1774545480780.jpg not downloaded yet
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadedcd0>
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6036%252F20486036%252Finterior_dashboard-1774699911544.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6036/20486036/interior_dashboard-1774699911544.jpg saved to cache
2026-03-29 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f599d6fb-f69c-5556-b070-53fd1431d62c
2026-03-29 20:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc6e4021-948a-5fef-828e-3fdfd880a945 with identifier: 19940066
2026-03-29 20:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc6e4021-948a-5fef-828e-3fdfd880a945 with scrape type 1
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc6e4021-948a-5fef-828e-3fdfd880a945
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Fexterior_front_driver-1774719061633.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_front_driver-1774719061633.jpg not downloaded yet
2026-03-29 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9062/3629062/docs_service_history-1774700186147.jpg?ixlib=js-3.8.0&auto=format&s=9e5b8738aabdf69279203033b3b0e702> (referer: None)
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6326%252F20496326%252Fdamage_dents-1774778736701.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6326/20496326/damage_dents-1774778736701.jpg not downloaded yet
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9688%252F19679688%252Fdamage_scratches-1774628568666.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9688/19679688/damage_scratches-1774628568666.jpg not downloaded yet
2026-03-29 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6036/20486036/interior_front_seats-1774700186928.jpg> (referer: None)
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Fexterior_rear_driver-1774719080495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_rear_driver-1774719080495.jpg not downloaded yet
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6326%252F20496326%252Fwheels_front_driver-1774778770031.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6326/20496326/wheels_front_driver-1774778770031.jpg not downloaded yet
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9688%252F19679688%252Fdamage_scratches-1774544959696.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9688/19679688/damage_scratches-1774544959696.jpg not downloaded yet
2026-03-29 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6965/20486965/docs_service_history-1774701072986.jpg?ixlib=js-3.8.0&auto=format&s=cf52a40006daa4b1ffcbeaf95fdc306e> (referer: None)
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Fexterior_front_passenger-1774719107676.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_front_passenger-1774719107676.jpg not downloaded yet
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9584750>
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6036%252F20486036%252Finterior_rear_seats-1774700337910.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6036/20486036/interior_rear_seats-1774700337910.jpg saved to cache
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f599d6fb-f69c-5556-b070-53fd1431d62c
2026-03-29 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6036/20486036/instrument_cluster-1774699536891.jpg> (referer: None)
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Fexterior_rear_passenger-1774719093591.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_rear_passenger-1774719093591.jpg not downloaded yet
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac1f390>
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9062%252F3629062%252Fdocs_service_history-1774700186147.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9e5b8738aabdf69279203033b3b0e702') HTTP/1.1" 204 0
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9062/3629062/docs_service_history-1774700186147.jpg?ixlib=js-3.8.0&auto=format&s=9e5b8738aabdf69279203033b3b0e702 saved to cache
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7aa56651-1db2-5dc0-80a5-d141f627d833
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0066%252F19940066%252Finterior_front_seats-1774719642375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0066/19940066/interior_front_seats-1774719642375.jpg not downloaded yet
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0066%252F19940066%252Finterior_rear_seats-1774719574342.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0066/19940066/interior_rear_seats-1774719574342.jpg not downloaded yet
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87012ce350>
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6036%252F20486036%252Finterior_front_seats-1774700186928.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6036/20486036/interior_front_seats-1774700186928.jpg saved to cache
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f599d6fb-f69c-5556-b070-53fd1431d62c
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9315910>
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6965%252F20486965%252Fdocs_service_history-1774701072986.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcf52a40006daa4b1ffcbeaf95fdc306e') HTTP/1.1" 204 0
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6965/20486965/docs_service_history-1774701072986.jpg?ixlib=js-3.8.0&auto=format&s=cf52a40006daa4b1ffcbeaf95fdc306e saved to cache
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3b83795-b8da-52c5-adfd-45cceb547866
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96d7a90>
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6036%252F20486036%252Finstrument_cluster-1774699536891.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6036/20486036/instrument_cluster-1774699536891.jpg saved to cache
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f599d6fb-f69c-5556-b070-53fd1431d62c
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Finterior_dashboard-1774719598090.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/interior_dashboard-1774719598090.jpg not downloaded yet
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Finstrument_cluster-1774719672277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/instrument_cluster-1774719672277.jpg not downloaded yet
2026-03-29 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_front_passenger-1774698779593.jpg> (referer: None)
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0066%252F19940066%252Finterior_boot-1774719608378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0066/19940066/interior_boot-1774719608378.jpg not downloaded yet
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Fwheels_front_driver-1774719146441.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/wheels_front_driver-1774719146441.jpg not downloaded yet
2026-03-29 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_rear_driver-1774698772895.jpg> (referer: None)
2026-03-29 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_front_driver-1774547598196.jpg> (referer: None)
2026-03-29 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1425/20471425/interior_front_seats-1774714005118.jpg> (referer: None)
2026-03-29 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1425/20471425/interior_boot-1774714001664.jpg> (referer: None)
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9602890>
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6036%252F20486036%252Fexterior_front_passenger-1774698779593.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_front_passenger-1774698779593.jpg saved to cache
2026-03-29 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f599d6fb-f69c-5556-b070-53fd1431d62c
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90d61d0>
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6036%252F20486036%252Fexterior_rear_driver-1774698772895.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_rear_driver-1774698772895.jpg saved to cache
2026-03-29 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f599d6fb-f69c-5556-b070-53fd1431d62c
2026-03-29 20:01:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f599d6fb-f69c-5556-b070-53fd1431d62c, skipping ID generation
2026-03-29 20:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f599d6fb-f69c-5556-b070-53fd1431d62c with scrape type 1
2026-03-29 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f599d6fb-f69c-5556-b070-53fd1431d62c sending to next pipeline
2026-03-29 20:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f599d6fb-f69c-5556-b070-53fd1431d62c, identifier: 20486036
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d4b750>
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9688%252F19679688%252Fexterior_front_driver-1774547598196.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_front_driver-1774547598196.jpg saved to cache
2026-03-29 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90d6cd0>
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1425%252F20471425%252Finterior_front_seats-1774714005118.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1425/20471425/interior_front_seats-1774714005118.jpg saved to cache
2026-03-29 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5193134d-3233-5069-ba9a-bf1201dfda7a
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8636c10>
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1425%252F20471425%252Finterior_boot-1774714001664.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1425/20471425/interior_boot-1774714001664.jpg saved to cache
2026-03-29 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5193134d-3233-5069-ba9a-bf1201dfda7a
2026-03-29 20:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f599d6fb-f69c-5556-b070-53fd1431d62c with identifier: 20486036
2026-03-29 20:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f599d6fb-f69c-5556-b070-53fd1431d62c with identifier: 20486036
2026-03-29 20:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f599d6fb-f69c-5556-b070-53fd1431d62c with identifier: 20486036 to the API
2026-03-29 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_rear_driver-1774698772895.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f599d6fb-f69c-5556-b070-53fd1431d62c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR56 EBF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20486036',
'listing': 'auction',
'location': 'Hampshire Hindhead',
'make': 'Mercedes',
'model': 'SL Class',
'odometer': 60390,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2209832,
'Height': 2857,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_front_driver-1774698780689.jpg',
'Width': 3809},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2139173,
'Height': 2876,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_rear_driver-1774698772895.jpg',
'Width': 3835},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2088345,
'Height': 2859,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_front_passenger-1774698779593.jpg',
'Width': 3812},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1819338,
'Height': 2811,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6036/20486036/exterior_rear_passenger-1774698777794.jpg',
'Width': 3748},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3228774,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6036/20486036/interior_front_seats-1774700186928.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3045906,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6036/20486036/interior_rear_seats-1774700337910.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2034472,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6036/20486036/interior_dashboard-1774699911544.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3030895,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6036/20486036/instrument_cluster-1774699536891.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2430281,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6036/20486036/interior_boot-1774699787587.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f599d6fb-f69c-5556-b070-53fd1431d62c/f599d6fb-f69c-5556-b070-53fd1431d62c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1411762,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6036/20486036/docs_service_history-1774700364260.jpg?ixlib=js-3.8.0&auto=format&s=d54f53abcd5b692cf2d43ca2c6ce110f',
'Width': 3840}],
'price': 4361,
'price_includes_vat': False,
'registration_date': '2007-01-08',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes SL350 Auto',
'transmission': 'automatic',
'trim': 'SL350 Auto',
'vin': 'WDB2304562F127120',
'year': 2007}
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486036%27 HTTP/1.1" 200 None
2026-03-29 20:01:45 [motorway.uk] INFO: Saving data for 20486036: {'created_time': 1774814505.22112, 'last_price_update_time': 1774814505.221131, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20486036') HTTP/1.1" 204 0
2026-03-29 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_rear_passenger-1774719093591.jpg> (referer: None)
2026-03-29 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_front_passenger-1774719107676.jpg> (referer: None)
2026-03-29 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_rear_driver-1774719080495.jpg> (referer: None)
2026-03-29 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6326/20496326/wheels_front_driver-1774778770031.jpg> (referer: None)
2026-03-29 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9688/19679688/damage_scratches-1774544959696.jpg> (referer: None)
2026-03-29 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0066/19940066/interior_dashboard-1774719598090.jpg> (referer: None)
2026-03-29 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0066/19940066/interior_front_seats-1774719642375.jpg> (referer: None)
2026-03-29 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9688/19679688/damage_scratches-1774628568666.jpg> (referer: None)
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9316f50>
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Fexterior_rear_passenger-1774719093591.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_rear_passenger-1774719093591.jpg saved to cache
2026-03-29 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc6e4021-948a-5fef-828e-3fdfd880a945
2026-03-29 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17539370.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9185fd0>
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Fexterior_front_passenger-1774719107676.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_front_passenger-1774719107676.jpg saved to cache
2026-03-29 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc6e4021-948a-5fef-828e-3fdfd880a945
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1cf190>
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Fexterior_rear_driver-1774719080495.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_rear_driver-1774719080495.jpg saved to cache
2026-03-29 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc6e4021-948a-5fef-828e-3fdfd880a945
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa158150>
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6326%252F20496326%252Fwheels_front_driver-1774778770031.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6326/20496326/wheels_front_driver-1774778770031.jpg saved to cache
2026-03-29 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dfea1c92-e899-52d4-baee-d6d9130fc43d
2026-03-29 20:01:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae14c90>
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9688%252F19679688%252Fdamage_scratches-1774544959696.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9688/19679688/damage_scratches-1774544959696.jpg saved to cache
2026-03-29 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6
2026-03-29 20:01:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa15ac90>
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Finterior_dashboard-1774719598090.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/interior_dashboard-1774719598090.jpg saved to cache
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc6e4021-948a-5fef-828e-3fdfd880a945
2026-03-29 20:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94967d0>
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0066%252F19940066%252Finterior_front_seats-1774719642375.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0066/19940066/interior_front_seats-1774719642375.jpg saved to cache
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc6e4021-948a-5fef-828e-3fdfd880a945
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fdb250>
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9688%252F19679688%252Fdamage_scratches-1774628568666.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9688/19679688/damage_scratches-1774628568666.jpg saved to cache
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6
2026-03-29 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17699246.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f101a58b-a354-5d9d-a62b-bb96dde14db0 with identifier: 17539370
2026-03-29 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f101a58b-a354-5d9d-a62b-bb96dde14db0 with scrape type 1
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f101a58b-a354-5d9d-a62b-bb96dde14db0
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9370%252F17539370%252Fexterior_front_driver-1774610269984.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_front_driver-1774610269984.jpeg not downloaded yet
2026-03-29 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0066/19940066/interior_rear_seats-1774719574342.jpg> (referer: None)
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9370%252F17539370%252Fexterior_rear_driver-1774610263232.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_rear_driver-1774610263232.jpeg not downloaded yet
2026-03-29 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0066/19940066/wheels_front_driver-1774719146441.jpg> (referer: None)
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9370%252F17539370%252Fexterior_front_passenger-1774610236570.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_front_passenger-1774610236570.jpeg not downloaded yet
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9370%252F17539370%252Fexterior_rear_passenger-1774610222008.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_rear_passenger-1774610222008.jpeg not downloaded yet
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9370%252F17539370%252Finterior_front_seats-1774610952488.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9370/17539370/interior_front_seats-1774610952488.jpeg not downloaded yet
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9370%252F17539370%252Finterior_rear_seats-1774611163419.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9370/17539370/interior_rear_seats-1774611163419.jpeg not downloaded yet
2026-03-29 20:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 181a0d36-b518-516c-887c-063daa59908c with identifier: 17699246
2026-03-29 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 181a0d36-b518-516c-887c-063daa59908c with scrape type 1
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 181a0d36-b518-516c-887c-063daa59908c
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9246%252F17699246%252Fexterior_front_driver-1774690127510.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_front_driver-1774690127510.jpg not downloaded yet
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9370%252F17539370%252Finterior_dashboard-1774611203012.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9370/17539370/interior_dashboard-1774611203012.jpeg not downloaded yet
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9246%252F17699246%252Fexterior_rear_driver-1774690146159.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_rear_driver-1774690146159.jpg not downloaded yet
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9370%252F17539370%252Finstrument_cluster-1774611197037.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9370/17539370/instrument_cluster-1774611197037.jpeg not downloaded yet
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9246%252F17699246%252Fexterior_front_passenger-1774690173878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_front_passenger-1774690173878.jpg not downloaded yet
2026-03-29 20:01:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c15d10>
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0066%252F19940066%252Finterior_rear_seats-1774719574342.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0066/19940066/interior_rear_seats-1774719574342.jpg saved to cache
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc6e4021-948a-5fef-828e-3fdfd880a945
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa4d5d0>
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Fwheels_front_driver-1774719146441.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/wheels_front_driver-1774719146441.jpg saved to cache
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc6e4021-948a-5fef-828e-3fdfd880a945
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9370%252F17539370%252Finterior_boot-1774611187259.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9370/17539370/interior_boot-1774611187259.jpeg not downloaded yet
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9246%252F17699246%252Fexterior_rear_passenger-1774690163902.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_rear_passenger-1774690163902.jpg not downloaded yet
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9370%252F17539370%252Fdamage_missing_trims-1774611551774.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9370/17539370/damage_missing_trims-1774611551774.jpeg not downloaded yet
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9246%252F17699246%252Finterior_front_seats-1774690487788.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9246/17699246/interior_front_seats-1774690487788.jpg not downloaded yet
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_front_driver-1774719061633.jpg> (referer: None)
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9246%252F17699246%252Finterior_dashboard-1774695043894.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9246/17699246/interior_dashboard-1774695043894.jpg not downloaded yet
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9246%252F17699246%252Finstrument_cluster-1774690728491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9246/17699246/instrument_cluster-1774690728491.jpg not downloaded yet
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9246%252F17699246%252Finterior_boot-1774695267807.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9246/17699246/interior_boot-1774695267807.jpg not downloaded yet
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9246%252F17699246%252Fdocs_service_history-1774692626406.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc5fcb3f09bb8addc7247ccbf590e3cb6%27 HTTP/1.1" 200 None
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9246/17699246/docs_service_history-1774692626406.jpg?ixlib=js-3.8.0&auto=format&s=c5fcb3f09bb8addc7247ccbf590e3cb6 not downloaded yet
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6326/20496326/interior_boot-1774781241196.jpg> (referer: None)
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9246%252F17699246%252Fdocs_service_history-1774692642468.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8cc16b2da85142b9b19b9c9adacb0ef2%27 HTTP/1.1" 200 None
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9246/17699246/docs_service_history-1774692642468.jpg?ixlib=js-3.8.0&auto=format&s=8cc16b2da85142b9b19b9c9adacb0ef2 not downloaded yet
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9688/19679688/interior_dashboard-1774545442997.jpg> (referer: None)
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa003290>
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Fexterior_front_driver-1774719061633.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_front_driver-1774719061633.jpg saved to cache
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc6e4021-948a-5fef-828e-3fdfd880a945
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9618350>
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6326%252F20496326%252Finterior_boot-1774781241196.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6326/20496326/interior_boot-1774781241196.jpg saved to cache
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dfea1c92-e899-52d4-baee-d6d9130fc43d
2026-03-29 20:01:47 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (10763239) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9370/17539370/interior_boot-1774611187259.jpeg>.
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae9aa90>
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9688%252F19679688%252Finterior_dashboard-1774545442997.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9688/19679688/interior_dashboard-1774545442997.jpg saved to cache
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_rear_passenger-1774544799472.jpg> (referer: None)
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6326/20496326/interior_dashboard-1774781228123.jpg> (referer: None)
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0066/19940066/instrument_cluster-1774719672277.jpg> (referer: None)
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0066/19940066/interior_boot-1774719608378.jpg> (referer: None)
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6326/20496326/interior_rear_seats-1774779626016.jpg> (referer: None)
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9246/17699246/docs_service_history-1774692626406.jpg?ixlib=js-3.8.0&auto=format&s=c5fcb3f09bb8addc7247ccbf590e3cb6> (referer: None)
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9688/19679688/interior_boot-1774545480780.jpg> (referer: None)
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6326/20496326/damage_dents-1774778736701.jpg> (referer: None)
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9688/19679688/interior_front_seats-1774545521830.jpg> (referer: None)
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9688/19679688/interior_rear_seats-1774545411562.jpg> (referer: None)
2026-03-29 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6326/20496326/interior_front_seats-1774779672994.jpg> (referer: None)
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabebad0>
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9688%252F19679688%252Fexterior_rear_passenger-1774544799472.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_rear_passenger-1774544799472.jpg saved to cache
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa003150>
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6326%252F20496326%252Finterior_dashboard-1774781228123.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6326/20496326/interior_dashboard-1774781228123.jpg saved to cache
2026-03-29 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfea1c92-e899-52d4-baee-d6d9130fc43d
2026-03-29 20:01:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac90890>
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0066%252F19940066%252Finstrument_cluster-1774719672277.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0066/19940066/instrument_cluster-1774719672277.jpg saved to cache
2026-03-29 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc6e4021-948a-5fef-828e-3fdfd880a945
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa07d910>
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0066%252F19940066%252Finterior_boot-1774719608378.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0066/19940066/interior_boot-1774719608378.jpg saved to cache
2026-03-29 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc6e4021-948a-5fef-828e-3fdfd880a945
2026-03-29 20:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc6e4021-948a-5fef-828e-3fdfd880a945, skipping ID generation
2026-03-29 20:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc6e4021-948a-5fef-828e-3fdfd880a945 with scrape type 1
2026-03-29 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc6e4021-948a-5fef-828e-3fdfd880a945 sending to next pipeline
2026-03-29 20:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cc6e4021-948a-5fef-828e-3fdfd880a945, identifier: 19940066
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9114f10>
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6326%252F20496326%252Finterior_rear_seats-1774779626016.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6326/20496326/interior_rear_seats-1774779626016.jpg saved to cache
2026-03-29 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfea1c92-e899-52d4-baee-d6d9130fc43d
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa07e550>
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9246%252F17699246%252Fdocs_service_history-1774692626406.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc5fcb3f09bb8addc7247ccbf590e3cb6') HTTP/1.1" 204 0
2026-03-29 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9246/17699246/docs_service_history-1774692626406.jpg?ixlib=js-3.8.0&auto=format&s=c5fcb3f09bb8addc7247ccbf590e3cb6 saved to cache
2026-03-29 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 181a0d36-b518-516c-887c-063daa59908c
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f961b510>
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9688%252F19679688%252Finterior_boot-1774545480780.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9688/19679688/interior_boot-1774545480780.jpg saved to cache
2026-03-29 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac93750>
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6326%252F20496326%252Fdamage_dents-1774778736701.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6326/20496326/damage_dents-1774778736701.jpg saved to cache
2026-03-29 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dfea1c92-e899-52d4-baee-d6d9130fc43d
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f963fc90>
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9688%252F19679688%252Finterior_front_seats-1774545521830.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9688/19679688/interior_front_seats-1774545521830.jpg saved to cache
2026-03-29 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6
2026-03-29 20:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f912f550>
2026-03-29 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9688%252F19679688%252Finterior_rear_seats-1774545411562.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9688/19679688/interior_rear_seats-1774545411562.jpg saved to cache
2026-03-29 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6
2026-03-29 20:01:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9262c90>
2026-03-29 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6326%252F20496326%252Finterior_front_seats-1774779672994.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6326/20496326/interior_front_seats-1774779672994.jpg saved to cache
2026-03-29 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfea1c92-e899-52d4-baee-d6d9130fc43d
2026-03-29 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_front_passenger-1774690173878.jpg> (referer: None)
2026-03-29 20:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cc6e4021-948a-5fef-828e-3fdfd880a945 with identifier: 19940066
2026-03-29 20:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cc6e4021-948a-5fef-828e-3fdfd880a945 with identifier: 19940066
2026-03-29 20:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cc6e4021-948a-5fef-828e-3fdfd880a945 with identifier: 19940066 to the API
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0066/19940066/interior_boot-1774719608378.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'cc6e4021-948a-5fef-828e-3fdfd880a945',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA51 YAZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19940066',
'listing': 'auction',
'location': 'Cheshire West and Chester Northwich',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 85650,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1555915,
'Height': 2327,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_front_driver-1774719061633.jpg',
'Width': 3102},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1473595,
'Height': 2405,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_rear_driver-1774719080495.jpg',
'Width': 3207},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1382101,
'Height': 2308,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_front_passenger-1774719107676.jpg',
'Width': 3077},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1272589,
'Height': 2266,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0066/19940066/exterior_rear_passenger-1774719093591.jpg',
'Width': 3021},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4612269,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0066/19940066/interior_front_seats-1774719642375.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4211068,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0066/19940066/interior_rear_seats-1774719574342.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3488414,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0066/19940066/interior_dashboard-1774719598090.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3009049,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0066/19940066/instrument_cluster-1774719672277.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3286780,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0066/19940066/interior_boot-1774719608378.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc6e4021-948a-5fef-828e-3fdfd880a945/cc6e4021-948a-5fef-828e-3fdfd880a945_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456134,
'Height': 1599,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0066/19940066/wheels_front_driver-1774719146441.jpg',
'Width': 2132}],
'price': 7631,
'price_includes_vat': False,
'registration_date': '2015-09-29',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Beetle Design TDI Bmotion Tech',
'transmission': 'manual',
'trim': 'Design TDI Bmotion Tech',
'vin': 'WVWZZZ16ZFM820392',
'year': 2015}
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719940066%27 HTTP/1.1" 200 None
2026-03-29 20:01:49 [motorway.uk] INFO: Saving data for 19940066: {'created_time': 1774814509.795481, 'last_price_update_time': 1774814509.795491, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19940066') HTTP/1.1" 204 0
2026-03-29 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafbead0>
2026-03-29 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9246%252F17699246%252Fexterior_front_passenger-1774690173878.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_front_passenger-1774690173878.jpg saved to cache
2026-03-29 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 181a0d36-b518-516c-887c-063daa59908c
2026-03-29 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9246/17699246/interior_front_seats-1774690487788.jpg> (referer: None)
2026-03-29 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9246/17699246/instrument_cluster-1774690728491.jpg> (referer: None)
2026-03-29 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9246/17699246/docs_service_history-1774692642468.jpg?ixlib=js-3.8.0&auto=format&s=8cc16b2da85142b9b19b9c9adacb0ef2> (referer: None)
2026-03-29 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9246/17699246/interior_boot-1774695267807.jpg> (referer: None)
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96766d0>
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9246%252F17699246%252Finterior_front_seats-1774690487788.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9246/17699246/interior_front_seats-1774690487788.jpg saved to cache
2026-03-29 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 181a0d36-b518-516c-887c-063daa59908c
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa7c2d0>
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9246%252F17699246%252Finstrument_cluster-1774690728491.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9246/17699246/instrument_cluster-1774690728491.jpg saved to cache
2026-03-29 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 181a0d36-b518-516c-887c-063daa59908c
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa11c50>
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9246%252F17699246%252Fdocs_service_history-1774692642468.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8cc16b2da85142b9b19b9c9adacb0ef2') HTTP/1.1" 204 0
2026-03-29 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9246/17699246/docs_service_history-1774692642468.jpg?ixlib=js-3.8.0&auto=format&s=8cc16b2da85142b9b19b9c9adacb0ef2 saved to cache
2026-03-29 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 181a0d36-b518-516c-887c-063daa59908c
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa15910>
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9246%252F17699246%252Finterior_boot-1774695267807.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9246/17699246/interior_boot-1774695267807.jpg saved to cache
2026-03-29 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 181a0d36-b518-516c-887c-063daa59908c
2026-03-29 20:01:50 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (13119185) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9370/17539370/interior_rear_seats-1774611163419.jpeg>.
2026-03-29 20:01:50 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (13966677) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9370/17539370/interior_front_seats-1774610952488.jpeg>.
2026-03-29 20:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_front_driver-1774690127510.jpg> (referer: None)
2026-03-29 20:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_rear_driver-1774690146159.jpg> (referer: None)
2026-03-29 20:01:50 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9370/17539370/interior_boot-1774611187259.jpeg>.
2026-03-29 20:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9370/17539370/instrument_cluster-1774611197037.jpeg> (referer: None)
2026-03-29 20:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9246/17699246/interior_dashboard-1774695043894.jpg> (referer: None)
2026-03-29 20:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9370/17539370/interior_dashboard-1774611203012.jpeg> (referer: None)
2026-03-29 20:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9370/17539370/interior_boot-1774611187259.jpeg> (referer: None)
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a3d910>
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9246%252F17699246%252Fexterior_front_driver-1774690127510.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_front_driver-1774690127510.jpg saved to cache
2026-03-29 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 181a0d36-b518-516c-887c-063daa59908c
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9031ed0>
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9246%252F17699246%252Fexterior_rear_driver-1774690146159.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_rear_driver-1774690146159.jpg saved to cache
2026-03-29 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 181a0d36-b518-516c-887c-063daa59908c
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f931ee10>
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9370%252F17539370%252Finstrument_cluster-1774611197037.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9370/17539370/instrument_cluster-1774611197037.jpeg saved to cache
2026-03-29 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f101a58b-a354-5d9d-a62b-bb96dde14db0
2026-03-29 20:01:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e90fd0>
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9246%252F17699246%252Finterior_dashboard-1774695043894.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9246/17699246/interior_dashboard-1774695043894.jpg saved to cache
2026-03-29 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 181a0d36-b518-516c-887c-063daa59908c
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae4fbd0>
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9370%252F17539370%252Finterior_dashboard-1774611203012.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9370/17539370/interior_dashboard-1774611203012.jpeg saved to cache
2026-03-29 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f101a58b-a354-5d9d-a62b-bb96dde14db0
2026-03-29 20:01:51 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:01:51 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:01:51 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x9b\x1c\x94\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\t\x1fS\x00\x9b\x12\x18\x00\x00\x00\x00'
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9668150>
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9370%252F17539370%252Finterior_boot-1774611187259.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9370/17539370/interior_boot-1774611187259.jpeg saved to cache
2026-03-29 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f101a58b-a354-5d9d-a62b-bb96dde14db0
2026-03-29 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_rear_passenger-1774690163902.jpg> (referer: None)
2026-03-29 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_rear_passenger-1774610222008.jpeg> (referer: None)
2026-03-29 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_rear_passenger-1774778631626.jpg> (referer: None)
2026-03-29 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_front_passenger-1774778645943.jpg> (referer: None)
2026-03-29 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_front_passenger-1774610236570.jpeg> (referer: None)
2026-03-29 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_front_passenger-1774547631504.jpg> (referer: None)
2026-03-29 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_rear_driver-1774610263232.jpeg> (referer: None)
2026-03-29 20:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_front_driver-1774610269984.jpeg> (referer: None)
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c13150>
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9246%252F17699246%252Fexterior_rear_passenger-1774690163902.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_rear_passenger-1774690163902.jpg saved to cache
2026-03-29 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 181a0d36-b518-516c-887c-063daa59908c
2026-03-29 20:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 181a0d36-b518-516c-887c-063daa59908c, skipping ID generation
2026-03-29 20:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 181a0d36-b518-516c-887c-063daa59908c with scrape type 1
2026-03-29 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 181a0d36-b518-516c-887c-063daa59908c sending to next pipeline
2026-03-29 20:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 181a0d36-b518-516c-887c-063daa59908c, identifier: 17699246
2026-03-29 20:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 181a0d36-b518-516c-887c-063daa59908c with identifier: 17699246
2026-03-29 20:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 181a0d36-b518-516c-887c-063daa59908c with identifier: 17699246
2026-03-29 20:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 181a0d36-b518-516c-887c-063daa59908c with identifier: 17699246 to the API
2026-03-29 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_rear_passenger-1774690163902.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '5.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '181a0d36-b518-516c-887c-063daa59908c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'A25 JGB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17699246',
'listing': 'auction',
'location': 'Dorset Dorchester',
'make': 'Mercedes',
'model': 'AMG',
'odometer': 19500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 967912,
'Height': 1978,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_front_driver-1774690127510.jpg',
'Width': 2637},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1760195,
'Height': 2632,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_rear_driver-1774690146159.jpg',
'Width': 3509},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1550983,
'Height': 2460,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_front_passenger-1774690173878.jpg',
'Width': 3280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2117410,
'Height': 2733,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9246/17699246/exterior_rear_passenger-1774690163902.jpg',
'Width': 3644},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2280164,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9246/17699246/interior_front_seats-1774690487788.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3729691,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9246/17699246/interior_dashboard-1774695043894.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2487478,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9246/17699246/instrument_cluster-1774690728491.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3890143,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9246/17699246/interior_boot-1774695267807.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1135459,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9246/17699246/docs_service_history-1774692626406.jpg?ixlib=js-3.8.0&auto=format&s=c5fcb3f09bb8addc7247ccbf590e3cb6',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_181a0d36-b518-516c-887c-063daa59908c/181a0d36-b518-516c-887c-063daa59908c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2342703,
'Height': 4284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9246/17699246/docs_service_history-1774692642468.jpg?ixlib=js-3.8.0&auto=format&s=8cc16b2da85142b9b19b9c9adacb0ef2',
'Width': 5712}],
'price': 33632,
'price_includes_vat': False,
'registration_date': '2016-04-26',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes AMG SL 63 Auto',
'transmission': 'automatic',
'trim': 'SL 63 Auto',
'vin': 'WDD2314742F039601',
'year': 2016}
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717699246%27 HTTP/1.1" 200 None
2026-03-29 20:01:52 [motorway.uk] INFO: Saving data for 17699246: {'created_time': 1774814512.26948, 'last_price_update_time': 1774814512.269489, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17699246') HTTP/1.1" 204 0
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f902ced0>
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9370%252F17539370%252Fexterior_rear_passenger-1774610222008.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_rear_passenger-1774610222008.jpeg saved to cache
2026-03-29 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f101a58b-a354-5d9d-a62b-bb96dde14db0
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faecdb50>
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6326%252F20496326%252Fexterior_rear_passenger-1774778631626.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_rear_passenger-1774778631626.jpg saved to cache
2026-03-29 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfea1c92-e899-52d4-baee-d6d9130fc43d
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faff9510>
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6326%252F20496326%252Fexterior_front_passenger-1774778645943.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_front_passenger-1774778645943.jpg saved to cache
2026-03-29 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfea1c92-e899-52d4-baee-d6d9130fc43d
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae62b90>
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9370%252F17539370%252Fexterior_front_passenger-1774610236570.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_front_passenger-1774610236570.jpeg saved to cache
2026-03-29 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f101a58b-a354-5d9d-a62b-bb96dde14db0
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae62b90>
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9688%252F19679688%252Fexterior_front_passenger-1774547631504.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_front_passenger-1774547631504.jpg saved to cache
2026-03-29 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facea990>
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9370%252F17539370%252Fexterior_rear_driver-1774610263232.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_rear_driver-1774610263232.jpeg saved to cache
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f101a58b-a354-5d9d-a62b-bb96dde14db0
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf01610>
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9370%252F17539370%252Fexterior_front_driver-1774610269984.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_front_driver-1774610269984.jpeg saved to cache
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f101a58b-a354-5d9d-a62b-bb96dde14db0
2026-03-29 20:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_front_driver-1774778588098.jpg> (referer: None)
2026-03-29 20:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_rear_driver-1774778637410.jpg> (referer: None)
2026-03-29 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_rear_driver-1774547613407.jpg> (referer: None)
2026-03-29 20:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1425/20471425/docs_service_history-1774714176720.jpg?ixlib=js-3.8.0&auto=format&s=526847649502adfaae7c8a54b63eeaa5> (referer: None)
2026-03-29 20:01:53 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9370/17539370/interior_front_seats-1774610952488.jpeg>.
2026-03-29 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1425/20471425/instrument_cluster-1774714046839.jpg> (referer: None)
2026-03-29 20:01:53 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/9370/17539370/interior_rear_seats-1774611163419.jpeg>.
2026-03-29 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9370/17539370/interior_front_seats-1774610952488.jpeg> (referer: None)
2026-03-29 20:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9370/17539370/damage_missing_trims-1774611551774.jpeg> (referer: None)
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f92463d0>
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6326%252F20496326%252Fexterior_front_driver-1774778588098.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_front_driver-1774778588098.jpg saved to cache
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfea1c92-e899-52d4-baee-d6d9130fc43d
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d16650>
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6326%252F20496326%252Fexterior_rear_driver-1774778637410.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_rear_driver-1774778637410.jpg saved to cache
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfea1c92-e899-52d4-baee-d6d9130fc43d
2026-03-29 20:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfea1c92-e899-52d4-baee-d6d9130fc43d, skipping ID generation
2026-03-29 20:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfea1c92-e899-52d4-baee-d6d9130fc43d with scrape type 1
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfea1c92-e899-52d4-baee-d6d9130fc43d sending to next pipeline
2026-03-29 20:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: dfea1c92-e899-52d4-baee-d6d9130fc43d, identifier: 20496326
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faffb290>
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9688%252F19679688%252Fexterior_rear_driver-1774547613407.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_rear_driver-1774547613407.jpg saved to cache
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6
2026-03-29 20:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04f3b57f-cd71-560c-a98a-4d8b1b16afb6, skipping ID generation
2026-03-29 20:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6 with scrape type 1
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04f3b57f-cd71-560c-a98a-4d8b1b16afb6 sending to next pipeline
2026-03-29 20:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 04f3b57f-cd71-560c-a98a-4d8b1b16afb6, identifier: 19679688
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f92454d0>
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1425%252F20471425%252Fdocs_service_history-1774714176720.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D526847649502adfaae7c8a54b63eeaa5') HTTP/1.1" 204 0
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1425/20471425/docs_service_history-1774714176720.jpg?ixlib=js-3.8.0&auto=format&s=526847649502adfaae7c8a54b63eeaa5 saved to cache
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5193134d-3233-5069-ba9a-bf1201dfda7a
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa165910>
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1425%252F20471425%252Finstrument_cluster-1774714046839.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1425/20471425/instrument_cluster-1774714046839.jpg saved to cache
2026-03-29 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5193134d-3233-5069-ba9a-bf1201dfda7a
2026-03-29 20:01:53 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:01:53 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:01:53 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xca\xa2\xae\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\nz\xa7\x00\xca\x982\x00\x00\x00\x00'
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faeccd50>
2026-03-29 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9370%252F17539370%252Finterior_front_seats-1774610952488.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9370/17539370/interior_front_seats-1774610952488.jpeg saved to cache
2026-03-29 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f101a58b-a354-5d9d-a62b-bb96dde14db0
2026-03-29 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x81\x80s\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06v\x99\x00\x81u\xf7\x00\x00\x00\x00'
2026-03-29 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e39cd0>
2026-03-29 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9370%252F17539370%252Fdamage_missing_trims-1774611551774.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9370/17539370/damage_missing_trims-1774611551774.jpeg saved to cache
2026-03-29 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f101a58b-a354-5d9d-a62b-bb96dde14db0
2026-03-29 20:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: dfea1c92-e899-52d4-baee-d6d9130fc43d with identifier: 20496326
2026-03-29 20:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: dfea1c92-e899-52d4-baee-d6d9130fc43d with identifier: 20496326
2026-03-29 20:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: dfea1c92-e899-52d4-baee-d6d9130fc43d with identifier: 20496326 to the API
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_rear_driver-1774778637410.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'dfea1c92-e899-52d4-baee-d6d9130fc43d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WM71 EFO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20496326',
'listing': 'auction',
'location': 'Devon Exeter',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 68467,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1411286,
'Height': 2509,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_front_driver-1774778588098.jpg',
'Width': 3345},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1506096,
'Height': 2730,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_rear_driver-1774778637410.jpg',
'Width': 3640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1690937,
'Height': 2738,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_front_passenger-1774778645943.jpg',
'Width': 3650},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1476500,
'Height': 2682,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6326/20496326/exterior_rear_passenger-1774778631626.jpg',
'Width': 3576},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3217497,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6326/20496326/interior_front_seats-1774779672994.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2546612,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6326/20496326/interior_rear_seats-1774779626016.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2213408,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6326/20496326/interior_dashboard-1774781228123.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2626586,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6326/20496326/interior_boot-1774781241196.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4216535,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6326/20496326/damage_dents-1774778736701.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfea1c92-e899-52d4-baee-d6d9130fc43d/dfea1c92-e899-52d4-baee-d6d9130fc43d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1828626,
'Height': 2689,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6326/20496326/wheels_front_driver-1774778770031.jpg',
'Width': 3585}],
'price': 27104,
'price_includes_vat': False,
'registration_date': '2022-01-27',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Touareg V6 Black Edition TSI A',
'transmission': 'automatic',
'trim': 'V6 Black Edition TSI A',
'vin': 'WVGZZZCRZND005715',
'year': 2022}
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720496326%27 HTTP/1.1" 200 None
2026-03-29 20:01:54 [motorway.uk] INFO: Saving data for 20496326: {'created_time': 1774814514.847898, 'last_price_update_time': 1774814514.847908, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20496326') HTTP/1.1" 204 0
2026-03-29 20:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 04f3b57f-cd71-560c-a98a-4d8b1b16afb6 with identifier: 19679688
2026-03-29 20:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 04f3b57f-cd71-560c-a98a-4d8b1b16afb6 with identifier: 19679688
2026-03-29 20:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 04f3b57f-cd71-560c-a98a-4d8b1b16afb6 with identifier: 19679688 to the API
2026-03-29 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_rear_driver-1774547613407.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '04f3b57f-cd71-560c-a98a-4d8b1b16afb6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR18 TKK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19679688',
'listing': 'auction',
'location': 'North Somerset Weston-super-Mare',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 35218,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1891516,
'Height': 2658,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_front_driver-1774547598196.jpg',
'Width': 3544},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1723033,
'Height': 2652,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_rear_driver-1774547613407.jpg',
'Width': 3536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2110482,
'Height': 2763,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_front_passenger-1774547631504.jpg',
'Width': 3684},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1502526,
'Height': 2387,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9688/19679688/exterior_rear_passenger-1774544799472.jpg',
'Width': 3183},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4003431,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9688/19679688/interior_front_seats-1774545521830.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4527851,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9688/19679688/interior_rear_seats-1774545411562.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1600517,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9688/19679688/interior_dashboard-1774545442997.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4726584,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9688/19679688/interior_boot-1774545480780.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1804189,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9688/19679688/damage_scratches-1774628568666.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04f3b57f-cd71-560c-a98a-4d8b1b16afb6/04f3b57f-cd71-560c-a98a-4d8b1b16afb6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4022608,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9688/19679688/damage_scratches-1774544959696.jpg',
'Width': 4032}],
'price': 9962,
'price_includes_vat': False,
'registration_date': '2018-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo SE TSI S-A',
'transmission': 'automatic',
'trim': 'SE TSI S-A',
'vin': 'WVWZZZAWZJU019903',
'year': 2018}
2026-03-29 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719679688%27 HTTP/1.1" 200 None
2026-03-29 20:01:55 [motorway.uk] INFO: Saving data for 19679688: {'created_time': 1774814515.235079, 'last_price_update_time': 1774814515.235091, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19679688') HTTP/1.1" 204 0
2026-03-29 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9370/17539370/interior_rear_seats-1774611163419.jpeg> (referer: None)
2026-03-29 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1425/20471425/interior_dashboard-1774714717356.jpg> (referer: None)
2026-03-29 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_front_passenger-1774713579558.jpg> (referer: None)
2026-03-29 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_rear_driver-1774713574893.jpg> (referer: None)
2026-03-29 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1425/20471425/interior_rear_seats-1774714011058.jpg> (referer: None)
2026-03-29 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_rear_passenger-1774713580974.jpg> (referer: None)
2026-03-29 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8396/19998396/docs_service_history-1774698670475-1.jpeg?ixlib=js-3.8.0&auto=format&s=aabaf9b8f3771385ff7a9de9bb185a7a> (referer: None)
2026-03-29 20:01:55 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:01:55 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:01:55 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xbe\x85Z\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\t\xa9w\x00\xbez\xde\x00\x00\x00\x00'
2026-03-29 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa17310>
2026-03-29 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9370%252F17539370%252Finterior_rear_seats-1774611163419.jpeg') HTTP/1.1" 204 0
2026-03-29 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9370/17539370/interior_rear_seats-1774611163419.jpeg saved to cache
2026-03-29 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f101a58b-a354-5d9d-a62b-bb96dde14db0
2026-03-29 20:01:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f101a58b-a354-5d9d-a62b-bb96dde14db0, skipping ID generation
2026-03-29 20:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f101a58b-a354-5d9d-a62b-bb96dde14db0 with scrape type 1
2026-03-29 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f101a58b-a354-5d9d-a62b-bb96dde14db0 sending to next pipeline
2026-03-29 20:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f101a58b-a354-5d9d-a62b-bb96dde14db0, identifier: 17539370
2026-03-29 20:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f101a58b-a354-5d9d-a62b-bb96dde14db0 with identifier: 17539370
2026-03-29 20:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f101a58b-a354-5d9d-a62b-bb96dde14db0 with identifier: 17539370
2026-03-29 20:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f101a58b-a354-5d9d-a62b-bb96dde14db0 with identifier: 17539370 to the API
2026-03-29 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9370/17539370/interior_rear_seats-1774611163419.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f101a58b-a354-5d9d-a62b-bb96dde14db0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WL21 BUF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17539370',
'listing': 'auction',
'location': 'Shropshire Oswestry',
'make': 'Audi',
'model': 'Q2',
'odometer': 30000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4839359,
'Height': 4879,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_front_driver-1774610269984.jpeg',
'Width': 6505},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4406026,
'Height': 4695,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_rear_driver-1774610263232.jpeg',
'Width': 6260},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3646053,
'Height': 4832,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_front_passenger-1774610236570.jpeg',
'Width': 6443},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3514251,
'Height': 4337,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9370/17539370/exterior_rear_passenger-1774610222008.jpeg',
'Width': 5782},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 13966677,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/9370/17539370/interior_front_seats-1774610952488.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 13119185,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/9370/17539370/interior_rear_seats-1774611163419.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5563266,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9370/17539370/interior_dashboard-1774611203012.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3448403,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9370/17539370/instrument_cluster-1774611197037.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 10763239,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/9370/17539370/interior_boot-1774611187259.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f101a58b-a354-5d9d-a62b-bb96dde14db0/f101a58b-a354-5d9d-a62b-bb96dde14db0_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 8910604,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/9370/17539370/damage_missing_trims-1774611551774.jpeg',
'Width': 8064}],
'price': 13653,
'price_includes_vat': False,
'registration_date': '2021-05-26',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q2 Sport 30 TFSI',
'transmission': 'manual',
'trim': 'Sport 30 TFSI',
'vin': 'WAUZZZGA9MA028599',
'year': 2021}
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717539370%27 HTTP/1.1" 200 None
2026-03-29 20:01:56 [motorway.uk] INFO: Saving data for 17539370: {'created_time': 1774814516.147923, 'last_price_update_time': 1774814516.147935, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17539370') HTTP/1.1" 204 0
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf14d50>
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1425%252F20471425%252Finterior_dashboard-1774714717356.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1425/20471425/interior_dashboard-1774714717356.jpg saved to cache
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5193134d-3233-5069-ba9a-bf1201dfda7a
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf77a90>
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1425%252F20471425%252Fexterior_front_passenger-1774713579558.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_front_passenger-1774713579558.jpg saved to cache
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5193134d-3233-5069-ba9a-bf1201dfda7a
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa165310>
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1425%252F20471425%252Fexterior_rear_driver-1774713574893.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_rear_driver-1774713574893.jpg saved to cache
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5193134d-3233-5069-ba9a-bf1201dfda7a
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ac6ed0>
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1425%252F20471425%252Finterior_rear_seats-1774714011058.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1425/20471425/interior_rear_seats-1774714011058.jpg saved to cache
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5193134d-3233-5069-ba9a-bf1201dfda7a
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1885d0>
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1425%252F20471425%252Fexterior_rear_passenger-1774713580974.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_rear_passenger-1774713580974.jpg saved to cache
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5193134d-3233-5069-ba9a-bf1201dfda7a
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab3b650>
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8396%252F19998396%252Fdocs_service_history-1774698670475-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daabaf9b8f3771385ff7a9de9bb185a7a') HTTP/1.1" 204 0
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8396/19998396/docs_service_history-1774698670475-1.jpeg?ixlib=js-3.8.0&auto=format&s=aabaf9b8f3771385ff7a9de9bb185a7a saved to cache
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97
2026-03-29 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_front_driver-1774713576469.jpg> (referer: None)
2026-03-29 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6965/20486965/interior_boot-1774700734508.jpg> (referer: None)
2026-03-29 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6997/20436997/interior_boot-1774693841991.jpg> (referer: None)
2026-03-29 20:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=360&page=10&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f922cdd0>
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1425%252F20471425%252Fexterior_front_driver-1774713576469.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_front_driver-1774713576469.jpg saved to cache
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5193134d-3233-5069-ba9a-bf1201dfda7a
2026-03-29 20:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5193134d-3233-5069-ba9a-bf1201dfda7a, skipping ID generation
2026-03-29 20:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5193134d-3233-5069-ba9a-bf1201dfda7a with scrape type 1
2026-03-29 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5193134d-3233-5069-ba9a-bf1201dfda7a sending to next pipeline
2026-03-29 20:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5193134d-3233-5069-ba9a-bf1201dfda7a, identifier: 20471425
2026-03-29 20:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5193134d-3233-5069-ba9a-bf1201dfda7a with identifier: 20471425
2026-03-29 20:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5193134d-3233-5069-ba9a-bf1201dfda7a with identifier: 20471425
2026-03-29 20:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5193134d-3233-5069-ba9a-bf1201dfda7a with identifier: 20471425 to the API
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_front_driver-1774713576469.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '5193134d-3233-5069-ba9a-bf1201dfda7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KK18 LWS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20471425',
'listing': 'auction',
'location': 'North East Lincolnshire Grimsby',
'make': 'Volvo',
'model': 'XC60',
'odometer': 87700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1857769,
'Height': 2636,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_front_driver-1774713576469.jpg',
'Width': 3514},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2258739,
'Height': 2820,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_rear_driver-1774713574893.jpg',
'Width': 3760},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2014962,
'Height': 2655,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_front_passenger-1774713579558.jpg',
'Width': 3540},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2461187,
'Height': 2765,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1425/20471425/exterior_rear_passenger-1774713580974.jpg',
'Width': 3687},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3178387,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1425/20471425/interior_front_seats-1774714005118.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3128281,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1425/20471425/interior_rear_seats-1774714011058.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2431556,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1425/20471425/interior_dashboard-1774714717356.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2992504,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1425/20471425/instrument_cluster-1774714046839.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3029885,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1425/20471425/interior_boot-1774714001664.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5193134d-3233-5069-ba9a-bf1201dfda7a/5193134d-3233-5069-ba9a-bf1201dfda7a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1981610,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1425/20471425/docs_service_history-1774714176720.jpg?ixlib=js-3.8.0&auto=format&s=526847649502adfaae7c8a54b63eeaa5',
'Width': 3840}],
'price': 17006,
'price_includes_vat': False,
'registration_date': '2018-07-18',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC60 R-DESIGN PRO D5 PP AWD A',
'transmission': 'automatic',
'trim': 'R-DESIGN PRO D5 PP AWD A',
'vin': 'YV1UZ68TCK1221586',
'year': 2018}
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471425%27 HTTP/1.1" 200 None
2026-03-29 20:01:57 [motorway.uk] INFO: Saving data for 20471425: {'created_time': 1774814517.466283, 'last_price_update_time': 1774814517.466294, 'auction_closing_time': 1774884600.0}
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20471425') HTTP/1.1" 204 0
2026-03-29 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9115310>
2026-03-29 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6965%252F20486965%252Finterior_boot-1774700734508.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6965/20486965/interior_boot-1774700734508.jpg saved to cache
2026-03-29 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3b83795-b8da-52c5-adfd-45cceb547866
2026-03-29 20:01:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:01:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:01:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f966b410>
2026-03-29 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6997%252F20436997%252Finterior_boot-1774693841991.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6997/20436997/interior_boot-1774693841991.jpg saved to cache
2026-03-29 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 18969142
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 19163712
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 10452717
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 18171472
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 20302141
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720302141%27 HTTP/1.1" 200 None
2026-03-29 20:01:57 [motorway.uk] INFO: Scrape type for 20302141: 1
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 20404971
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 19535149
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 20368231
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720368231%27 HTTP/1.1" 200 None
2026-03-29 20:01:57 [motorway.uk] INFO: Scrape type for 20368231: 1
2026-03-29 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20346137.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 19585852
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 20303922
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720303922%27 HTTP/1.1" 200 None
2026-03-29 20:01:57 [motorway.uk] INFO: Scrape type for 20303922: 2
2026-03-29 20:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 19960180
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 17662839
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 20459994
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 19144130
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 20459047
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459047%27 HTTP/1.1" 200 None
2026-03-29 20:01:57 [motorway.uk] INFO: Scrape type for 20459047: 1
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 18354443
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 20148114
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720148114%27 HTTP/1.1" 200 None
2026-03-29 20:01:57 [motorway.uk] INFO: Scrape type for 20148114: 1
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 12711502
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 19337875
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 10813763
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710813763%27 HTTP/1.1" 200 None
2026-03-29 20:01:57 [motorway.uk] INFO: Scrape type for 10813763: 1
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 18907003
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718907003%27 HTTP/1.1" 200 None
2026-03-29 20:01:57 [motorway.uk] INFO: Scrape type for 18907003: 1
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 15916141
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 20257823
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 20475074
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 15870409
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 20251970
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 17727943
2026-03-29 20:01:57 [motorway.uk] INFO: Found listing with ID: 20462595
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720462595%27 HTTP/1.1" 200 None
2026-03-29 20:01:57 [motorway.uk] INFO: Scrape type for 20462595: 1
2026-03-29 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8396/19998396/instrument_cluster-1774521481443.jpg> (referer: None)
2026-03-29 20:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4 with identifier: 20346137
2026-03-29 20:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4 with scrape type 1
2026-03-29 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4
2026-03-29 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6137%252F20346137%252Fexterior_front_driver-1774713499435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6137/20346137/exterior_front_driver-1774713499435.jpg not downloaded yet
2026-03-29 20:01:58 [motorway.uk] INFO: Found listing with ID: 20192465
2026-03-29 20:01:58 [motorway.uk] INFO: Found listing with ID: 20063535
2026-03-29 20:01:58 [motorway.uk] INFO: Found listing with ID: 20333711
2026-03-29 20:01:58 [motorway.uk] INFO: Found listing with ID: 18068486
2026-03-29 20:01:58 [motorway.uk] INFO: Found listing with ID: 20437958
2026-03-29 20:01:58 [motorway.uk] INFO: Found listing with ID: 20459514
2026-03-29 20:01:58 [motorway.uk] INFO: Found listing with ID: 18787282
2026-03-29 20:01:58 [motorway.uk] INFO: Found listing with ID: 10538324
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710538324%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [motorway.uk] INFO: Scrape type for 10538324: 1
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6137%252F20346137%252Fexterior_rear_driver-1774713233010.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6137/20346137/exterior_rear_driver-1774713233010.jpg not downloaded yet
2026-03-29 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486896.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489379.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9062/3629062/interior_dashboard-1774700106221.jpg> (referer: None)
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6137%252F20346137%252Fexterior_front_passenger-1774715965057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6137/20346137/exterior_front_passenger-1774715965057.jpg not downloaded yet
2026-03-29 20:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9062/3629062/instrument_cluster-1774700159675.jpg> (referer: None)
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6137%252F20346137%252Fexterior_rear_passenger-1774713551631.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6137/20346137/exterior_rear_passenger-1774713551631.jpg not downloaded yet
2026-03-29 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6997/20436997/instrument_cluster-1774693625010.jpg> (referer: None)
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf7c250>
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8396%252F19998396%252Finstrument_cluster-1774521481443.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8396/19998396/instrument_cluster-1774521481443.jpg saved to cache
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97
2026-03-29 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6997/20436997/interior_dashboard-1774693833763.jpg> (referer: None)
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6137%252F20346137%252Finterior_front_seats-1774715821085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6137/20346137/interior_front_seats-1774715821085.jpg not downloaded yet
2026-03-29 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20494274.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6137%252F20346137%252Finterior_rear_seats-1774714637173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6137/20346137/interior_rear_seats-1774714637173.jpg not downloaded yet
2026-03-29 20:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 564e792f-3a57-5c45-b3b1-29ebc0e950ef with identifier: 20486896
2026-03-29 20:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef with scrape type 1
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6896%252F20486896%252Fexterior_front_driver-1774707625226.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6896/20486896/exterior_front_driver-1774707625226.jpg not downloaded yet
2026-03-29 20:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08468e3a-1f17-5dc4-be2c-91a91fb22b19 with identifier: 20489379
2026-03-29 20:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19 with scrape type 1
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9379%252F20489379%252Fexterior_front_driver-1774706873900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_front_driver-1774706873900.jpg not downloaded yet
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa175e90>
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9062%252F3629062%252Finterior_dashboard-1774700106221.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9062/3629062/interior_dashboard-1774700106221.jpg saved to cache
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7aa56651-1db2-5dc0-80a5-d141f627d833
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e66750>
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9062%252F3629062%252Finstrument_cluster-1774700159675.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9062/3629062/instrument_cluster-1774700159675.jpg saved to cache
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7aa56651-1db2-5dc0-80a5-d141f627d833
2026-03-29 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6965/20486965/instrument_cluster-1774700442346.jpg> (referer: None)
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6137%252F20346137%252Finterior_dashboard-1774715556972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6137/20346137/interior_dashboard-1774715556972.jpg not downloaded yet
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6896%252F20486896%252Fexterior_rear_driver-1774699859001.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6896/20486896/exterior_rear_driver-1774699859001.jpg not downloaded yet
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9379%252F20489379%252Fexterior_rear_driver-1774706886761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_rear_driver-1774706886761.jpg not downloaded yet
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ef12d0>
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6997%252F20436997%252Finstrument_cluster-1774693625010.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6997/20436997/instrument_cluster-1774693625010.jpg saved to cache
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6137%252F20346137%252Finterior_boot-1774714880660.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6137/20346137/interior_boot-1774714880660.jpg not downloaded yet
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6896%252F20486896%252Fexterior_front_passenger-1774699833800.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6896/20486896/exterior_front_passenger-1774699833800.jpg not downloaded yet
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9379%252F20489379%252Fexterior_front_passenger-1774706936710.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_front_passenger-1774706936710.jpg not downloaded yet
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e49150>
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6997%252F20436997%252Finterior_dashboard-1774693833763.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6997/20436997/interior_dashboard-1774693833763.jpg saved to cache
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3
2026-03-29 20:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba4deeea-6337-50ef-a7c1-3873e456858c with identifier: 20494274
2026-03-29 20:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba4deeea-6337-50ef-a7c1-3873e456858c with scrape type 1
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba4deeea-6337-50ef-a7c1-3873e456858c
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4274%252F20494274%252Fexterior_front_driver-1774791970418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_front_driver-1774791970418.jpg not downloaded yet
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e97e50>
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6965%252F20486965%252Finstrument_cluster-1774700442346.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6965/20486965/instrument_cluster-1774700442346.jpg saved to cache
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3b83795-b8da-52c5-adfd-45cceb547866
2026-03-29 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6965/20486965/interior_dashboard-1774700750778.jpg> (referer: None)
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6137%252F20346137%252Fdocs_service_history-1774715075472.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D67efdcafbff479a560d68be5663b9c91%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6137/20346137/docs_service_history-1774715075472.jpg?ixlib=js-3.8.0&auto=format&s=67efdcafbff479a560d68be5663b9c91 not downloaded yet
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6896%252F20486896%252Fexterior_rear_passenger-1774700008504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6896/20486896/exterior_rear_passenger-1774700008504.jpg not downloaded yet
2026-03-29 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9379%252F20489379%252Fexterior_rear_passenger-1774706898784.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_rear_passenger-1774706898784.jpg not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4274%252F20494274%252Fexterior_rear_driver-1774792065177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_rear_driver-1774792065177.jpg not downloaded yet
2026-03-29 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8396/19998396/interior_boot-1774521547690.jpg> (referer: None)
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6137%252F20346137%252Fdamage_scratches-1774713912775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6137/20346137/damage_scratches-1774713912775.jpg not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6896%252F20486896%252Finterior_front_seats-1774700240590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6896/20486896/interior_front_seats-1774700240590.jpg not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9379%252F20489379%252Finterior_front_seats-1774707220001.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9379/20489379/interior_front_seats-1774707220001.jpg not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4274%252F20494274%252Fexterior_front_passenger-1774792122805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_front_passenger-1774792122805.jpg not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6896%252F20486896%252Finterior_rear_seats-1774700241340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6896/20486896/interior_rear_seats-1774700241340.jpg not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9379%252F20489379%252Finterior_rear_seats-1774707233408.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9379/20489379/interior_rear_seats-1774707233408.jpg not downloaded yet
2026-03-29 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9062/3629062/interior_boot-1774700095680.jpg> (referer: None)
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4274%252F20494274%252Fexterior_rear_passenger-1774792089102.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_rear_passenger-1774792089102.jpg not downloaded yet
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f905c450>
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6965%252F20486965%252Finterior_dashboard-1774700750778.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6965/20486965/interior_dashboard-1774700750778.jpg saved to cache
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3b83795-b8da-52c5-adfd-45cceb547866
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6896%252F20486896%252Finterior_dashboard-1774707425709.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6896/20486896/interior_dashboard-1774707425709.jpg not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9379%252F20489379%252Finterior_dashboard-1774772484077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9379/20489379/interior_dashboard-1774772484077.jpg not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4274%252F20494274%252Finterior_front_seats-1774792472605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4274/20494274/interior_front_seats-1774792472605.jpg not downloaded yet
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f934bdd0>
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8396%252F19998396%252Finterior_boot-1774521547690.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8396/19998396/interior_boot-1774521547690.jpg saved to cache
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6896%252F20486896%252Finterior_boot-1774707438601.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6896/20486896/interior_boot-1774707438601.jpg not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9379%252F20489379%252Finstrument_cluster-1774707321948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9379/20489379/instrument_cluster-1774707321948.jpg not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4274%252F20494274%252Finterior_rear_seats-1774792491511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4274/20494274/interior_rear_seats-1774792491511.jpg not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6896%252F20486896%252Fdocs_service_history-1774700334671.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7c384b0808732b7a60f7d0f4cd2fecbb%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6896/20486896/docs_service_history-1774700334671.jpg?ixlib=js-3.8.0&auto=format&s=7c384b0808732b7a60f7d0f4cd2fecbb not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9379%252F20489379%252Finterior_boot-1774707259970.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9379/20489379/interior_boot-1774707259970.jpg not downloaded yet
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9349390>
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9062%252F3629062%252Finterior_boot-1774700095680.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9062/3629062/interior_boot-1774700095680.jpg saved to cache
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7aa56651-1db2-5dc0-80a5-d141f627d833
2026-03-29 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6137/20346137/exterior_front_driver-1774713499435.jpg> (referer: None)
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4274%252F20494274%252Finterior_dashboard-1774794427044.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4274/20494274/interior_dashboard-1774794427044.jpg not downloaded yet
2026-03-29 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6137/20346137/exterior_rear_driver-1774713233010.jpg> (referer: None)
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6896%252F20486896%252Fdocs_service_history-1774700356608.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2456aae304149f6b98f4c49ce8c0ea8f%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6896/20486896/docs_service_history-1774700356608.jpg?ixlib=js-3.8.0&auto=format&s=2456aae304149f6b98f4c49ce8c0ea8f not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9379%252F20489379%252Fdocs_service_history-1774707362535.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5f69487b05a9f2b5b1dc1b0fd6c7241c%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9379/20489379/docs_service_history-1774707362535.jpg?ixlib=js-3.8.0&auto=format&s=5f69487b05a9f2b5b1dc1b0fd6c7241c not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4274%252F20494274%252Finterior_boot-1774792536783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4274/20494274/interior_boot-1774792536783.jpg not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4274%252F20494274%252Fdocs_service_history-1774792759511.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D54b1dbe1a424ea9ef76acb417e5f59d2%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4274/20494274/docs_service_history-1774792759511.jpg?ixlib=js-3.8.0&auto=format&s=54b1dbe1a424ea9ef76acb417e5f59d2 not downloaded yet
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4274%252F20494274%252Fdocs_service_history-1774794025213.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D087c976951cdd78ce6f719e2e4e589cd%27 HTTP/1.1" 200 None
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4274/20494274/docs_service_history-1774794025213.jpg?ixlib=js-3.8.0&auto=format&s=087c976951cdd78ce6f719e2e4e589cd not downloaded yet
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d7c3d0>
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6137%252F20346137%252Fexterior_front_driver-1774713499435.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6137/20346137/exterior_front_driver-1774713499435.jpg saved to cache
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d7ec90>
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6137%252F20346137%252Fexterior_rear_driver-1774713233010.jpg') HTTP/1.1" 204 0
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6137/20346137/exterior_rear_driver-1774713233010.jpg saved to cache
2026-03-29 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4
2026-03-29 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8396/19998396/interior_dashboard-1774702623830.jpg> (referer: None)
2026-03-29 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6896/20486896/docs_service_history-1774700334671.jpg?ixlib=js-3.8.0&auto=format&s=7c384b0808732b7a60f7d0f4cd2fecbb> (referer: None)
2026-03-29 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9379/20489379/docs_service_history-1774707362535.jpg?ixlib=js-3.8.0&auto=format&s=5f69487b05a9f2b5b1dc1b0fd6c7241c> (referer: None)
2026-03-29 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6896/20486896/interior_boot-1774707438601.jpg> (referer: None)
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f870e543650>
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8396%252F19998396%252Finterior_dashboard-1774702623830.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8396/19998396/interior_dashboard-1774702623830.jpg saved to cache
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97
2026-03-29 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20368231.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb1390>
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6896%252F20486896%252Fdocs_service_history-1774700334671.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7c384b0808732b7a60f7d0f4cd2fecbb') HTTP/1.1" 204 0
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6896/20486896/docs_service_history-1774700334671.jpg?ixlib=js-3.8.0&auto=format&s=7c384b0808732b7a60f7d0f4cd2fecbb saved to cache
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca0a90>
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9379%252F20489379%252Fdocs_service_history-1774707362535.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5f69487b05a9f2b5b1dc1b0fd6c7241c') HTTP/1.1" 204 0
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9379/20489379/docs_service_history-1774707362535.jpg?ixlib=js-3.8.0&auto=format&s=5f69487b05a9f2b5b1dc1b0fd6c7241c saved to cache
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca1210>
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6896%252F20486896%252Finterior_boot-1774707438601.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6896/20486896/interior_boot-1774707438601.jpg saved to cache
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef
2026-03-29 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20302141.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3165d9-f6b8-5290-86d7-9aedd9abf26d with identifier: 20368231
2026-03-29 20:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d with scrape type 1
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F20368231%252Fexterior_front_driver-1774694801482.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_front_driver-1774694801482.jpg not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F20368231%252Fexterior_rear_driver-1774694821009.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_rear_driver-1774694821009.jpg not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F20368231%252Fexterior_front_passenger-1774694895966.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_front_passenger-1774694895966.jpg not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F20368231%252Fexterior_rear_passenger-1774694882886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_rear_passenger-1774694882886.jpg not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8231%252F20368231%252Finterior_front_seats-1774695386581.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8231/20368231/interior_front_seats-1774695386581.jpg not downloaded yet
2026-03-29 20:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4452ee70-858c-5e9c-b16a-d470f37269b2 with identifier: 20302141
2026-03-29 20:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4452ee70-858c-5e9c-b16a-d470f37269b2 with scrape type 1
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4452ee70-858c-5e9c-b16a-d470f37269b2
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2141%252F20302141%252Fexterior_front_driver-1774437332701.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_front_driver-1774437332701.jpg not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8231%252F20368231%252Finterior_rear_seats-1774695398281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8231/20368231/interior_rear_seats-1774695398281.jpg not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2141%252F20302141%252Fexterior_rear_driver-1773747944476.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_rear_driver-1773747944476.jpg not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F20368231%252Finterior_dashboard-1774695443939.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/20368231/interior_dashboard-1774695443939.jpg not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2141%252F20302141%252Fexterior_front_passenger-1774437324999.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_front_passenger-1774437324999.jpg not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8231%252F20368231%252Finterior_boot-1774695458189.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8231/20368231/interior_boot-1774695458189.jpg not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2141%252F20302141%252Fexterior_rear_passenger-1773748391959.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_rear_passenger-1773748391959.jpg not downloaded yet
2026-03-29 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6896/20486896/docs_service_history-1774700356608.jpg?ixlib=js-3.8.0&auto=format&s=2456aae304149f6b98f4c49ce8c0ea8f> (referer: None)
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8231%252F20368231%252Fdocs_service_history-1774697613993.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7d49b516bbfe784d95d06f2f91d08be6%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8231/20368231/docs_service_history-1774697613993.jpg?ixlib=js-3.8.0&auto=format&s=7d49b516bbfe784d95d06f2f91d08be6 not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2141%252F20302141%252Finterior_front_seats-1774630384051.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2141/20302141/interior_front_seats-1774630384051.jpg not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8231%252F20368231%252Fdamage_scratches-1774694956938.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8231/20368231/damage_scratches-1774694956938.jpg not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2141%252F20302141%252Finterior_rear_seats-1774437341089.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2141/20302141/interior_rear_seats-1774437341089.jpg not downloaded yet
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2141%252F20302141%252Finterior_dashboard-1774709695795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2141/20302141/interior_dashboard-1774709695795.jpg not downloaded yet
2026-03-29 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9379/20489379/instrument_cluster-1774707321948.jpg> (referer: None)
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2141%252F20302141%252Finstrument_cluster-1774690348043.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2141/20302141/instrument_cluster-1774690348043.jpg not downloaded yet
2026-03-29 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6896/20486896/interior_dashboard-1774707425709.jpg> (referer: None)
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2141%252F20302141%252Finterior_boot-1774442193806.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2141/20302141/interior_boot-1774442193806.jpg not downloaded yet
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f964a810>
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6896%252F20486896%252Fdocs_service_history-1774700356608.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2456aae304149f6b98f4c49ce8c0ea8f') HTTP/1.1" 204 0
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6896/20486896/docs_service_history-1774700356608.jpg?ixlib=js-3.8.0&auto=format&s=2456aae304149f6b98f4c49ce8c0ea8f saved to cache
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef
2026-03-29 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4274/20494274/interior_dashboard-1774794427044.jpg> (referer: None)
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2141%252F20302141%252Fdamage_scratches-1774273521224.png%27 HTTP/1.1" 200 None
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2141/20302141/damage_scratches-1774273521224.png not downloaded yet
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f928a810>
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9379%252F20489379%252Finstrument_cluster-1774707321948.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9379/20489379/instrument_cluster-1774707321948.jpg saved to cache
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ad20d0>
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6896%252F20486896%252Finterior_dashboard-1774707425709.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6896/20486896/interior_dashboard-1774707425709.jpg saved to cache
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9002890>
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4274%252F20494274%252Finterior_dashboard-1774794427044.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4274/20494274/interior_dashboard-1774794427044.jpg saved to cache
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ba4deeea-6337-50ef-a7c1-3873e456858c
2026-03-29 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9379/20489379/interior_dashboard-1774772484077.jpg> (referer: None)
2026-03-29 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_rear_passenger-1774792089102.jpg> (referer: None)
2026-03-29 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4274/20494274/interior_front_seats-1774792472605.jpg> (referer: None)
2026-03-29 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9379/20489379/interior_boot-1774707259970.jpg> (referer: None)
2026-03-29 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_rear_passenger-1773748391959.jpg> (referer: None)
2026-03-29 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4274/20494274/interior_boot-1774792536783.jpg> (referer: None)
2026-03-29 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4274/20494274/interior_rear_seats-1774792491511.jpg> (referer: None)
2026-03-29 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4274/20494274/docs_service_history-1774792759511.jpg?ixlib=js-3.8.0&auto=format&s=54b1dbe1a424ea9ef76acb417e5f59d2> (referer: None)
2026-03-29 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9379/20489379/interior_rear_seats-1774707233408.jpg> (referer: None)
2026-03-29 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2141/20302141/interior_rear_seats-1774437341089.jpg> (referer: None)
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa5dfd0>
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9379%252F20489379%252Finterior_dashboard-1774772484077.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9379/20489379/interior_dashboard-1774772484077.jpg saved to cache
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700e09a90>
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4274%252F20494274%252Fexterior_rear_passenger-1774792089102.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_rear_passenger-1774792089102.jpg saved to cache
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ba4deeea-6337-50ef-a7c1-3873e456858c
2026-03-29 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2141/20302141/damage_scratches-1774273521224.png> (referer: None)
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa07f910>
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4274%252F20494274%252Finterior_front_seats-1774792472605.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4274/20494274/interior_front_seats-1774792472605.jpg saved to cache
2026-03-29 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ba4deeea-6337-50ef-a7c1-3873e456858c
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f967ba10>
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9379%252F20489379%252Finterior_boot-1774707259970.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9379/20489379/interior_boot-1774707259970.jpg saved to cache
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81f9e90>
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2141%252F20302141%252Fexterior_rear_passenger-1773748391959.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_rear_passenger-1773748391959.jpg saved to cache
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4452ee70-858c-5e9c-b16a-d470f37269b2
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ad1c50>
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4274%252F20494274%252Finterior_boot-1774792536783.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4274/20494274/interior_boot-1774792536783.jpg saved to cache
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ba4deeea-6337-50ef-a7c1-3873e456858c
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fda190>
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4274%252F20494274%252Finterior_rear_seats-1774792491511.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4274/20494274/interior_rear_seats-1774792491511.jpg saved to cache
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ba4deeea-6337-50ef-a7c1-3873e456858c
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f928b990>
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4274%252F20494274%252Fdocs_service_history-1774792759511.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D54b1dbe1a424ea9ef76acb417e5f59d2') HTTP/1.1" 204 0
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4274/20494274/docs_service_history-1774792759511.jpg?ixlib=js-3.8.0&auto=format&s=54b1dbe1a424ea9ef76acb417e5f59d2 saved to cache
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ba4deeea-6337-50ef-a7c1-3873e456858c
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81f8710>
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9379%252F20489379%252Finterior_rear_seats-1774707233408.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9379/20489379/interior_rear_seats-1774707233408.jpg saved to cache
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x0f\x00\x00'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xb8\x0b\x00\x00'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'Galaxy Z Fold5\x00'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 194 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 202 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 210 - value: b'F946BXXS6FZB6\x00'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 224 - value: b'2026:03:24 15:28:51\x00'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xf4\x00\x00\x00'
2026-03-29 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\xee\x02\x00\x00'
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e3f7d0>
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2141%252F20302141%252Finterior_rear_seats-1774437341089.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2141/20302141/interior_rear_seats-1774437341089.jpg saved to cache
2026-03-29 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4452ee70-858c-5e9c-b16a-d470f37269b2
2026-03-29 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10538324.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:02 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:02:02 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-29 20:02:02 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-29 20:02:02 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-29 20:02:02 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 61780
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf2bf90>
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_9.png HTTP/1.1" 201 0
2026-03-29 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2141%252F20302141%252Fdamage_scratches-1774273521224.png') HTTP/1.1" 204 0
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2141/20302141/damage_scratches-1774273521224.png saved to cache
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4452ee70-858c-5e9c-b16a-d470f37269b2
2026-03-29 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4274/20494274/docs_service_history-1774794025213.jpg?ixlib=js-3.8.0&auto=format&s=087c976951cdd78ce6f719e2e4e589cd> (referer: None)
2026-03-29 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2141/20302141/instrument_cluster-1774690348043.jpg> (referer: None)
2026-03-29 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2141/20302141/interior_dashboard-1774709695795.jpg> (referer: None)
2026-03-29 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2141/20302141/interior_boot-1774442193806.jpg> (referer: None)
2026-03-29 20:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e2465ce-820f-5388-98d5-42f23c6f7aa4 with identifier: 10538324
2026-03-29 20:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4 with scrape type 1
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8324%252F10538324%252Fexterior_front_driver-1774697654205.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_front_driver-1774697654205.jpeg not downloaded yet
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8324%252F10538324%252Fexterior_rear_driver-1774697695819.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_rear_driver-1774697695819.jpeg not downloaded yet
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8324%252F10538324%252Fexterior_front_passenger-1774697666218.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_front_passenger-1774697666218.jpeg not downloaded yet
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e21bd0>
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4274%252F20494274%252Fdocs_service_history-1774794025213.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D087c976951cdd78ce6f719e2e4e589cd') HTTP/1.1" 204 0
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4274/20494274/docs_service_history-1774794025213.jpg?ixlib=js-3.8.0&auto=format&s=087c976951cdd78ce6f719e2e4e589cd saved to cache
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ba4deeea-6337-50ef-a7c1-3873e456858c
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a6d0d0>
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2141%252F20302141%252Finstrument_cluster-1774690348043.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2141/20302141/instrument_cluster-1774690348043.jpg saved to cache
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4452ee70-858c-5e9c-b16a-d470f37269b2
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9047050>
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2141%252F20302141%252Finterior_dashboard-1774709695795.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2141/20302141/interior_dashboard-1774709695795.jpg saved to cache
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4452ee70-858c-5e9c-b16a-d470f37269b2
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x0f\x00\x00'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xb8\x0b\x00\x00'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'Galaxy Z Fold5\x00'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 194 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 202 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 210 - value: b'F946BXXS6FZB6\x00'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 224 - value: b'2026:03:24 15:32:15\x00'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xf4\x00\x00\x00'
2026-03-29 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\xee\x02\x00\x00'
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89553d0>
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2141%252F20302141%252Finterior_boot-1774442193806.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2141/20302141/interior_boot-1774442193806.jpg saved to cache
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4452ee70-858c-5e9c-b16a-d470f37269b2
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8324%252F10538324%252Fexterior_rear_passenger-1774697676081.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_rear_passenger-1774697676081.jpeg not downloaded yet
2026-03-29 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18907003.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8324%252F10538324%252Finterior_front_seats-1774697864788.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8324/10538324/interior_front_seats-1774697864788.jpeg not downloaded yet
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8324%252F10538324%252Finterior_rear_seats-1774698281012.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8324/10538324/interior_rear_seats-1774698281012.jpeg not downloaded yet
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8324%252F10538324%252Finterior_dashboard-1774697987831.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8324/10538324/interior_dashboard-1774697987831.jpeg not downloaded yet
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8324%252F10538324%252Finstrument_cluster-1774698022129.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8324/10538324/instrument_cluster-1774698022129.jpeg not downloaded yet
2026-03-29 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8231/20368231/docs_service_history-1774697613993.jpg?ixlib=js-3.8.0&auto=format&s=7d49b516bbfe784d95d06f2f91d08be6> (referer: None)
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8324%252F10538324%252Finterior_boot-1774698004360.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8324/10538324/interior_boot-1774698004360.jpeg not downloaded yet
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8324%252F10538324%252Fdocs_service_history-1774699525936.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8cf7e99d85c84224dc59df1551dbfc78%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8324/10538324/docs_service_history-1774699525936.jpeg?ixlib=js-3.8.0&auto=format&s=8cf7e99d85c84224dc59df1551dbfc78 not downloaded yet
2026-03-29 20:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979 with identifier: 18907003
2026-03-29 20:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979 with scrape type 1
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7003%252F18907003%252Fexterior_front_driver-1774708572684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_front_driver-1774708572684.jpg not downloaded yet
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7003%252F18907003%252Fexterior_rear_driver-1774709261392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_rear_driver-1774709261392.jpg not downloaded yet
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7003%252F18907003%252Fexterior_front_passenger-1774709438762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_front_passenger-1774709438762.jpg not downloaded yet
2026-03-29 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_rear_driver-1773747944476.jpg> (referer: None)
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7003%252F18907003%252Fexterior_rear_passenger-1774709411375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_rear_passenger-1774709411375.jpg not downloaded yet
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90a31d0>
2026-03-29 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8231%252F20368231%252Fdocs_service_history-1774697613993.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7d49b516bbfe784d95d06f2f91d08be6') HTTP/1.1" 204 0
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8231/20368231/docs_service_history-1774697613993.jpg?ixlib=js-3.8.0&auto=format&s=7d49b516bbfe784d95d06f2f91d08be6 saved to cache
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7003%252F18907003%252Finterior_front_seats-1774710112310.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7003/18907003/interior_front_seats-1774710112310.jpg not downloaded yet
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7003%252F18907003%252Finterior_rear_seats-1774710084339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7003/18907003/interior_rear_seats-1774710084339.jpg not downloaded yet
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7003%252F18907003%252Finterior_dashboard-1774776699664.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7003/18907003/interior_dashboard-1774776699664.jpg not downloaded yet
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90edd50>
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2141%252F20302141%252Fexterior_rear_driver-1773747944476.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_rear_driver-1773747944476.jpg saved to cache
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4452ee70-858c-5e9c-b16a-d470f37269b2
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7003%252F18907003%252Finstrument_cluster-1774710271958.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7003/18907003/instrument_cluster-1774710271958.jpg not downloaded yet
2026-03-29 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8231/20368231/interior_dashboard-1774695443939.jpg> (referer: None)
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7003%252F18907003%252Finterior_boot-1774710021224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7003/18907003/interior_boot-1774710021224.jpg not downloaded yet
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7003%252F18907003%252Fdocs_service_history-1774710423151.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D31ae7aed0d5cd4998a10039e4a7dcc9e%27 HTTP/1.1" 200 None
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7003/18907003/docs_service_history-1774710423151.jpg?ixlib=js-3.8.0&auto=format&s=31ae7aed0d5cd4998a10039e4a7dcc9e not downloaded yet
2026-03-29 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_front_driver-1774437332701.jpg> (referer: None)
2026-03-29 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_front_passenger-1774437324999.jpg> (referer: None)
2026-03-29 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8231/20368231/damage_scratches-1774694956938.jpg> (referer: None)
2026-03-29 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8231/20368231/interior_rear_seats-1774695398281.jpg> (referer: None)
2026-03-29 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8231/20368231/interior_front_seats-1774695386581.jpg> (referer: None)
2026-03-29 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2141/20302141/interior_front_seats-1774630384051.jpg> (referer: None)
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9208650>
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F20368231%252Finterior_dashboard-1774695443939.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/20368231/interior_dashboard-1774695443939.jpg saved to cache
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f920b590>
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2141%252F20302141%252Fexterior_front_driver-1774437332701.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_front_driver-1774437332701.jpg saved to cache
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4452ee70-858c-5e9c-b16a-d470f37269b2
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae73b10>
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2141%252F20302141%252Fexterior_front_passenger-1774437324999.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_front_passenger-1774437324999.jpg saved to cache
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4452ee70-858c-5e9c-b16a-d470f37269b2
2026-03-29 20:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a32c90>
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8231%252F20368231%252Fdamage_scratches-1774694956938.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8231/20368231/damage_scratches-1774694956938.jpg saved to cache
2026-03-29 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d
2026-03-29 20:02:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93e1e10>
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8231%252F20368231%252Finterior_rear_seats-1774695398281.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8231/20368231/interior_rear_seats-1774695398281.jpg saved to cache
2026-03-29 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9308fd0>
2026-03-29 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8231%252F20368231%252Finterior_front_seats-1774695386581.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8231/20368231/interior_front_seats-1774695386581.jpg saved to cache
2026-03-29 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x0f\x00\x00'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xb8\x0b\x00\x00'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'Galaxy Z Fold5\x00'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 194 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 202 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 210 - value: b'F946BXXS6FZB6\x00'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 224 - value: b'2026:03:27 13:14:09\x00'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xf4\x00\x00\x00'
2026-03-29 20:02:05 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\xee\x02\x00\x00'
2026-03-29 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f925ba90>
2026-03-29 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2141%252F20302141%252Finterior_front_seats-1774630384051.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2141/20302141/interior_front_seats-1774630384051.jpg saved to cache
2026-03-29 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4452ee70-858c-5e9c-b16a-d470f37269b2
2026-03-29 20:02:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4452ee70-858c-5e9c-b16a-d470f37269b2, skipping ID generation
2026-03-29 20:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4452ee70-858c-5e9c-b16a-d470f37269b2 with scrape type 1
2026-03-29 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4452ee70-858c-5e9c-b16a-d470f37269b2 sending to next pipeline
2026-03-29 20:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4452ee70-858c-5e9c-b16a-d470f37269b2, identifier: 20302141
2026-03-29 20:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4452ee70-858c-5e9c-b16a-d470f37269b2 with identifier: 20302141
2026-03-29 20:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4452ee70-858c-5e9c-b16a-d470f37269b2 with identifier: 20302141
2026-03-29 20:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4452ee70-858c-5e9c-b16a-d470f37269b2 with identifier: 20302141 to the API
2026-03-29 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2141/20302141/interior_front_seats-1774630384051.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '4452ee70-858c-5e9c-b16a-d470f37269b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LS68 HSA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20302141',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 78744,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2439204,
'Height': 2798,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_front_driver-1774437332701.jpg',
'Width': 3731},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1210116,
'Height': 2235,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_rear_driver-1773747944476.jpg',
'Width': 2980},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2176633,
'Height': 2933,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_front_passenger-1774437324999.jpg',
'Width': 3911},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1014219,
'Height': 2245,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2141/20302141/exterior_rear_passenger-1773748391959.jpg',
'Width': 2993},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4599490,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/2141/20302141/interior_front_seats-1774630384051.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5111053,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/2141/20302141/interior_rear_seats-1774437341089.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2683158,
'Height': 3000,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2141/20302141/interior_dashboard-1774709695795.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1650248,
'Height': 2581,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2141/20302141/instrument_cluster-1774690348043.jpg',
'Width': 3442},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4502212,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/2141/20302141/interior_boot-1774442193806.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4452ee70-858c-5e9c-b16a-d470f37269b2/4452ee70-858c-5e9c-b16a-d470f37269b2_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 61887,
'Height': 156,
'OriginUrl': 'https://motorway-photos.imgix.net/2141/20302141/damage_scratches-1774273521224.png',
'Width': 389}],
'price': 10545,
'price_includes_vat': False,
'registration_date': '2018-09-29',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 250 AMG Line Auto',
'transmission': 'automatic',
'trim': 'A 250 AMG Line Auto',
'vin': 'WDD1770462J030046',
'year': 2018}
2026-03-29 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720302141%27 HTTP/1.1" 200 None
2026-03-29 20:02:06 [motorway.uk] INFO: Saving data for 20302141: {'created_time': 1774814526.398027, 'last_price_update_time': 1774814526.398042, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20302141') HTTP/1.1" 204 0
2026-03-29 20:02:06 [scrapy.extensions.logstats] INFO: Crawled 92 pages (at 42 pages/min), scraped 38 items (at 25 items/min)
2026-03-29 20:02:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 278MiB
2026-03-29 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8231/20368231/interior_boot-1774695458189.jpg> (referer: None)
2026-03-29 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_rear_passenger-1774694882886.jpg> (referer: None)
2026-03-29 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_front_passenger-1774709438762.jpg> (referer: None)
2026-03-29 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_front_passenger-1774697666218.jpeg> (referer: None)
2026-03-29 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_rear_passenger-1774697676081.jpeg> (referer: None)
2026-03-29 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7003/18907003/instrument_cluster-1774710271958.jpg> (referer: None)
2026-03-29 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_front_driver-1774697654205.jpeg> (referer: None)
2026-03-29 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7003/18907003/interior_boot-1774710021224.jpg> (referer: None)
2026-03-29 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_rear_driver-1774697695819.jpeg> (referer: None)
2026-03-29 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8324/10538324/interior_dashboard-1774697987831.jpeg> (referer: None)
2026-03-29 20:02:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa7db50>
2026-03-29 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8231%252F20368231%252Finterior_boot-1774695458189.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8231/20368231/interior_boot-1774695458189.jpg saved to cache
2026-03-29 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d
2026-03-29 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa7cd90>
2026-03-29 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F20368231%252Fexterior_rear_passenger-1774694882886.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_rear_passenger-1774694882886.jpg saved to cache
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9163c50>
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7003%252F18907003%252Fexterior_front_passenger-1774709438762.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_front_passenger-1774709438762.jpg saved to cache
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8fbb710>
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8324%252F10538324%252Fexterior_front_passenger-1774697666218.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_front_passenger-1774697666218.jpeg saved to cache
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9160710>
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8324%252F10538324%252Fexterior_rear_passenger-1774697676081.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_rear_passenger-1774697676081.jpeg saved to cache
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4
2026-03-29 20:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabb7190>
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7003%252F18907003%252Finstrument_cluster-1774710271958.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7003/18907003/instrument_cluster-1774710271958.jpg saved to cache
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9054790>
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8324%252F10538324%252Fexterior_front_driver-1774697654205.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_front_driver-1774697654205.jpeg saved to cache
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4
2026-03-29 20:02:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8bff350>
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7003%252F18907003%252Finterior_boot-1774710021224.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7003/18907003/interior_boot-1774710021224.jpg saved to cache
2026-03-29 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9688450>
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8324%252F10538324%252Fexterior_rear_driver-1774697695819.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_rear_driver-1774697695819.jpeg saved to cache
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94c1690>
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8324%252F10538324%252Finterior_dashboard-1774697987831.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8324/10538324/interior_dashboard-1774697987831.jpeg saved to cache
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4
2026-03-29 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7003/18907003/interior_dashboard-1774776699664.jpg> (referer: None)
2026-03-29 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_rear_passenger-1774709411375.jpg> (referer: None)
2026-03-29 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_rear_driver-1774709261392.jpg> (referer: None)
2026-03-29 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7003/18907003/docs_service_history-1774710423151.jpg?ixlib=js-3.8.0&auto=format&s=31ae7aed0d5cd4998a10039e4a7dcc9e> (referer: None)
2026-03-29 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7003/18907003/interior_rear_seats-1774710084339.jpg> (referer: None)
2026-03-29 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7003/18907003/interior_front_seats-1774710112310.jpg> (referer: None)
2026-03-29 20:02:08 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12464290) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8324/10538324/interior_boot-1774698004360.jpeg>.
2026-03-29 20:02:08 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (16074196) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8324/10538324/interior_front_seats-1774697864788.jpeg>.
2026-03-29 20:02:08 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (16904002) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8324/10538324/interior_rear_seats-1774698281012.jpeg>.
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f968a610>
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7003%252F18907003%252Finterior_dashboard-1774776699664.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7003/18907003/interior_dashboard-1774776699664.jpg saved to cache
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d1a90>
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7003%252F18907003%252Fexterior_rear_passenger-1774709411375.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_rear_passenger-1774709411375.jpg saved to cache
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facc3c90>
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7003%252F18907003%252Fexterior_rear_driver-1774709261392.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_rear_driver-1774709261392.jpg saved to cache
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9261a50>
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7003%252F18907003%252Fdocs_service_history-1774710423151.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D31ae7aed0d5cd4998a10039e4a7dcc9e') HTTP/1.1" 204 0
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7003/18907003/docs_service_history-1774710423151.jpg?ixlib=js-3.8.0&auto=format&s=31ae7aed0d5cd4998a10039e4a7dcc9e saved to cache
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9619450>
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7003%252F18907003%252Finterior_rear_seats-1774710084339.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7003/18907003/interior_rear_seats-1774710084339.jpg saved to cache
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9260250>
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7003%252F18907003%252Finterior_front_seats-1774710112310.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7003/18907003/interior_front_seats-1774710112310.jpg saved to cache
2026-03-29 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979
2026-03-29 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19374986.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6896/20486896/interior_rear_seats-1774700241340.jpg> (referer: None)
2026-03-29 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_front_driver-1774708572684.jpg> (referer: None)
2026-03-29 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8324/10538324/docs_service_history-1774699525936.jpeg?ixlib=js-3.8.0&auto=format&s=8cf7e99d85c84224dc59df1551dbfc78> (referer: None)
2026-03-29 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_rear_driver-1774694821009.jpg> (referer: None)
2026-03-29 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_front_passenger-1774694895966.jpg> (referer: None)
2026-03-29 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_front_driver-1774694801482.jpg> (referer: None)
2026-03-29 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_front_passenger-1774792122805.jpg> (referer: None)
2026-03-29 20:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8c73554-3775-557f-9e8a-04e21eca55b1 with identifier: 19374986
2026-03-29 20:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8c73554-3775-557f-9e8a-04e21eca55b1 with scrape type 1
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8c73554-3775-557f-9e8a-04e21eca55b1
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4986%252F19374986%252Fexterior_front_driver-1774690960808.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4986/19374986/exterior_front_driver-1774690960808.jpg not downloaded yet
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4986%252F19374986%252Fexterior_rear_driver-1774690998020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4986/19374986/exterior_rear_driver-1774690998020.jpg not downloaded yet
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4986%252F19374986%252F19374986-exterior_front_passenger-modified-1774693082023.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4986/19374986/19374986-exterior_front_passenger-modified-1774693082023.jpeg not downloaded yet
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac93750>
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6896%252F20486896%252Finterior_rear_seats-1774700241340.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6896/20486896/interior_rear_seats-1774700241340.jpg saved to cache
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90d5250>
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7003%252F18907003%252Fexterior_front_driver-1774708572684.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_front_driver-1774708572684.jpg saved to cache
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979
2026-03-29 20:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979, skipping ID generation
2026-03-29 20:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979 with scrape type 1
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979 sending to next pipeline
2026-03-29 20:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979, identifier: 18907003
2026-03-29 20:02:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:02:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010d9790>
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8324%252F10538324%252Fdocs_service_history-1774699525936.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8cf7e99d85c84224dc59df1551dbfc78') HTTP/1.1" 204 0
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8324/10538324/docs_service_history-1774699525936.jpeg?ixlib=js-3.8.0&auto=format&s=8cf7e99d85c84224dc59df1551dbfc78 saved to cache
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94c3dd0>
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F20368231%252Fexterior_rear_driver-1774694821009.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_rear_driver-1774694821009.jpg saved to cache
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8acfb50>
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F20368231%252Fexterior_front_passenger-1774694895966.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_front_passenger-1774694895966.jpg saved to cache
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4986%252F19374986%252Fexterior_rear_passenger-1774690990272.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4986/19374986/exterior_rear_passenger-1774690990272.jpg not downloaded yet
2026-03-29 20:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979 with identifier: 18907003
2026-03-29 20:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979 with identifier: 18907003
2026-03-29 20:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 881d5ae3-e74f-5651-b8ef-ea5aeaf4a979 with identifier: 18907003 to the API
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_front_driver-1774708572684.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '881d5ae3-e74f-5651-b8ef-ea5aeaf4a979',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LA17 XWF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18907003',
'listing': 'auction',
'location': 'Kent Whitstable',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 45500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1614724,
'Height': 2537,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_front_driver-1774708572684.jpg',
'Width': 3382},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1509091,
'Height': 2592,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_rear_driver-1774709261392.jpg',
'Width': 3456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1389449,
'Height': 2441,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_front_passenger-1774709438762.jpg',
'Width': 3254},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1543630,
'Height': 2631,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7003/18907003/exterior_rear_passenger-1774709411375.jpg',
'Width': 3508},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3169169,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7003/18907003/interior_front_seats-1774710112310.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2987480,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7003/18907003/interior_rear_seats-1774710084339.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1373711,
'Height': 2210,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7003/18907003/interior_dashboard-1774776699664.jpg',
'Width': 2947},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2658352,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7003/18907003/instrument_cluster-1774710271958.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3503026,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7003/18907003/interior_boot-1774710021224.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_881d5ae3-e74f-5651-b8ef-ea5aeaf4a979/881d5ae3-e74f-5651-b8ef-ea5aeaf4a979_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2564985,
'Height': 2904,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7003/18907003/docs_service_history-1774710423151.jpg?ixlib=js-3.8.0&auto=format&s=31ae7aed0d5cd4998a10039e4a7dcc9e',
'Width': 1912}],
'price': 13264,
'price_includes_vat': False,
'registration_date': '2017-07-17',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Velar SE D240 Auto',
'transmission': 'automatic',
'trim': 'Velar SE D240 Auto',
'vin': 'SALYA2AN3JA706082',
'year': 2017}
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718907003%27 HTTP/1.1" 200 None
2026-03-29 20:02:10 [motorway.uk] INFO: Saving data for 18907003: {'created_time': 1774814530.357277, 'last_price_update_time': 1774814530.357288, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18907003') HTTP/1.1" 204 0
2026-03-29 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca05d0>
2026-03-29 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F20368231%252Fexterior_front_driver-1774694801482.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_front_driver-1774694801482.jpg saved to cache
2026-03-29 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d
2026-03-29 20:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ac3165d9-f6b8-5290-86d7-9aedd9abf26d, skipping ID generation
2026-03-29 20:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d with scrape type 1
2026-03-29 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ac3165d9-f6b8-5290-86d7-9aedd9abf26d sending to next pipeline
2026-03-29 20:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ac3165d9-f6b8-5290-86d7-9aedd9abf26d, identifier: 20368231
2026-03-29 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa194d0>
2026-03-29 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4274%252F20494274%252Fexterior_front_passenger-1774792122805.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_front_passenger-1774792122805.jpg saved to cache
2026-03-29 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ba4deeea-6337-50ef-a7c1-3873e456858c
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4986%252F19374986%252F19374986-interior_front_seats-modified-1774693099658.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4986/19374986/19374986-interior_front_seats-modified-1774693099658.jpeg not downloaded yet
2026-03-29 20:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ac3165d9-f6b8-5290-86d7-9aedd9abf26d with identifier: 20368231
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Red HTTP/1.1" 200 None
2026-03-29 20:02:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ac3165d9-f6b8-5290-86d7-9aedd9abf26d with identifier: 20368231
2026-03-29 20:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ac3165d9-f6b8-5290-86d7-9aedd9abf26d with identifier: 20368231 to the API
2026-03-29 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_front_driver-1774694801482.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ac3165d9-f6b8-5290-86d7-9aedd9abf26d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LT18 ARU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20368231',
'listing': 'auction',
'location': 'Greater London Pinner',
'make': 'Peugeot',
'model': '3008',
'odometer': 51875,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2233782,
'Height': 2759,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_front_driver-1774694801482.jpg',
'Width': 3679},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1848894,
'Height': 2620,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_rear_driver-1774694821009.jpg',
'Width': 3493},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2459051,
'Height': 2790,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_front_passenger-1774694895966.jpg',
'Width': 3720},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1972841,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8231/20368231/exterior_rear_passenger-1774694882886.jpg',
'Width': 3454},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3744940,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8231/20368231/interior_front_seats-1774695386581.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3307360,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8231/20368231/interior_rear_seats-1774695398281.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1881199,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8231/20368231/interior_dashboard-1774695443939.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4300243,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8231/20368231/interior_boot-1774695458189.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 970159,
'Height': 3316,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8231/20368231/docs_service_history-1774697613993.jpg?ixlib=js-3.8.0&auto=format&s=7d49b516bbfe784d95d06f2f91d08be6',
'Width': 2487},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac3165d9-f6b8-5290-86d7-9aedd9abf26d/ac3165d9-f6b8-5290-86d7-9aedd9abf26d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3252941,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8231/20368231/damage_scratches-1774694956938.jpg',
'Width': 4032}],
'price': 7687,
'price_includes_vat': False,
'registration_date': '2018-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 3008 Allure S/S Auto',
'transmission': 'automatic',
'trim': 'Allure S/S Auto',
'vin': 'VF3MRHNYWJS181843',
'year': 2018}
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720368231%27 HTTP/1.1" 200 None
2026-03-29 20:02:11 [motorway.uk] INFO: Saving data for 20368231: {'created_time': 1774814531.459734, 'last_price_update_time': 1774814531.459745, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20368231') HTTP/1.1" 204 0
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4986%252F19374986%252Finterior_rear_seats-1774691233864.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4986/19374986/interior_rear_seats-1774691233864.jpg not downloaded yet
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4986%252F19374986%252F19374986-interior_dashboard-modified-1774693111820.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4986/19374986/19374986-interior_dashboard-modified-1774693111820.jpeg not downloaded yet
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4986%252F19374986%252F19374986-instrument_cluster-modified-1774693275018.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4986/19374986/19374986-instrument_cluster-modified-1774693275018.jpeg not downloaded yet
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4986%252F19374986%252Finterior_boot-1774691307468.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4986/19374986/interior_boot-1774691307468.jpg not downloaded yet
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4986%252F19374986%252Fdamage_scratches-1774691471928.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4986/19374986/damage_scratches-1774691471928.jpg not downloaded yet
2026-03-29 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6896/20486896/interior_front_seats-1774700240590.jpg> (referer: None)
2026-03-29 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_rear_driver-1774792065177.jpg> (referer: None)
2026-03-29 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6896/20486896/exterior_rear_passenger-1774700008504.jpg> (referer: None)
2026-03-29 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_rear_passenger-1774706898784.jpg> (referer: None)
2026-03-29 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9379/20489379/interior_front_seats-1774707220001.jpg> (referer: None)
2026-03-29 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6137/20346137/damage_scratches-1774713912775.jpg> (referer: None)
2026-03-29 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4986/19374986/exterior_front_driver-1774690960808.jpg> (referer: None)
2026-03-29 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8324/10538324/instrument_cluster-1774698022129.jpeg> (referer: None)
2026-03-29 20:02:11 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8324/10538324/interior_rear_seats-1774698281012.jpeg>.
2026-03-29 20:02:11 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8324/10538324/interior_front_seats-1774697864788.jpeg>.
2026-03-29 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90eef50>
2026-03-29 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6896%252F20486896%252Finterior_front_seats-1774700240590.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6896/20486896/interior_front_seats-1774700240590.jpg saved to cache
2026-03-29 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef
2026-03-29 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f909b350>
2026-03-29 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4274%252F20494274%252Fexterior_rear_driver-1774792065177.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_rear_driver-1774792065177.jpg saved to cache
2026-03-29 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ba4deeea-6337-50ef-a7c1-3873e456858c
2026-03-29 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94ca190>
2026-03-29 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6896%252F20486896%252Fexterior_rear_passenger-1774700008504.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6896/20486896/exterior_rear_passenger-1774700008504.jpg saved to cache
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8806c10>
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9379%252F20489379%252Fexterior_rear_passenger-1774706898784.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_rear_passenger-1774706898784.jpg saved to cache
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19
2026-03-29 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f10fd0>
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9379%252F20489379%252Finterior_front_seats-1774707220001.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9379/20489379/interior_front_seats-1774707220001.jpg saved to cache
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19
2026-03-29 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9309a90>
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6137%252F20346137%252Fdamage_scratches-1774713912775.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6137/20346137/damage_scratches-1774713912775.jpg saved to cache
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabd0790>
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4986%252F19374986%252Fexterior_front_driver-1774690960808.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4986/19374986/exterior_front_driver-1774690960808.jpg saved to cache
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8c73554-3775-557f-9e8a-04e21eca55b1
2026-03-29 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x92\xdbJ\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07\x0f\xed\x00\x92\xd0\xba\x00\x00\x00\x00'
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac1cd10>
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8324%252F10538324%252Finstrument_cluster-1774698022129.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8324/10538324/instrument_cluster-1774698022129.jpeg saved to cache
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4
2026-03-29 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4986/19374986/exterior_rear_driver-1774690998020.jpg> (referer: None)
2026-03-29 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4986/19374986/exterior_rear_passenger-1774690990272.jpg> (referer: None)
2026-03-29 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4986/19374986/damage_scratches-1774691471928.jpg> (referer: None)
2026-03-29 20:02:12 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8324/10538324/interior_boot-1774698004360.jpeg>.
2026-03-29 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4986/19374986/19374986-instrument_cluster-modified-1774693275018.jpeg> (referer: None)
2026-03-29 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6137/20346137/docs_service_history-1774715075472.jpg?ixlib=js-3.8.0&auto=format&s=67efdcafbff479a560d68be5663b9c91> (referer: None)
2026-03-29 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4986/19374986/19374986-exterior_front_passenger-modified-1774693082023.jpeg> (referer: None)
2026-03-29 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4986/19374986/interior_boot-1774691307468.jpg> (referer: None)
2026-03-29 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8324/10538324/interior_boot-1774698004360.jpeg> (referer: None)
2026-03-29 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8324/10538324/interior_front_seats-1774697864788.jpeg> (referer: None)
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e62910>
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4986%252F19374986%252Fexterior_rear_driver-1774690998020.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4986/19374986/exterior_rear_driver-1774690998020.jpg saved to cache
2026-03-29 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8c73554-3775-557f-9e8a-04e21eca55b1
2026-03-29 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4986/19374986/19374986-interior_front_seats-modified-1774693099658.jpeg> (referer: None)
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e6f390>
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4986%252F19374986%252Fexterior_rear_passenger-1774690990272.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4986/19374986/exterior_rear_passenger-1774690990272.jpg saved to cache
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8c73554-3775-557f-9e8a-04e21eca55b1
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8acea10>
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4986%252F19374986%252Fdamage_scratches-1774691471928.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4986/19374986/damage_scratches-1774691471928.jpg saved to cache
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b8c73554-3775-557f-9e8a-04e21eca55b1
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e6e090>
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4986%252F19374986%252F19374986-instrument_cluster-modified-1774693275018.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4986/19374986/19374986-instrument_cluster-modified-1774693275018.jpeg saved to cache
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8c73554-3775-557f-9e8a-04e21eca55b1
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8acf950>
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6137%252F20346137%252Fdocs_service_history-1774715075472.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D67efdcafbff479a560d68be5663b9c91') HTTP/1.1" 204 0
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6137/20346137/docs_service_history-1774715075472.jpg?ixlib=js-3.8.0&auto=format&s=67efdcafbff479a560d68be5663b9c91 saved to cache
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8acdd90>
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4986%252F19374986%252F19374986-exterior_front_passenger-modified-1774693082023.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4986/19374986/19374986-exterior_front_passenger-modified-1774693082023.jpeg saved to cache
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8c73554-3775-557f-9e8a-04e21eca55b1
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ddd250>
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4986%252F19374986%252Finterior_boot-1774691307468.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4986/19374986/interior_boot-1774691307468.jpg saved to cache
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b8c73554-3775-557f-9e8a-04e21eca55b1
2026-03-29 20:02:13 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:02:13 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:02:13 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xb54\x15\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xfc\x8d\x00\xb5)\x85\x00\x00\x00\x00'
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d7c710>
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8324%252F10538324%252Finterior_boot-1774698004360.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8324/10538324/interior_boot-1774698004360.jpeg saved to cache
2026-03-29 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4
2026-03-29 20:02:13 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:02:13 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:02:13 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xeb\xf9W\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\tL}\x00\xeb\xee\xc7\x00\x00\x00\x00'
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8acdd10>
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8324%252F10538324%252Finterior_front_seats-1774697864788.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8324/10538324/interior_front_seats-1774697864788.jpeg saved to cache
2026-03-29 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4
2026-03-29 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8324/10538324/interior_rear_seats-1774698281012.jpeg> (referer: None)
2026-03-29 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f932c890>
2026-03-29 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4986%252F19374986%252F19374986-interior_front_seats-modified-1774693099658.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4986/19374986/19374986-interior_front_seats-modified-1774693099658.jpeg saved to cache
2026-03-29 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8c73554-3775-557f-9e8a-04e21eca55b1
2026-03-29 20:02:14 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:02:14 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:02:14 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xf8\x06@\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\t\xe9\x02\x00\xf7\xfb\xb0\x00\x00\x00\x00'
2026-03-29 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0a3f90>
2026-03-29 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8324%252F10538324%252Finterior_rear_seats-1774698281012.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8324/10538324/interior_rear_seats-1774698281012.jpeg saved to cache
2026-03-29 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4
2026-03-29 20:02:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e2465ce-820f-5388-98d5-42f23c6f7aa4, skipping ID generation
2026-03-29 20:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4 with scrape type 1
2026-03-29 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e2465ce-820f-5388-98d5-42f23c6f7aa4 sending to next pipeline
2026-03-29 20:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8e2465ce-820f-5388-98d5-42f23c6f7aa4, identifier: 10538324
2026-03-29 20:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8e2465ce-820f-5388-98d5-42f23c6f7aa4 with identifier: 10538324
2026-03-29 20:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8e2465ce-820f-5388-98d5-42f23c6f7aa4 with identifier: 10538324
2026-03-29 20:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8e2465ce-820f-5388-98d5-42f23c6f7aa4 with identifier: 10538324 to the API
2026-03-29 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8324/10538324/interior_rear_seats-1774698281012.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '8e2465ce-820f-5388-98d5-42f23c6f7aa4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BX69 UPR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10538324',
'listing': 'auction',
'location': 'Essex Epping',
'make': 'BMW',
'model': 'X2',
'odometer': 58156,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6198999,
'Height': 5456,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_front_driver-1774697654205.jpeg',
'Width': 7274},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6107568,
'Height': 5358,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_rear_driver-1774697695819.jpeg',
'Width': 7144},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5741482,
'Height': 5141,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_front_passenger-1774697666218.jpeg',
'Width': 6854},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7088333,
'Height': 5618,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8324/10538324/exterior_rear_passenger-1774697676081.jpeg',
'Width': 7490},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 16074196,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8324/10538324/interior_front_seats-1774697864788.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 16904002,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8324/10538324/interior_rear_seats-1774698281012.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5523136,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8324/10538324/interior_dashboard-1774697987831.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 10087223,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8324/10538324/instrument_cluster-1774698022129.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 12464290,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8324/10538324/interior_boot-1774698004360.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e2465ce-820f-5388-98d5-42f23c6f7aa4/8e2465ce-820f-5388-98d5-42f23c6f7aa4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2431459,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8324/10538324/docs_service_history-1774699525936.jpeg?ixlib=js-3.8.0&auto=format&s=8cf7e99d85c84224dc59df1551dbfc78',
'Width': 4032}],
'price': 12999,
'price_includes_vat': False,
'registration_date': '2020-02-28',
'seats_number': None,
'seller_name': None,
'title': 'BMW X2 XDRIVE20I Sport Auto',
'transmission': 'automatic',
'trim': 'XDRIVE20I Sport Auto',
'vin': 'WBAYH520505R06957',
'year': 2020}
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710538324%27 HTTP/1.1" 200 None
2026-03-29 20:02:15 [motorway.uk] INFO: Saving data for 10538324: {'created_time': 1774814535.131429, 'last_price_update_time': 1774814535.13144, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10538324') HTTP/1.1" 204 0
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4986/19374986/interior_rear_seats-1774691233864.jpg> (referer: None)
2026-03-29 20:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_front_driver-1774791970418.jpg> (referer: None)
2026-03-29 20:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_rear_driver-1774706886761.jpg> (referer: None)
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6896/20486896/exterior_front_passenger-1774699833800.jpg> (referer: None)
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6896/20486896/exterior_rear_driver-1774699859001.jpg> (referer: None)
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_front_driver-1774706873900.jpg> (referer: None)
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6137/20346137/exterior_rear_passenger-1774713551631.jpg> (referer: None)
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_front_passenger-1774706936710.jpg> (referer: None)
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4986/19374986/19374986-interior_dashboard-modified-1774693111820.jpeg> (referer: None)
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6896/20486896/exterior_front_driver-1774707625226.jpg> (referer: None)
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6137/20346137/interior_front_seats-1774715821085.jpg> (referer: None)
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6137/20346137/interior_dashboard-1774715556972.jpg> (referer: None)
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6137/20346137/interior_boot-1774714880660.jpg> (referer: None)
2026-03-29 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6137/20346137/interior_rear_seats-1774714637173.jpg> (referer: None)
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fe5710>
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4986%252F19374986%252Finterior_rear_seats-1774691233864.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4986/19374986/interior_rear_seats-1774691233864.jpg saved to cache
2026-03-29 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8c73554-3775-557f-9e8a-04e21eca55b1
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f9ec50>
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4274%252F20494274%252Fexterior_front_driver-1774791970418.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_front_driver-1774791970418.jpg saved to cache
2026-03-29 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba4deeea-6337-50ef-a7c1-3873e456858c
2026-03-29 20:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba4deeea-6337-50ef-a7c1-3873e456858c, skipping ID generation
2026-03-29 20:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba4deeea-6337-50ef-a7c1-3873e456858c with scrape type 1
2026-03-29 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba4deeea-6337-50ef-a7c1-3873e456858c sending to next pipeline
2026-03-29 20:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ba4deeea-6337-50ef-a7c1-3873e456858c, identifier: 20494274
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f917aa10>
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9379%252F20489379%252Fexterior_rear_driver-1774706886761.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_rear_driver-1774706886761.jpg saved to cache
2026-03-29 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90a0910>
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6896%252F20486896%252Fexterior_front_passenger-1774699833800.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6896/20486896/exterior_front_passenger-1774699833800.jpg saved to cache
2026-03-29 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa7d890>
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6896%252F20486896%252Fexterior_rear_driver-1774699859001.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6896/20486896/exterior_rear_driver-1774699859001.jpg saved to cache
2026-03-29 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90a0350>
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9379%252F20489379%252Fexterior_front_driver-1774706873900.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_front_driver-1774706873900.jpg saved to cache
2026-03-29 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f958d0>
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6137%252F20346137%252Fexterior_rear_passenger-1774713551631.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6137/20346137/exterior_rear_passenger-1774713551631.jpg saved to cache
2026-03-29 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90a0f90>
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9379%252F20489379%252Fexterior_front_passenger-1774706936710.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_front_passenger-1774706936710.jpg saved to cache
2026-03-29 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19
2026-03-29 20:02:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08468e3a-1f17-5dc4-be2c-91a91fb22b19, skipping ID generation
2026-03-29 20:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19 with scrape type 1
2026-03-29 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08468e3a-1f17-5dc4-be2c-91a91fb22b19 sending to next pipeline
2026-03-29 20:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 08468e3a-1f17-5dc4-be2c-91a91fb22b19, identifier: 20489379
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0ce410>
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4986%252F19374986%252F19374986-interior_dashboard-modified-1774693111820.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4986/19374986/19374986-interior_dashboard-modified-1774693111820.jpeg saved to cache
2026-03-29 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8c73554-3775-557f-9e8a-04e21eca55b1
2026-03-29 20:02:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8c73554-3775-557f-9e8a-04e21eca55b1, skipping ID generation
2026-03-29 20:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8c73554-3775-557f-9e8a-04e21eca55b1 with scrape type 1
2026-03-29 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8c73554-3775-557f-9e8a-04e21eca55b1 sending to next pipeline
2026-03-29 20:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b8c73554-3775-557f-9e8a-04e21eca55b1, identifier: 19374986
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d6a10>
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6896%252F20486896%252Fexterior_front_driver-1774707625226.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6896/20486896/exterior_front_driver-1774707625226.jpg saved to cache
2026-03-29 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef
2026-03-29 20:02:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 564e792f-3a57-5c45-b3b1-29ebc0e950ef, skipping ID generation
2026-03-29 20:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef with scrape type 1
2026-03-29 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 564e792f-3a57-5c45-b3b1-29ebc0e950ef sending to next pipeline
2026-03-29 20:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 564e792f-3a57-5c45-b3b1-29ebc0e950ef, identifier: 20486896
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700deb7d0>
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6137%252F20346137%252Finterior_front_seats-1774715821085.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6137/20346137/interior_front_seats-1774715821085.jpg saved to cache
2026-03-29 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9586ad0>
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6137%252F20346137%252Finterior_dashboard-1774715556972.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6137/20346137/interior_dashboard-1774715556972.jpg saved to cache
2026-03-29 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4
2026-03-29 20:02:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d4910>
2026-03-29 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6137%252F20346137%252Finterior_boot-1774714880660.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6137/20346137/interior_boot-1774714880660.jpg saved to cache
2026-03-29 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4
2026-03-29 20:02:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f13250>
2026-03-29 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6137%252F20346137%252Finterior_rear_seats-1774714637173.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6137/20346137/interior_rear_seats-1774714637173.jpg saved to cache
2026-03-29 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4
2026-03-29 20:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ba4deeea-6337-50ef-a7c1-3873e456858c with identifier: 20494274
2026-03-29 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ba4deeea-6337-50ef-a7c1-3873e456858c with identifier: 20494274
2026-03-29 20:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ba4deeea-6337-50ef-a7c1-3873e456858c with identifier: 20494274 to the API
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_front_driver-1774791970418.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ba4deeea-6337-50ef-a7c1-3873e456858c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MK19 OPS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20494274',
'listing': 'auction',
'location': 'Gloucestershire Cheltenham',
'make': 'Audi',
'model': 'Q3',
'odometer': 48000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1465732,
'Height': 2518,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_front_driver-1774791970418.jpg',
'Width': 3357},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1246796,
'Height': 2328,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_rear_driver-1774792065177.jpg',
'Width': 3104},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1510701,
'Height': 2498,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_front_passenger-1774792122805.jpg',
'Width': 3330},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1365439,
'Height': 2316,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4274/20494274/exterior_rear_passenger-1774792089102.jpg',
'Width': 3088},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3403273,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4274/20494274/interior_front_seats-1774792472605.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3843326,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4274/20494274/interior_rear_seats-1774792491511.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2723737,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4274/20494274/interior_dashboard-1774794427044.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3270770,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4274/20494274/interior_boot-1774792536783.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3338877,
'Height': 2999,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4274/20494274/docs_service_history-1774792759511.jpg?ixlib=js-3.8.0&auto=format&s=54b1dbe1a424ea9ef76acb417e5f59d2',
'Width': 2067},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba4deeea-6337-50ef-a7c1-3873e456858c/ba4deeea-6337-50ef-a7c1-3873e456858c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5158340,
'Height': 3582,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4274/20494274/docs_service_history-1774794025213.jpg?ixlib=js-3.8.0&auto=format&s=087c976951cdd78ce6f719e2e4e589cd',
'Width': 2493}],
'price': 17519,
'price_includes_vat': False,
'registration_date': '2019-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q3 S Line 35 TFSI S-A',
'transmission': 'automatic',
'trim': 'S Line 35 TFSI S-A',
'vin': 'WAUZZZF35K1008253',
'year': 2019}
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720494274%27 HTTP/1.1" 200 None
2026-03-29 20:02:17 [motorway.uk] INFO: Saving data for 20494274: {'created_time': 1774814537.867203, 'last_price_update_time': 1774814537.867214, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20494274') HTTP/1.1" 204 0
2026-03-29 20:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 08468e3a-1f17-5dc4-be2c-91a91fb22b19 with identifier: 20489379
2026-03-29 20:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 08468e3a-1f17-5dc4-be2c-91a91fb22b19 with identifier: 20489379
2026-03-29 20:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 08468e3a-1f17-5dc4-be2c-91a91fb22b19 with identifier: 20489379 to the API
2026-03-29 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_front_passenger-1774706936710.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '08468e3a-1f17-5dc4-be2c-91a91fb22b19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AE18 THU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20489379',
'listing': 'auction',
'location': 'West Midlands Coventry',
'make': 'Peugeot',
'model': '3008',
'odometer': 62091,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2109121,
'Height': 2846,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_front_driver-1774706873900.jpg',
'Width': 3794},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1324563,
'Height': 2329,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_rear_driver-1774706886761.jpg',
'Width': 3105},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1872219,
'Height': 2811,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_front_passenger-1774706936710.jpg',
'Width': 3748},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1702297,
'Height': 2611,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9379/20489379/exterior_rear_passenger-1774706898784.jpg',
'Width': 3481},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3584996,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9379/20489379/interior_front_seats-1774707220001.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3028878,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9379/20489379/interior_rear_seats-1774707233408.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2555195,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9379/20489379/interior_dashboard-1774772484077.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2351343,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9379/20489379/instrument_cluster-1774707321948.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3646725,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9379/20489379/interior_boot-1774707259970.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08468e3a-1f17-5dc4-be2c-91a91fb22b19/08468e3a-1f17-5dc4-be2c-91a91fb22b19_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598503,
'Height': 1893,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9379/20489379/docs_service_history-1774707362535.jpg?ixlib=js-3.8.0&auto=format&s=5f69487b05a9f2b5b1dc1b0fd6c7241c',
'Width': 3377}],
'price': 11101,
'price_includes_vat': False,
'registration_date': '2018-04-24',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 3008 GT BlueHDi S/S Auto',
'transmission': 'automatic',
'trim': 'GT BlueHDi S/S Auto',
'vin': 'VF3MJEHZRJS101363',
'year': 2018}
2026-03-29 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489379%27 HTTP/1.1" 200 None
2026-03-29 20:02:18 [motorway.uk] INFO: Saving data for 20489379: {'created_time': 1774814538.265794, 'last_price_update_time': 1774814538.265804, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20489379') HTTP/1.1" 204 0
2026-03-29 20:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b8c73554-3775-557f-9e8a-04e21eca55b1 with identifier: 19374986
2026-03-29 20:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b8c73554-3775-557f-9e8a-04e21eca55b1 with identifier: 19374986
2026-03-29 20:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b8c73554-3775-557f-9e8a-04e21eca55b1 with identifier: 19374986 to the API
2026-03-29 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/4986/19374986/19374986-interior_dashboard-modified-1774693111820.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': 'b8c73554-3775-557f-9e8a-04e21eca55b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LF23 VOA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19374986',
'listing': 'auction',
'location': 'Merseyside Liverpool',
'make': 'Tesla',
'model': 'Model Y',
'odometer': 56000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 687338,
'Height': 1951,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4986/19374986/exterior_front_driver-1774690960808.jpg',
'Width': 2601},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 616500,
'Height': 1712,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4986/19374986/exterior_rear_driver-1774690998020.jpg',
'Width': 2282},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 711662,
'Height': 1901,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4986/19374986/19374986-exterior_front_passenger-modified-1774693082023.jpeg',
'Width': 2535},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 697460,
'Height': 1997,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4986/19374986/exterior_rear_passenger-1774690990272.jpg',
'Width': 2662},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1823979,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4986/19374986/19374986-interior_front_seats-modified-1774693099658.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1355130,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4986/19374986/interior_rear_seats-1774691233864.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2172168,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4986/19374986/19374986-interior_dashboard-modified-1774693111820.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1211462,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4986/19374986/19374986-instrument_cluster-modified-1774693275018.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2382686,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4986/19374986/interior_boot-1774691307468.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8c73554-3775-557f-9e8a-04e21eca55b1/b8c73554-3775-557f-9e8a-04e21eca55b1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 916818,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/4986/19374986/damage_scratches-1774691471928.jpg',
'Width': 4080}],
'price': 19820,
'price_includes_vat': False,
'registration_date': '2023-03-07',
'seats_number': None,
'seller_name': None,
'title': 'Tesla Model Y Long Range AWD',
'transmission': 'automatic',
'trim': 'Long Range AWD',
'vin': 'LRWYHCEK7PC727004',
'year': 2023}
2026-03-29 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719374986%27 HTTP/1.1" 200 None
2026-03-29 20:02:18 [motorway.uk] INFO: Saving data for 19374986: {'created_time': 1774814538.680262, 'last_price_update_time': 1774814538.680274, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19374986') HTTP/1.1" 204 0
2026-03-29 20:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 564e792f-3a57-5c45-b3b1-29ebc0e950ef with identifier: 20486896
2026-03-29 20:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 564e792f-3a57-5c45-b3b1-29ebc0e950ef with identifier: 20486896
2026-03-29 20:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 564e792f-3a57-5c45-b3b1-29ebc0e950ef with identifier: 20486896 to the API
2026-03-29 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/6896/20486896/exterior_front_driver-1774707625226.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '564e792f-3a57-5c45-b3b1-29ebc0e950ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AX69 PLF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20486896',
'listing': 'auction',
'location': 'None None',
'make': 'Porsche',
'model': 'Macan',
'odometer': 43400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1944649,
'Height': 2723,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6896/20486896/exterior_front_driver-1774707625226.jpg',
'Width': 3631},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1404901,
'Height': 2529,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6896/20486896/exterior_rear_driver-1774699859001.jpg',
'Width': 3372},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1338295,
'Height': 2461,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6896/20486896/exterior_front_passenger-1774699833800.jpg',
'Width': 3281},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1413989,
'Height': 2494,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6896/20486896/exterior_rear_passenger-1774700008504.jpg',
'Width': 3325},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1565961,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6896/20486896/interior_front_seats-1774700240590.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1401482,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6896/20486896/interior_rear_seats-1774700241340.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1538137,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6896/20486896/interior_dashboard-1774707425709.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1741342,
'Height': 2656,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6896/20486896/interior_boot-1774707438601.jpg',
'Width': 3542},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 645854,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6896/20486896/docs_service_history-1774700334671.jpg?ixlib=js-3.8.0&auto=format&s=7c384b0808732b7a60f7d0f4cd2fecbb',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_564e792f-3a57-5c45-b3b1-29ebc0e950ef/564e792f-3a57-5c45-b3b1-29ebc0e950ef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1250749,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6896/20486896/docs_service_history-1774700356608.jpg?ixlib=js-3.8.0&auto=format&s=2456aae304149f6b98f4c49ce8c0ea8f',
'Width': 3840}],
'price': 34183,
'price_includes_vat': False,
'registration_date': '2019-09-02',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Macan S S-A',
'transmission': 'automatic',
'trim': 'S S-A',
'vin': 'WP1ZZZ95ZLLB31080',
'year': 2019}
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486896%27 HTTP/1.1" 200 None
2026-03-29 20:02:19 [motorway.uk] INFO: Saving data for 20486896: {'created_time': 1774814539.12629, 'last_price_update_time': 1774814539.1263, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20486896') HTTP/1.1" 204 0
2026-03-29 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6137/20346137/exterior_front_passenger-1774715965057.jpg> (referer: None)
2026-03-29 20:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8954410>
2026-03-29 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6137%252F20346137%252Fexterior_front_passenger-1774715965057.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6137/20346137/exterior_front_passenger-1774715965057.jpg saved to cache
2026-03-29 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4
2026-03-29 20:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4, skipping ID generation
2026-03-29 20:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4 with scrape type 1
2026-03-29 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4 sending to next pipeline
2026-03-29 20:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4, identifier: 20346137
2026-03-29 20:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4 with identifier: 20346137
2026-03-29 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4 with identifier: 20346137
2026-03-29 20:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9da6ec19-1ba3-5a2a-8da1-469147d5eaa4 with identifier: 20346137 to the API
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/6137/20346137/exterior_front_passenger-1774715965057.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '9da6ec19-1ba3-5a2a-8da1-469147d5eaa4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'Y27 JRS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20346137',
'listing': 'auction',
'location': 'Plymouth Plymouth',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 15000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1240716,
'Height': 2227,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6137/20346137/exterior_front_driver-1774713499435.jpg',
'Width': 2969},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1056312,
'Height': 2318,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6137/20346137/exterior_rear_driver-1774713233010.jpg',
'Width': 3091},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2664057,
'Height': 3002,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6137/20346137/exterior_front_passenger-1774715965057.jpg',
'Width': 4003},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1206959,
'Height': 2222,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6137/20346137/exterior_rear_passenger-1774713551631.jpg',
'Width': 2963},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2214634,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6137/20346137/interior_front_seats-1774715821085.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2346330,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6137/20346137/interior_rear_seats-1774714637173.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2816170,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6137/20346137/interior_dashboard-1774715556972.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5082320,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6137/20346137/interior_boot-1774714880660.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1265886,
'Height': 2508,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6137/20346137/docs_service_history-1774715075472.jpg?ixlib=js-3.8.0&auto=format&s=67efdcafbff479a560d68be5663b9c91',
'Width': 3687},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9da6ec19-1ba3-5a2a-8da1-469147d5eaa4/9da6ec19-1ba3-5a2a-8da1-469147d5eaa4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3117267,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6137/20346137/damage_scratches-1774713912775.jpg',
'Width': 4032}],
'price': 20922,
'price_includes_vat': False,
'registration_date': '2023-07-27',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Kona N Line S HEV S-A',
'transmission': 'automatic',
'trim': 'N Line S HEV S-A',
'vin': 'KMHHB8112RU013272',
'year': 2023}
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720346137%27 HTTP/1.1" 200 None
2026-03-29 20:02:19 [motorway.uk] INFO: Saving data for 20346137: {'created_time': 1774814539.857632, 'last_price_update_time': 1774814539.857643, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20346137') HTTP/1.1" 204 0
2026-03-29 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_rear_passenger-1774699792682.jpg> (referer: None)
2026-03-29 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8396/19998396/interior_front_seats-1774521807768.jpg> (referer: None)
2026-03-29 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6965/20486965/interior_rear_seats-1774700736846.jpg> (referer: None)
2026-03-29 20:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9062/3629062/interior_rear_seats-1774700094119.jpg> (referer: None)
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa1c190>
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9062%252F3629062%252Fexterior_rear_passenger-1774699792682.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_rear_passenger-1774699792682.jpg saved to cache
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7aa56651-1db2-5dc0-80a5-d141f627d833
2026-03-29 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8396/19998396/interior_rear_seats-1774521553541.jpg> (referer: None)
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f912c490>
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8396%252F19998396%252Finterior_front_seats-1774521807768.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8396/19998396/interior_front_seats-1774521807768.jpg saved to cache
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93880d0>
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6965%252F20486965%252Finterior_rear_seats-1774700736846.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6965/20486965/interior_rear_seats-1774700736846.jpg saved to cache
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3b83795-b8da-52c5-adfd-45cceb547866
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89e94d0>
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9062%252F3629062%252Finterior_rear_seats-1774700094119.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9062/3629062/interior_rear_seats-1774700094119.jpg saved to cache
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7aa56651-1db2-5dc0-80a5-d141f627d833
2026-03-29 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=396&page=11&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89ea110>
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8396%252F19998396%252Finterior_rear_seats-1774521553541.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8396/19998396/interior_rear_seats-1774521553541.jpg saved to cache
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97
2026-03-29 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6965/20486965/interior_front_seats-1774700730875.jpg> (referer: None)
2026-03-29 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6997/20436997/exterior_rear_passenger-1774692638902.jpg> (referer: None)
2026-03-29 20:02:20 [motorway.uk] INFO: Found listing with ID: 18237479
2026-03-29 20:02:20 [motorway.uk] INFO: Found listing with ID: 20424370
2026-03-29 20:02:20 [motorway.uk] INFO: Found listing with ID: 10385844
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710385844%27 HTTP/1.1" 200 None
2026-03-29 20:02:20 [motorway.uk] INFO: Scrape type for 10385844: 1
2026-03-29 20:02:20 [motorway.uk] INFO: Found listing with ID: 20023878
2026-03-29 20:02:20 [motorway.uk] INFO: Found listing with ID: 20463571
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720463571%27 HTTP/1.1" 200 None
2026-03-29 20:02:20 [motorway.uk] INFO: Scrape type for 20463571: 1
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700e53cd0>
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6965%252F20486965%252Finterior_front_seats-1774700730875.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6965/20486965/interior_front_seats-1774700730875.jpg saved to cache
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3b83795-b8da-52c5-adfd-45cceb547866
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac1fc10>
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6997%252F20436997%252Fexterior_rear_passenger-1774692638902.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6997/20436997/exterior_rear_passenger-1774692638902.jpg saved to cache
2026-03-29 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3
2026-03-29 20:02:20 [motorway.uk] INFO: Found listing with ID: 19486980
2026-03-29 20:02:20 [motorway.uk] INFO: Found listing with ID: 7743070
2026-03-29 20:02:20 [motorway.uk] INFO: Found listing with ID: 11675984
2026-03-29 20:02:20 [motorway.uk] INFO: Found listing with ID: 11431082
2026-03-29 20:02:20 [motorway.uk] INFO: Found listing with ID: 20466900
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720466900%27 HTTP/1.1" 200 None
2026-03-29 20:02:20 [motorway.uk] INFO: Scrape type for 20466900: 1
2026-03-29 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_rear_passenger-1774699505758.jpg> (referer: None)
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20422527
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20080388
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 12887188
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20469058
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 19693972
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 19713173
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 19370782
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 19687443
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719687443%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [motorway.uk] INFO: Scrape type for 19687443: 1
2026-03-29 20:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 19280379
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20156431
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720156431%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [motorway.uk] INFO: Scrape type for 20156431: 1
2026-03-29 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9062/3629062/interior_front_seats-1774700093092.jpg> (referer: None)
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700deb8d0>
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6965%252F20486965%252Fexterior_rear_passenger-1774699505758.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_rear_passenger-1774699505758.jpg saved to cache
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3b83795-b8da-52c5-adfd-45cceb547866
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 19905808
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20454140
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20386729
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720386729%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [motorway.uk] INFO: Scrape type for 20386729: 1
2026-03-29 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20462595.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20000898
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20501153
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20416082
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720416082%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [motorway.uk] INFO: Scrape type for 20416082: 1
2026-03-29 20:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_front_passenger-1774699541278.jpg> (referer: None)
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 18349950
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718349950%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [motorway.uk] INFO: Scrape type for 18349950: 1
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f28d10>
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9062%252F3629062%252Finterior_front_seats-1774700093092.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9062/3629062/interior_front_seats-1774700093092.jpg saved to cache
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7aa56651-1db2-5dc0-80a5-d141f627d833
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20300016
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 11716723
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711716723%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [motorway.uk] INFO: Scrape type for 11716723: 1
2026-03-29 20:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20488257
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 8670436
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20266056
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20449935
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20429190
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720429190%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [motorway.uk] INFO: Scrape type for 20429190: 1
2026-03-29 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d with identifier: 20462595
2026-03-29 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d with scrape type 1
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2595%252F20462595%252Fexterior_front_driver-1774699634681.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_front_driver-1774699634681.jpg not downloaded yet
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f0e190>
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6965%252F20486965%252Fexterior_front_passenger-1774699541278.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_front_passenger-1774699541278.jpg saved to cache
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3b83795-b8da-52c5-adfd-45cceb547866
2026-03-29 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6997/20436997/exterior_front_passenger-1774695715920.jpg> (referer: None)
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 20031424
2026-03-29 20:02:21 [motorway.uk] INFO: Found listing with ID: 14826836
2026-03-29 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_rear_passenger-1774520696521.jpg> (referer: None)
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2595%252F20462595%252Fexterior_rear_driver-1774699658775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_rear_driver-1774699658775.jpg not downloaded yet
2026-03-29 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6997/20436997/interior_front_seats-1774693863285.jpg> (referer: None)
2026-03-29 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10813763.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2595%252F20462595%252Fexterior_front_passenger-1774699714820.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_front_passenger-1774699714820.jpg not downloaded yet
2026-03-29 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_rear_driver-1774699786092.jpg> (referer: None)
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2595%252F20462595%252Fexterior_rear_passenger-1774699674485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_rear_passenger-1774699674485.jpg not downloaded yet
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2595%252F20462595%252Finterior_front_seats-1774700653704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2595/20462595/interior_front_seats-1774700653704.jpg not downloaded yet
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2595%252F20462595%252Finterior_rear_seats-1774700672281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2595/20462595/interior_rear_seats-1774700672281.jpg not downloaded yet
2026-03-29 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_front_passenger-1774699788675.jpg> (referer: None)
2026-03-29 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_rear_driver-1774699501519.jpg> (referer: None)
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2595%252F20462595%252Finterior_dashboard-1774700725713.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2595/20462595/interior_dashboard-1774700725713.jpg not downloaded yet
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2595%252F20462595%252Finstrument_cluster-1774700934209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2595/20462595/instrument_cluster-1774700934209.jpg not downloaded yet
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa30950>
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6997%252F20436997%252Fexterior_front_passenger-1774695715920.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6997/20436997/exterior_front_passenger-1774695715920.jpg saved to cache
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1399d0>
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8396%252F19998396%252Fexterior_rear_passenger-1774520696521.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_rear_passenger-1774520696521.jpg saved to cache
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2595%252F20462595%252Finterior_boot-1774700787314.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2595/20462595/interior_boot-1774700787314.jpg not downloaded yet
2026-03-29 20:02:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ed4910>
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6997%252F20436997%252Finterior_front_seats-1774693863285.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6997/20436997/interior_front_seats-1774693863285.jpg saved to cache
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3
2026-03-29 20:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 844b82ff-98cb-5a98-ab6f-116f74757aea with identifier: 10813763
2026-03-29 20:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 844b82ff-98cb-5a98-ab6f-116f74757aea with scrape type 1
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 844b82ff-98cb-5a98-ab6f-116f74757aea
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3763%252F10813763%252Fexterior_front_driver-1774767272208.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_front_driver-1774767272208.jpg not downloaded yet
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2595%252F20462595%252Fdocs_service_history-1774701152299.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D012449000a7c94a31ee244571f5d5627%27 HTTP/1.1" 200 None
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2595/20462595/docs_service_history-1774701152299.jpg?ixlib=js-3.8.0&auto=format&s=012449000a7c94a31ee244571f5d5627 not downloaded yet
2026-03-29 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6997/20436997/exterior_rear_driver-1774692628724.jpg> (referer: None)
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3763%252F10813763%252Fexterior_rear_driver-1774768064355.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_rear_driver-1774768064355.jpg not downloaded yet
2026-03-29 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_front_passenger-1774520703417.jpg> (referer: None)
2026-03-29 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20459047.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa23390>
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9062%252F3629062%252Fexterior_rear_driver-1774699786092.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_rear_driver-1774699786092.jpg saved to cache
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7aa56651-1db2-5dc0-80a5-d141f627d833
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f938f3d0>
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9062%252F3629062%252Fexterior_front_passenger-1774699788675.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_front_passenger-1774699788675.jpg saved to cache
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7aa56651-1db2-5dc0-80a5-d141f627d833
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f23590>
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6965%252F20486965%252Fexterior_rear_driver-1774699501519.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_rear_driver-1774699501519.jpg saved to cache
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3b83795-b8da-52c5-adfd-45cceb547866
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3763%252F10813763%252Fexterior_front_passenger-1774767294092.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_front_passenger-1774767294092.jpg not downloaded yet
2026-03-29 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20303922.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20148114.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3763%252F10813763%252Fexterior_rear_passenger-1774767374391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_rear_passenger-1774767374391.jpg not downloaded yet
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3763%252F10813763%252Finterior_front_seats-1774767478412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3763/10813763/interior_front_seats-1774767478412.jpg not downloaded yet
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f870ea83bd0>
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6997%252F20436997%252Fexterior_rear_driver-1774692628724.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6997/20436997/exterior_rear_driver-1774692628724.jpg saved to cache
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa1f0d0>
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8396%252F19998396%252Fexterior_front_passenger-1774520703417.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_front_passenger-1774520703417.jpg saved to cache
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97
2026-03-29 20:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76baecea-2974-5d9c-b3e8-0db824fa2811 with identifier: 20459047
2026-03-29 20:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76baecea-2974-5d9c-b3e8-0db824fa2811 with scrape type 1
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76baecea-2974-5d9c-b3e8-0db824fa2811
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9047%252F20459047%252Fexterior_front_driver-1774712293303.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9047/20459047/exterior_front_driver-1774712293303.jpg not downloaded yet
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3763%252F10813763%252Finterior_rear_seats-1774767544818.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3763/10813763/interior_rear_seats-1774767544818.jpg not downloaded yet
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9047%252F20459047%252Fexterior_rear_driver-1774629411103.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9047/20459047/exterior_rear_driver-1774629411103.jpg not downloaded yet
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3763%252F10813763%252F10813763-interior_dashboard-modified-1774779499460.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3763/10813763/10813763-interior_dashboard-modified-1774779499460.jpeg not downloaded yet
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9047%252F20459047%252Fexterior_front_passenger-1774712363604.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9047/20459047/exterior_front_passenger-1774712363604.jpg not downloaded yet
2026-03-29 20:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96799f3c-010b-59d8-a639-50f5989f76e2 with identifier: 20303922
2026-03-29 20:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96799f3c-010b-59d8-a639-50f5989f76e2 with scrape type 2
2026-03-29 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96799f3c-010b-59d8-a639-50f5989f76e2 with scrape type 2
2026-03-29 20:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 96799f3c-010b-59d8-a639-50f5989f76e2, identifier: 20303922
2026-03-29 20:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3af604eb-b084-520d-bc14-12299771621e with identifier: 20148114
2026-03-29 20:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3af604eb-b084-520d-bc14-12299771621e with scrape type 1
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3af604eb-b084-520d-bc14-12299771621e
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8114%252F20148114%252Fexterior_front_driver-1774699104049.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8114/20148114/exterior_front_driver-1774699104049.jpg not downloaded yet
2026-03-29 20:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 96799f3c-010b-59d8-a639-50f5989f76e2 with identifier: 20303922
2026-03-29 20:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 96799f3c-010b-59d8-a639-50f5989f76e2 with identifier: 20303922
2026-03-29 20:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 96799f3c-010b-59d8-a639-50f5989f76e2 with identifier: 20303922 to the API
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20303922.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '96799f3c-010b-59d8-a639-50f5989f76e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DP70 UMK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20303922',
'listing': 'auction',
'location': 'West Sussex Emsworth',
'make': 'Volkswagen',
'model': 'Transporter',
'odometer': 53000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 21000,
'price_includes_vat': False,
'registration_date': '2020-12-18',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Transporter T28 Highline TDI',
'transmission': 'manual',
'trim': 'T28 Highline TDI',
'vin': 'WV1ZZZ7HZMH038787',
'year': 2020}
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720303922%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [motorway.uk] INFO: Saving data for 20303922: {'auction_closing_time': 1774884600.0, 'created_time': 1774469453.811802, 'last_price_update_time': 1774814543.516205}
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20303922') HTTP/1.1" 204 0
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3763%252F10813763%252Finstrument_cluster-1774767641357.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3763/10813763/instrument_cluster-1774767641357.jpg not downloaded yet
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9047%252F20459047%252Fexterior_rear_passenger-1774712435215.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9047/20459047/exterior_rear_passenger-1774712435215.jpg not downloaded yet
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8114%252F20148114%252Fexterior_rear_driver-1774699123294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8114/20148114/exterior_rear_driver-1774699123294.jpg not downloaded yet
2026-03-29 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20466900.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3763%252F10813763%252Finterior_boot-1774767585564.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3763/10813763/interior_boot-1774767585564.jpg not downloaded yet
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9047%252F20459047%252Finterior_front_seats-1774712461018.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9047/20459047/interior_front_seats-1774712461018.jpg not downloaded yet
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8114%252F20148114%252Fexterior_front_passenger-1774716985545.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8114/20148114/exterior_front_passenger-1774716985545.jpg not downloaded yet
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3763%252F10813763%252F10813763-docs_service_history-default-1774766815740.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df18e7e2c407b97382dcb20a484a8a659%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3763/10813763/10813763-docs_service_history-default-1774766815740.jpg?ixlib=js-3.8.0&auto=format&s=f18e7e2c407b97382dcb20a484a8a659 not downloaded yet
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9047%252F20459047%252Finterior_rear_seats-1774630011876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9047/20459047/interior_rear_seats-1774630011876.jpg not downloaded yet
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8114%252F20148114%252Fexterior_rear_passenger-1774699138265.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8114/20148114/exterior_rear_passenger-1774699138265.jpg not downloaded yet
2026-03-29 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2595/20462595/docs_service_history-1774701152299.jpg?ixlib=js-3.8.0&auto=format&s=012449000a7c94a31ee244571f5d5627> (referer: None)
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9047%252F20459047%252Finterior_dashboard-1774712477675.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9047/20459047/interior_dashboard-1774712477675.jpg not downloaded yet
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8114%252F20148114%252Finterior_front_seats-1774717002595.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8114/20148114/interior_front_seats-1774717002595.jpg not downloaded yet
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9047%252F20459047%252Finterior_boot-1774630088856.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9047/20459047/interior_boot-1774630088856.jpg not downloaded yet
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8114%252F20148114%252Finterior_rear_seats-1774715940513.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8114/20148114/interior_rear_seats-1774715940513.jpg not downloaded yet
2026-03-29 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20156431.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c8a59c-87f1-5768-a213-dfce41ea3a2a with identifier: 20466900
2026-03-29 20:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a with scrape type 1
2026-03-29 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6900%252F20466900%252Fexterior_front_driver-1774709869204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6900/20466900/exterior_front_driver-1774709869204.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9047%252F20459047%252Fwheels_front_driver-1774629542377.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9047/20459047/wheels_front_driver-1774629542377.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8114%252F20148114%252Finterior_dashboard-1774717013822.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8114/20148114/interior_dashboard-1774717013822.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6900%252F20466900%252Fexterior_rear_driver-1774707533947.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6900/20466900/exterior_rear_driver-1774707533947.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9047%252F20459047%252Fwheels_rear_driver-1774629556798.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9047/20459047/wheels_rear_driver-1774629556798.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8114%252F20148114%252Finstrument_cluster-1774716929255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8114/20148114/instrument_cluster-1774716929255.jpg not downloaded yet
2026-03-29 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f968a710>
2026-03-29 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2595%252F20462595%252Fdocs_service_history-1774701152299.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D012449000a7c94a31ee244571f5d5627') HTTP/1.1" 204 0
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2595/20462595/docs_service_history-1774701152299.jpg?ixlib=js-3.8.0&auto=format&s=012449000a7c94a31ee244571f5d5627 saved to cache
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6900%252F20466900%252Fexterior_front_passenger-1774707555446.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6900/20466900/exterior_front_passenger-1774707555446.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8114%252F20148114%252Finterior_boot-1774717051521.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8114/20148114/interior_boot-1774717051521.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6900%252F20466900%252Fexterior_rear_passenger-1774709994545.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6900/20466900/exterior_rear_passenger-1774709994545.jpg not downloaded yet
2026-03-29 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18349950.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8114%252F20148114%252Fdamage_missing_trims-1774717090923.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8114/20148114/damage_missing_trims-1774717090923.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6900%252F20466900%252Finterior_front_seats-1774709395152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6900/20466900/interior_front_seats-1774709395152.jpg not downloaded yet
2026-03-29 20:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67567d47-7123-5980-b07b-ccc6b57a404e with identifier: 20156431
2026-03-29 20:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67567d47-7123-5980-b07b-ccc6b57a404e with scrape type 1
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67567d47-7123-5980-b07b-ccc6b57a404e
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6431%252F20156431%252Fexterior_front_driver-1774704451391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_front_driver-1774704451391.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6900%252F20466900%252Finterior_rear_seats-1774709360256.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6900/20466900/interior_rear_seats-1774709360256.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6431%252F20156431%252Fexterior_rear_driver-1774704446818.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_rear_driver-1774704446818.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6900%252F20466900%252Finterior_dashboard-1774709919487.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6900/20466900/interior_dashboard-1774709919487.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6431%252F20156431%252Fexterior_front_passenger-1774704448995.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_front_passenger-1774704448995.jpg not downloaded yet
2026-03-29 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_front_driver-1774767272208.jpg> (referer: None)
2026-03-29 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3763/10813763/interior_front_seats-1774767478412.jpg> (referer: None)
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6900%252F20466900%252Finstrument_cluster-1774709161571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6900/20466900/instrument_cluster-1774709161571.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6431%252F20156431%252Fexterior_rear_passenger-1774704453515.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_rear_passenger-1774704453515.jpg not downloaded yet
2026-03-29 20:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 117d0b4d-2a8e-5e5d-8208-fe871e00ec99 with identifier: 18349950
2026-03-29 20:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99 with scrape type 1
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9950%252F18349950%252Fexterior_front_driver-1774783506385.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_front_driver-1774783506385.jpg not downloaded yet
2026-03-29 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_front_passenger-1774767294092.jpg> (referer: None)
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6900%252F20466900%252Finterior_boot-1774709321551.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6900/20466900/interior_boot-1774709321551.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6431%252F20156431%252Finterior_front_seats-1774704984999.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6431/20156431/interior_front_seats-1774704984999.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9950%252F18349950%252Fexterior_rear_driver-1774783590797.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_rear_driver-1774783590797.jpg not downloaded yet
2026-03-29 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9047/20459047/exterior_front_driver-1774712293303.jpg> (referer: None)
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6900%252F20466900%252Fdocs_service_history-1774710107149.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df636e36ed469f27d4c8b9f00c7e9c56b%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6900/20466900/docs_service_history-1774710107149.jpg?ixlib=js-3.8.0&auto=format&s=f636e36ed469f27d4c8b9f00c7e9c56b not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6431%252F20156431%252Finterior_rear_seats-1774705024548.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6431/20156431/interior_rear_seats-1774705024548.jpg not downloaded yet
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9950%252F18349950%252Fexterior_front_passenger-1774783531463.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_front_passenger-1774783531463.jpg not downloaded yet
2026-03-29 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9264b90>
2026-03-29 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3763%252F10813763%252Fexterior_front_driver-1774767272208.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_front_driver-1774767272208.jpg saved to cache
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 844b82ff-98cb-5a98-ab6f-116f74757aea
2026-03-29 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a16b90>
2026-03-29 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3763%252F10813763%252Finterior_front_seats-1774767478412.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3763/10813763/interior_front_seats-1774767478412.jpg saved to cache
2026-03-29 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 844b82ff-98cb-5a98-ab6f-116f74757aea
2026-03-29 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2595/20462595/interior_dashboard-1774700725713.jpg> (referer: None)
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6431%252F20156431%252Finterior_dashboard-1774706347154.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6431/20156431/interior_dashboard-1774706347154.jpg not downloaded yet
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9950%252F18349950%252Fexterior_rear_passenger-1774783575697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_rear_passenger-1774783575697.jpg not downloaded yet
2026-03-29 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2595/20462595/instrument_cluster-1774700934209.jpg> (referer: None)
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa1fd90>
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3763%252F10813763%252Fexterior_front_passenger-1774767294092.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_front_passenger-1774767294092.jpg saved to cache
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 844b82ff-98cb-5a98-ab6f-116f74757aea
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6431%252F20156431%252Finterior_boot-1774704986566.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6431/20156431/interior_boot-1774704986566.jpg not downloaded yet
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9950%252F18349950%252Finterior_front_seats-1774783701979.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9950/18349950/interior_front_seats-1774783701979.jpg not downloaded yet
2026-03-29 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_rear_driver-1774768064355.jpg> (referer: None)
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a1b490>
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9047%252F20459047%252Fexterior_front_driver-1774712293303.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9047/20459047/exterior_front_driver-1774712293303.jpg saved to cache
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76baecea-2974-5d9c-b3e8-0db824fa2811
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6431%252F20156431%252Fdamage_scratches-1774704540742.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6431/20156431/damage_scratches-1774704540742.jpg not downloaded yet
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9950%252F18349950%252Finterior_rear_seats-1774783858110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9950/18349950/interior_rear_seats-1774783858110.jpg not downloaded yet
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae2fad0>
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2595%252F20462595%252Finterior_dashboard-1774700725713.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2595/20462595/interior_dashboard-1774700725713.jpg saved to cache
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d
2026-03-29 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_rear_passenger-1774767374391.jpg> (referer: None)
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6431%252F20156431%252Fwheels_front_driver-1774704611158.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6431/20156431/wheels_front_driver-1774704611158.jpg not downloaded yet
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9950%252F18349950%252F18349950-interior_dashboard-modified-1774787345480.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9950/18349950/18349950-interior_dashboard-modified-1774787345480.jpeg not downloaded yet
2026-03-29 20:02:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa00c090>
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2595%252F20462595%252Finstrument_cluster-1774700934209.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2595/20462595/instrument_cluster-1774700934209.jpg saved to cache
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9950%252F18349950%252Finstrument_cluster-1774783911906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9950/18349950/instrument_cluster-1774783911906.jpg not downloaded yet
2026-03-29 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8114/20148114/exterior_rear_driver-1774699123294.jpg> (referer: None)
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9605bd0>
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3763%252F10813763%252Fexterior_rear_driver-1774768064355.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_rear_driver-1774768064355.jpg saved to cache
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 844b82ff-98cb-5a98-ab6f-116f74757aea
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f915b210>
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3763%252F10813763%252Fexterior_rear_passenger-1774767374391.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_rear_passenger-1774767374391.jpg saved to cache
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 844b82ff-98cb-5a98-ab6f-116f74757aea
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9950%252F18349950%252Finterior_boot-1774783933873.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9950/18349950/interior_boot-1774783933873.jpg not downloaded yet
2026-03-29 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8114/20148114/exterior_rear_passenger-1774699138265.jpg> (referer: None)
2026-03-29 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20386729.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9950%252F18349950%252Fdocs_service_history-1774786399086.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd17c945987544bc41d213e23deb93d76%27 HTTP/1.1" 200 None
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9950/18349950/docs_service_history-1774786399086.jpg?ixlib=js-3.8.0&auto=format&s=d17c945987544bc41d213e23deb93d76 not downloaded yet
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabf3590>
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8114%252F20148114%252Fexterior_rear_driver-1774699123294.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8114/20148114/exterior_rear_driver-1774699123294.jpg saved to cache
2026-03-29 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3af604eb-b084-520d-bc14-12299771621e
2026-03-29 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2595/20462595/interior_rear_seats-1774700672281.jpg> (referer: None)
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d54d0>
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8114%252F20148114%252Fexterior_rear_passenger-1774699138265.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8114/20148114/exterior_rear_passenger-1774699138265.jpg saved to cache
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3af604eb-b084-520d-bc14-12299771621e
2026-03-29 20:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b7e7472-4781-5d52-ba1d-10c4356aa559 with identifier: 20386729
2026-03-29 20:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b7e7472-4781-5d52-ba1d-10c4356aa559 with scrape type 1
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b7e7472-4781-5d52-ba1d-10c4356aa559
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6729%252F20386729%252Fexterior_front_driver-1774187461901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_front_driver-1774187461901.jpg not downloaded yet
2026-03-29 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2595/20462595/interior_front_seats-1774700653704.jpg> (referer: None)
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6729%252F20386729%252Fexterior_rear_driver-1774187407967.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_rear_driver-1774187407967.jpg not downloaded yet
2026-03-29 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8114/20148114/interior_front_seats-1774717002595.jpg> (referer: None)
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f18f90>
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2595%252F20462595%252Finterior_rear_seats-1774700672281.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2595/20462595/interior_rear_seats-1774700672281.jpg saved to cache
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6729%252F20386729%252Fexterior_front_passenger-1774187458943.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_front_passenger-1774187458943.jpg not downloaded yet
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6729%252F20386729%252Fexterior_rear_passenger-1774187436625.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_rear_passenger-1774187436625.jpg not downloaded yet
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6729%252F20386729%252Finterior_front_seats-1774188600625.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6729/20386729/interior_front_seats-1774188600625.jpg not downloaded yet
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d30290>
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2595%252F20462595%252Finterior_front_seats-1774700653704.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2595/20462595/interior_front_seats-1774700653704.jpg saved to cache
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a59e50>
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8114%252F20148114%252Finterior_front_seats-1774717002595.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8114/20148114/interior_front_seats-1774717002595.jpg saved to cache
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3af604eb-b084-520d-bc14-12299771621e
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6729%252F20386729%252Finterior_rear_seats-1774188619447.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6729/20386729/interior_rear_seats-1774188619447.jpg not downloaded yet
2026-03-29 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_front_passenger-1774704448995.jpg> (referer: None)
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6729%252F20386729%252Finterior_dashboard-1774188663665.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6729/20386729/interior_dashboard-1774188663665.jpg not downloaded yet
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6729%252F20386729%252Finstrument_cluster-1774188692096.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6729/20386729/instrument_cluster-1774188692096.jpg not downloaded yet
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6729%252F20386729%252Finterior_boot-1774188705044.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6729/20386729/interior_boot-1774188705044.jpg not downloaded yet
2026-03-29 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2595/20462595/interior_boot-1774700787314.jpg> (referer: None)
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6729%252F20386729%252Fdocs_service_history-1774189583638.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc3fd1faf2b55e5bb3a6e082fec82c976%27 HTTP/1.1" 200 None
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6729/20386729/docs_service_history-1774189583638.jpg?ixlib=js-3.8.0&auto=format&s=c3fd1faf2b55e5bb3a6e082fec82c976 not downloaded yet
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8976410>
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6431%252F20156431%252Fexterior_front_passenger-1774704448995.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_front_passenger-1774704448995.jpg saved to cache
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67567d47-7123-5980-b07b-ccc6b57a404e
2026-03-29 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_rear_passenger-1774783575697.jpg> (referer: None)
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9190350>
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2595%252F20462595%252Finterior_boot-1774700787314.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2595/20462595/interior_boot-1774700787314.jpg saved to cache
2026-03-29 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d
2026-03-29 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6431/20156431/wheels_front_driver-1774704611158.jpg> (referer: None)
2026-03-29 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9950/18349950/interior_rear_seats-1774783858110.jpg> (referer: None)
2026-03-29 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6900/20466900/exterior_rear_passenger-1774709994545.jpg> (referer: None)
2026-03-29 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6900/20466900/interior_dashboard-1774709919487.jpg> (referer: None)
2026-03-29 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6431/20156431/interior_boot-1774704986566.jpg> (referer: None)
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafbb110>
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9950%252F18349950%252Fexterior_rear_passenger-1774783575697.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_rear_passenger-1774783575697.jpg saved to cache
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99
2026-03-29 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9950/18349950/interior_front_seats-1774783701979.jpg> (referer: None)
2026-03-29 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6431/20156431/damage_scratches-1774704540742.jpg> (referer: None)
2026-03-29 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9950/18349950/instrument_cluster-1774783911906.jpg> (referer: None)
2026-03-29 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9950/18349950/interior_boot-1774783933873.jpg> (referer: None)
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f938d6d0>
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6431%252F20156431%252Fwheels_front_driver-1774704611158.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6431/20156431/wheels_front_driver-1774704611158.jpg saved to cache
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67567d47-7123-5980-b07b-ccc6b57a404e
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ea4390>
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9950%252F18349950%252Finterior_rear_seats-1774783858110.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9950/18349950/interior_rear_seats-1774783858110.jpg saved to cache
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010da710>
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6900%252F20466900%252Fexterior_rear_passenger-1774709994545.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6900/20466900/exterior_rear_passenger-1774709994545.jpg saved to cache
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9160b10>
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6900%252F20466900%252Finterior_dashboard-1774709919487.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6900/20466900/interior_dashboard-1774709919487.jpg saved to cache
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa15a1d0>
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6431%252F20156431%252Finterior_boot-1774704986566.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6431/20156431/interior_boot-1774704986566.jpg saved to cache
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67567d47-7123-5980-b07b-ccc6b57a404e
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8eb1b10>
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9950%252F18349950%252Finterior_front_seats-1774783701979.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9950/18349950/interior_front_seats-1774783701979.jpg saved to cache
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c03850>
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6431%252F20156431%252Fdamage_scratches-1774704540742.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6431/20156431/damage_scratches-1774704540742.jpg saved to cache
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67567d47-7123-5980-b07b-ccc6b57a404e
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8df9050>
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9950%252F18349950%252Finstrument_cluster-1774783911906.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9950/18349950/instrument_cluster-1774783911906.jpg saved to cache
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99
2026-03-29 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9950/18349950/18349950-interior_dashboard-modified-1774787345480.jpeg> (referer: None)
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabd0790>
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9950%252F18349950%252Finterior_boot-1774783933873.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9950/18349950/interior_boot-1774783933873.jpg saved to cache
2026-03-29 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1f71d0>
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9950%252F18349950%252F18349950-interior_dashboard-modified-1774787345480.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9950/18349950/18349950-interior_dashboard-modified-1774787345480.jpeg saved to cache
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99
2026-03-29 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6900/20466900/docs_service_history-1774710107149.jpg?ixlib=js-3.8.0&auto=format&s=f636e36ed469f27d4c8b9f00c7e9c56b> (referer: None)
2026-03-29 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_rear_passenger-1774187436625.jpg> (referer: None)
2026-03-29 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_front_passenger-1774187458943.jpg> (referer: None)
2026-03-29 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6729/20386729/interior_dashboard-1774188663665.jpg> (referer: None)
2026-03-29 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9950/18349950/docs_service_history-1774786399086.jpg?ixlib=js-3.8.0&auto=format&s=d17c945987544bc41d213e23deb93d76> (referer: None)
2026-03-29 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6729/20386729/instrument_cluster-1774188692096.jpg> (referer: None)
2026-03-29 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6729/20386729/interior_rear_seats-1774188619447.jpg> (referer: None)
2026-03-29 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6729/20386729/interior_front_seats-1774188600625.jpg> (referer: None)
2026-03-29 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6729/20386729/docs_service_history-1774189583638.jpg?ixlib=js-3.8.0&auto=format&s=c3fd1faf2b55e5bb3a6e082fec82c976> (referer: None)
2026-03-29 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6729/20386729/interior_boot-1774188705044.jpg> (referer: None)
2026-03-29 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6431/20156431/interior_dashboard-1774706347154.jpg> (referer: None)
2026-03-29 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_front_passenger-1774783531463.jpg> (referer: None)
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa11b710>
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6900%252F20466900%252Fdocs_service_history-1774710107149.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df636e36ed469f27d4c8b9f00c7e9c56b') HTTP/1.1" 204 0
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6900/20466900/docs_service_history-1774710107149.jpg?ixlib=js-3.8.0&auto=format&s=f636e36ed469f27d4c8b9f00c7e9c56b saved to cache
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f932f690>
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6729%252F20386729%252Fexterior_rear_passenger-1774187436625.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_rear_passenger-1774187436625.jpg saved to cache
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b7e7472-4781-5d52-ba1d-10c4356aa559
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9180550>
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6729%252F20386729%252Fexterior_front_passenger-1774187458943.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_front_passenger-1774187458943.jpg saved to cache
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b7e7472-4781-5d52-ba1d-10c4356aa559
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8adedd0>
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6729%252F20386729%252Finterior_dashboard-1774188663665.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6729/20386729/interior_dashboard-1774188663665.jpg saved to cache
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b7e7472-4781-5d52-ba1d-10c4356aa559
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9275690>
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9950%252F18349950%252Fdocs_service_history-1774786399086.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd17c945987544bc41d213e23deb93d76') HTTP/1.1" 204 0
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9950/18349950/docs_service_history-1774786399086.jpg?ixlib=js-3.8.0&auto=format&s=d17c945987544bc41d213e23deb93d76 saved to cache
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8adc7d0>
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6729%252F20386729%252Finstrument_cluster-1774188692096.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6729/20386729/instrument_cluster-1774188692096.jpg saved to cache
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b7e7472-4781-5d52-ba1d-10c4356aa559
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ca4cd0>
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6729%252F20386729%252Finterior_rear_seats-1774188619447.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6729/20386729/interior_rear_seats-1774188619447.jpg saved to cache
2026-03-29 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b7e7472-4781-5d52-ba1d-10c4356aa559
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa00e850>
2026-03-29 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6729%252F20386729%252Finterior_front_seats-1774188600625.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6729/20386729/interior_front_seats-1774188600625.jpg saved to cache
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b7e7472-4781-5d52-ba1d-10c4356aa559
2026-03-29 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cc8e50>
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6729%252F20386729%252Fdocs_service_history-1774189583638.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc3fd1faf2b55e5bb3a6e082fec82c976') HTTP/1.1" 204 0
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6729/20386729/docs_service_history-1774189583638.jpg?ixlib=js-3.8.0&auto=format&s=c3fd1faf2b55e5bb3a6e082fec82c976 saved to cache
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b7e7472-4781-5d52-ba1d-10c4356aa559
2026-03-29 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8adfe50>
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6729%252F20386729%252Finterior_boot-1774188705044.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6729/20386729/interior_boot-1774188705044.jpg saved to cache
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b7e7472-4781-5d52-ba1d-10c4356aa559
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9182290>
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6431%252F20156431%252Finterior_dashboard-1774706347154.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6431/20156431/interior_dashboard-1774706347154.jpg saved to cache
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67567d47-7123-5980-b07b-ccc6b57a404e
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8adde50>
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9950%252F18349950%252Fexterior_front_passenger-1774783531463.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_front_passenger-1774783531463.jpg saved to cache
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99
2026-03-29 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6431/20156431/interior_rear_seats-1774705024548.jpg> (referer: None)
2026-03-29 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_rear_driver-1774783590797.jpg> (referer: None)
2026-03-29 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_front_driver-1774783506385.jpg> (referer: None)
2026-03-29 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6431/20156431/interior_front_seats-1774704984999.jpg> (referer: None)
2026-03-29 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_rear_driver-1774187407967.jpg> (referer: None)
2026-03-29 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_front_driver-1774187461901.jpg> (referer: None)
2026-03-29 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6900/20466900/interior_boot-1774709321551.jpg> (referer: None)
2026-03-29 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8114/20148114/damage_missing_trims-1774717090923.jpg> (referer: None)
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab3b750>
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6431%252F20156431%252Finterior_rear_seats-1774705024548.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6431/20156431/interior_rear_seats-1774705024548.jpg saved to cache
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67567d47-7123-5980-b07b-ccc6b57a404e
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf01e10>
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9950%252F18349950%252Fexterior_rear_driver-1774783590797.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_rear_driver-1774783590797.jpg saved to cache
2026-03-29 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9202110>
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9950%252F18349950%252Fexterior_front_driver-1774783506385.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_front_driver-1774783506385.jpg saved to cache
2026-03-29 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99
2026-03-29 20:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 117d0b4d-2a8e-5e5d-8208-fe871e00ec99, skipping ID generation
2026-03-29 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99 with scrape type 1
2026-03-29 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 117d0b4d-2a8e-5e5d-8208-fe871e00ec99 sending to next pipeline
2026-03-29 20:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 117d0b4d-2a8e-5e5d-8208-fe871e00ec99, identifier: 18349950
2026-03-29 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e17e50>
2026-03-29 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6431%252F20156431%252Finterior_front_seats-1774704984999.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6431/20156431/interior_front_seats-1774704984999.jpg saved to cache
2026-03-29 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67567d47-7123-5980-b07b-ccc6b57a404e
2026-03-29 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c00210>
2026-03-29 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6729%252F20386729%252Fexterior_rear_driver-1774187407967.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_rear_driver-1774187407967.jpg saved to cache
2026-03-29 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b7e7472-4781-5d52-ba1d-10c4356aa559
2026-03-29 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9503690>
2026-03-29 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6729%252F20386729%252Fexterior_front_driver-1774187461901.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_front_driver-1774187461901.jpg saved to cache
2026-03-29 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b7e7472-4781-5d52-ba1d-10c4356aa559
2026-03-29 20:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b7e7472-4781-5d52-ba1d-10c4356aa559, skipping ID generation
2026-03-29 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b7e7472-4781-5d52-ba1d-10c4356aa559 with scrape type 1
2026-03-29 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b7e7472-4781-5d52-ba1d-10c4356aa559 sending to next pipeline
2026-03-29 20:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2b7e7472-4781-5d52-ba1d-10c4356aa559, identifier: 20386729
2026-03-29 20:02:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa139c10>
2026-03-29 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6900%252F20466900%252Finterior_boot-1774709321551.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6900/20466900/interior_boot-1774709321551.jpg saved to cache
2026-03-29 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a
2026-03-29 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87004cf450>
2026-03-29 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8114%252F20148114%252Fdamage_missing_trims-1774717090923.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8114/20148114/damage_missing_trims-1774717090923.jpg saved to cache
2026-03-29 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3af604eb-b084-520d-bc14-12299771621e
2026-03-29 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8114/20148114/instrument_cluster-1774716929255.jpg> (referer: None)
2026-03-29 20:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 117d0b4d-2a8e-5e5d-8208-fe871e00ec99 with identifier: 18349950
2026-03-29 20:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 117d0b4d-2a8e-5e5d-8208-fe871e00ec99 with identifier: 18349950
2026-03-29 20:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 117d0b4d-2a8e-5e5d-8208-fe871e00ec99 with identifier: 18349950 to the API
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_front_driver-1774783506385.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '117d0b4d-2a8e-5e5d-8208-fe871e00ec99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KV18 DYA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18349950',
'listing': 'auction',
'location': 'Greater London Chessington',
'make': 'Volvo',
'model': 'XC90',
'odometer': 78041,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 928109,
'Height': 2023,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_front_driver-1774783506385.jpg',
'Width': 2697},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1115852,
'Height': 2125,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_rear_driver-1774783590797.jpg',
'Width': 2833},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1079539,
'Height': 2063,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_front_passenger-1774783531463.jpg',
'Width': 2751},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1045199,
'Height': 1975,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9950/18349950/exterior_rear_passenger-1774783575697.jpg',
'Width': 2633},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2026532,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9950/18349950/interior_front_seats-1774783701979.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1818360,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9950/18349950/interior_rear_seats-1774783858110.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2582455,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9950/18349950/18349950-interior_dashboard-modified-1774787345480.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1641419,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9950/18349950/instrument_cluster-1774783911906.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2331372,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9950/18349950/interior_boot-1774783933873.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_117d0b4d-2a8e-5e5d-8208-fe871e00ec99/117d0b4d-2a8e-5e5d-8208-fe871e00ec99_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1587807,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9950/18349950/docs_service_history-1774786399086.jpg?ixlib=js-3.8.0&auto=format&s=d17c945987544bc41d213e23deb93d76',
'Width': 3060}],
'price': 19483,
'price_includes_vat': False,
'registration_date': '2018-03-15',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC90 R-DESIGN D5 P-PULSE AWD A',
'transmission': 'automatic',
'trim': 'R-DESIGN D5 P-PULSE AWD A',
'vin': 'YV1LF68UCJ1371758',
'year': 2018}
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718349950%27 HTTP/1.1" 200 None
2026-03-29 20:02:31 [motorway.uk] INFO: Saving data for 18349950: {'created_time': 1774814551.954445, 'last_price_update_time': 1774814551.954456, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18349950') HTTP/1.1" 204 0
2026-03-29 20:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2b7e7472-4781-5d52-ba1d-10c4356aa559 with identifier: 20386729
2026-03-29 20:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2b7e7472-4781-5d52-ba1d-10c4356aa559 with identifier: 20386729
2026-03-29 20:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2b7e7472-4781-5d52-ba1d-10c4356aa559 with identifier: 20386729 to the API
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_front_driver-1774187461901.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2b7e7472-4781-5d52-ba1d-10c4356aa559',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RK19 PLN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20386729',
'listing': 'auction',
'location': 'Leicestershire Leicester',
'make': 'Audi',
'model': 'Q3',
'odometer': 60000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2105504,
'Height': 2972,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_front_driver-1774187461901.jpg',
'Width': 3962},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2189352,
'Height': 2956,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_rear_driver-1774187407967.jpg',
'Width': 3941},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2279795,
'Height': 2893,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_front_passenger-1774187458943.jpg',
'Width': 3857},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2182416,
'Height': 2903,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6729/20386729/exterior_rear_passenger-1774187436625.jpg',
'Width': 3871},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4447130,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6729/20386729/interior_front_seats-1774188600625.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4031583,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6729/20386729/interior_rear_seats-1774188619447.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1935696,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6729/20386729/interior_dashboard-1774188663665.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2296637,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6729/20386729/instrument_cluster-1774188692096.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4399643,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6729/20386729/interior_boot-1774188705044.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b7e7472-4781-5d52-ba1d-10c4356aa559/2b7e7472-4781-5d52-ba1d-10c4356aa559_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4088997,
'Height': 3695,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6729/20386729/docs_service_history-1774189583638.jpg?ixlib=js-3.8.0&auto=format&s=c3fd1faf2b55e5bb3a6e082fec82c976',
'Width': 2451}],
'price': 16563,
'price_includes_vat': False,
'registration_date': '2019-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q3 S Line 35 TFSI S-A',
'transmission': 'automatic',
'trim': 'S Line 35 TFSI S-A',
'vin': 'WAUZZZF35K1012108',
'year': 2019}
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720386729%27 HTTP/1.1" 200 None
2026-03-29 20:02:32 [motorway.uk] INFO: Saving data for 20386729: {'created_time': 1774814552.369358, 'last_price_update_time': 1774814552.369368, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20386729') HTTP/1.1" 204 0
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabb4c90>
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8114%252F20148114%252Finstrument_cluster-1774716929255.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8114/20148114/instrument_cluster-1774716929255.jpg saved to cache
2026-03-29 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3af604eb-b084-520d-bc14-12299771621e
2026-03-29 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_front_driver-1774704451391.jpg> (referer: None)
2026-03-29 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9047/20459047/wheels_rear_driver-1774629556798.jpg> (referer: None)
2026-03-29 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_rear_driver-1774704446818.jpg> (referer: None)
2026-03-29 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_rear_passenger-1774704453515.jpg> (referer: None)
2026-03-29 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6900/20466900/exterior_front_passenger-1774707555446.jpg> (referer: None)
2026-03-29 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6900/20466900/exterior_rear_driver-1774707533947.jpg> (referer: None)
2026-03-29 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8114/20148114/interior_boot-1774717051521.jpg> (referer: None)
2026-03-29 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6900/20466900/instrument_cluster-1774709161571.jpg> (referer: None)
2026-03-29 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6900/20466900/interior_front_seats-1774709395152.jpg> (referer: None)
2026-03-29 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6900/20466900/interior_rear_seats-1774709360256.jpg> (referer: None)
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8646290>
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6431%252F20156431%252Fexterior_front_driver-1774704451391.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_front_driver-1774704451391.jpg saved to cache
2026-03-29 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67567d47-7123-5980-b07b-ccc6b57a404e
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c000d0>
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9047%252F20459047%252Fwheels_rear_driver-1774629556798.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9047/20459047/wheels_rear_driver-1774629556798.jpg saved to cache
2026-03-29 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76baecea-2974-5d9c-b3e8-0db824fa2811
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae80f90>
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6431%252F20156431%252Fexterior_rear_driver-1774704446818.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_rear_driver-1774704446818.jpg saved to cache
2026-03-29 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67567d47-7123-5980-b07b-ccc6b57a404e
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf74ed0>
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6431%252F20156431%252Fexterior_rear_passenger-1774704453515.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_rear_passenger-1774704453515.jpg saved to cache
2026-03-29 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67567d47-7123-5980-b07b-ccc6b57a404e
2026-03-29 20:02:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67567d47-7123-5980-b07b-ccc6b57a404e, skipping ID generation
2026-03-29 20:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67567d47-7123-5980-b07b-ccc6b57a404e with scrape type 1
2026-03-29 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67567d47-7123-5980-b07b-ccc6b57a404e sending to next pipeline
2026-03-29 20:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 67567d47-7123-5980-b07b-ccc6b57a404e, identifier: 20156431
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ea7d90>
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6900%252F20466900%252Fexterior_front_passenger-1774707555446.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6900/20466900/exterior_front_passenger-1774707555446.jpg saved to cache
2026-03-29 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f938d010>
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6900%252F20466900%252Fexterior_rear_driver-1774707533947.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6900/20466900/exterior_rear_driver-1774707533947.jpg saved to cache
2026-03-29 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9163390>
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8114%252F20148114%252Finterior_boot-1774717051521.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8114/20148114/interior_boot-1774717051521.jpg saved to cache
2026-03-29 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3af604eb-b084-520d-bc14-12299771621e
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9191810>
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6900%252F20466900%252Finstrument_cluster-1774709161571.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6900/20466900/instrument_cluster-1774709161571.jpg saved to cache
2026-03-29 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8aa6090>
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6900%252F20466900%252Finterior_front_seats-1774709395152.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6900/20466900/interior_front_seats-1774709395152.jpg saved to cache
2026-03-29 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa09990>
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6900%252F20466900%252Finterior_rear_seats-1774709360256.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6900/20466900/interior_rear_seats-1774709360256.jpg saved to cache
2026-03-29 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a
2026-03-29 20:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 67567d47-7123-5980-b07b-ccc6b57a404e with identifier: 20156431
2026-03-29 20:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 67567d47-7123-5980-b07b-ccc6b57a404e with identifier: 20156431
2026-03-29 20:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 67567d47-7123-5980-b07b-ccc6b57a404e with identifier: 20156431 to the API
2026-03-29 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_rear_passenger-1774704453515.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '67567d47-7123-5980-b07b-ccc6b57a404e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MJ21 DWP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20156431',
'listing': 'auction',
'location': 'South Gloucestershire Bristol',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 34000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1650618,
'Height': 2482,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_front_driver-1774704451391.jpg',
'Width': 3309},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1303706,
'Height': 2433,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_rear_driver-1774704446818.jpg',
'Width': 3244},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1722638,
'Height': 2549,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_front_passenger-1774704448995.jpg',
'Width': 3398},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1466946,
'Height': 2603,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6431/20156431/exterior_rear_passenger-1774704453515.jpg',
'Width': 3470},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1997191,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6431/20156431/interior_front_seats-1774704984999.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1679589,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6431/20156431/interior_rear_seats-1774705024548.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1378531,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6431/20156431/interior_dashboard-1774706347154.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1870129,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6431/20156431/interior_boot-1774704986566.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2108472,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6431/20156431/damage_scratches-1774704540742.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67567d47-7123-5980-b07b-ccc6b57a404e/67567d47-7123-5980-b07b-ccc6b57a404e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1415861,
'Height': 2863,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6431/20156431/wheels_front_driver-1774704611158.jpg',
'Width': 3817}],
'price': 13476,
'price_includes_vat': False,
'registration_date': '2021-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Kamiq Monte Carlo TSI S-A',
'transmission': 'automatic',
'trim': 'Monte Carlo TSI S-A',
'vin': 'TMBHK6NW9M3094736',
'year': 2021}
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720156431%27 HTTP/1.1" 200 None
2026-03-29 20:02:34 [motorway.uk] INFO: Saving data for 20156431: {'created_time': 1774814554.217271, 'last_price_update_time': 1774814554.217282, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20156431') HTTP/1.1" 204 0
2026-03-29 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8114/20148114/interior_dashboard-1774717013822.jpg> (referer: None)
2026-03-29 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9047/20459047/wheels_front_driver-1774629542377.jpg> (referer: None)
2026-03-29 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6900/20466900/exterior_front_driver-1774709869204.jpg> (referer: None)
2026-03-29 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3763/10813763/10813763-docs_service_history-default-1774766815740.jpg?ixlib=js-3.8.0&auto=format&s=f18e7e2c407b97382dcb20a484a8a659> (referer: None)
2026-03-29 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9047/20459047/interior_dashboard-1774712477675.jpg> (referer: None)
2026-03-29 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8114/20148114/exterior_front_passenger-1774716985545.jpg> (referer: None)
2026-03-29 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8114/20148114/interior_rear_seats-1774715940513.jpg> (referer: None)
2026-03-29 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9047/20459047/interior_boot-1774630088856.jpg> (referer: None)
2026-03-29 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9047/20459047/interior_rear_seats-1774630011876.jpg> (referer: None)
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa189110>
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8114%252F20148114%252Finterior_dashboard-1774717013822.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8114/20148114/interior_dashboard-1774717013822.jpg saved to cache
2026-03-29 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3af604eb-b084-520d-bc14-12299771621e
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9308e90>
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9047%252F20459047%252Fwheels_front_driver-1774629542377.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9047/20459047/wheels_front_driver-1774629542377.jpg saved to cache
2026-03-29 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76baecea-2974-5d9c-b3e8-0db824fa2811
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f963d750>
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6900%252F20466900%252Fexterior_front_driver-1774709869204.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6900/20466900/exterior_front_driver-1774709869204.jpg saved to cache
2026-03-29 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a
2026-03-29 20:02:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82c8a59c-87f1-5768-a213-dfce41ea3a2a, skipping ID generation
2026-03-29 20:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a with scrape type 1
2026-03-29 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82c8a59c-87f1-5768-a213-dfce41ea3a2a sending to next pipeline
2026-03-29 20:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 82c8a59c-87f1-5768-a213-dfce41ea3a2a, identifier: 20466900
2026-03-29 20:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0f\x00\x00'
2026-03-29 20:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xd0\x0b\x00\x00'
2026-03-29 20:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:02:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 70 - Data Location: 158 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:02:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 166 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 106 - Data Location: 174 - value: b'samsung\x00'
2026-03-29 20:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 182 - value: b'SM-N960F\x00'
2026-03-29 20:02:34 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 191 - value: b'N960FXXU9FVH1\x00'
2026-03-29 20:02:34 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 205 - value: b'2026:03:29 07:46:53\x00'
2026-03-29 20:02:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe1\x00\x00\x00'
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1894d0>
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3763%252F10813763%252F10813763-docs_service_history-default-1774766815740.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df18e7e2c407b97382dcb20a484a8a659') HTTP/1.1" 204 0
2026-03-29 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3763/10813763/10813763-docs_service_history-default-1774766815740.jpg?ixlib=js-3.8.0&auto=format&s=f18e7e2c407b97382dcb20a484a8a659 saved to cache
2026-03-29 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 844b82ff-98cb-5a98-ab6f-116f74757aea
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f963ced0>
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9047%252F20459047%252Finterior_dashboard-1774712477675.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9047/20459047/interior_dashboard-1774712477675.jpg saved to cache
2026-03-29 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76baecea-2974-5d9c-b3e8-0db824fa2811
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f963c710>
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8114%252F20148114%252Fexterior_front_passenger-1774716985545.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8114/20148114/exterior_front_passenger-1774716985545.jpg saved to cache
2026-03-29 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3af604eb-b084-520d-bc14-12299771621e
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fbc150>
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8114%252F20148114%252Finterior_rear_seats-1774715940513.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8114/20148114/interior_rear_seats-1774715940513.jpg saved to cache
2026-03-29 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3af604eb-b084-520d-bc14-12299771621e
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9662d90>
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9047%252F20459047%252Finterior_boot-1774630088856.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9047/20459047/interior_boot-1774630088856.jpg saved to cache
2026-03-29 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76baecea-2974-5d9c-b3e8-0db824fa2811
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fbe150>
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9047%252F20459047%252Finterior_rear_seats-1774630011876.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9047/20459047/interior_rear_seats-1774630011876.jpg saved to cache
2026-03-29 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76baecea-2974-5d9c-b3e8-0db824fa2811
2026-03-29 20:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 82c8a59c-87f1-5768-a213-dfce41ea3a2a with identifier: 20466900
2026-03-29 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 82c8a59c-87f1-5768-a213-dfce41ea3a2a with identifier: 20466900
2026-03-29 20:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 82c8a59c-87f1-5768-a213-dfce41ea3a2a with identifier: 20466900 to the API
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/6900/20466900/exterior_front_driver-1774709869204.jpg>
{'auction_title': '',
'category': None,
'color': 'Orange',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '82c8a59c-87f1-5768-a213-dfce41ea3a2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RE23 MKV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20466900',
'listing': 'auction',
'location': 'Wokingham Reading',
'make': 'Kia',
'model': 'Sportage',
'odometer': 14994,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2444580,
'Height': 2300,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6900/20466900/exterior_front_driver-1774709869204.jpg',
'Width': 3067},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2001023,
'Height': 2496,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6900/20466900/exterior_rear_driver-1774707533947.jpg',
'Width': 3328},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1805634,
'Height': 2273,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6900/20466900/exterior_front_passenger-1774707555446.jpg',
'Width': 3031},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3407797,
'Height': 2810,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6900/20466900/exterior_rear_passenger-1774709994545.jpg',
'Width': 3747},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3071135,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6900/20466900/interior_front_seats-1774709395152.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3189689,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6900/20466900/interior_rear_seats-1774709360256.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3000257,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6900/20466900/interior_dashboard-1774709919487.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2609996,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6900/20466900/instrument_cluster-1774709161571.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3529437,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6900/20466900/interior_boot-1774709321551.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82c8a59c-87f1-5768-a213-dfce41ea3a2a/82c8a59c-87f1-5768-a213-dfce41ea3a2a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262262,
'Height': 1780,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6900/20466900/docs_service_history-1774710107149.jpg?ixlib=js-3.8.0&auto=format&s=f636e36ed469f27d4c8b9f00c7e9c56b',
'Width': 2373}],
'price': 24708,
'price_includes_vat': False,
'registration_date': '2023-04-29',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage Gtln S ISG MHEV4X4 SA',
'transmission': 'automatic',
'trim': 'Gtln S ISG MHEV4X4 SA',
'vin': 'U5YPX81BWPL144583',
'year': 2023}
2026-03-29 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720466900%27 HTTP/1.1" 200 None
2026-03-29 20:02:36 [motorway.uk] INFO: Saving data for 20466900: {'created_time': 1774814556.001091, 'last_price_update_time': 1774814556.001102, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20466900') HTTP/1.1" 204 0
2026-03-29 20:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3763/10813763/10813763-interior_dashboard-modified-1774779499460.jpeg> (referer: None)
2026-03-29 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3763/10813763/interior_rear_seats-1774767544818.jpg> (referer: None)
2026-03-29 20:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8114/20148114/exterior_front_driver-1774699104049.jpg> (referer: None)
2026-03-29 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3763/10813763/interior_boot-1774767585564.jpg> (referer: None)
2026-03-29 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3763/10813763/instrument_cluster-1774767641357.jpg> (referer: None)
2026-03-29 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9047/20459047/exterior_rear_driver-1774629411103.jpg> (referer: None)
2026-03-29 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9047/20459047/interior_front_seats-1774712461018.jpg> (referer: None)
2026-03-29 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9047/20459047/exterior_rear_passenger-1774712435215.jpg> (referer: None)
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f932e250>
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3763%252F10813763%252F10813763-interior_dashboard-modified-1774779499460.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3763/10813763/10813763-interior_dashboard-modified-1774779499460.jpeg saved to cache
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 844b82ff-98cb-5a98-ab6f-116f74757aea
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f919fdd0>
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3763%252F10813763%252Finterior_rear_seats-1774767544818.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3763/10813763/interior_rear_seats-1774767544818.jpg saved to cache
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 844b82ff-98cb-5a98-ab6f-116f74757aea
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9227a50>
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8114%252F20148114%252Fexterior_front_driver-1774699104049.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8114/20148114/exterior_front_driver-1774699104049.jpg saved to cache
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3af604eb-b084-520d-bc14-12299771621e
2026-03-29 20:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3af604eb-b084-520d-bc14-12299771621e, skipping ID generation
2026-03-29 20:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3af604eb-b084-520d-bc14-12299771621e with scrape type 1
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3af604eb-b084-520d-bc14-12299771621e sending to next pipeline
2026-03-29 20:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3af604eb-b084-520d-bc14-12299771621e, identifier: 20148114
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81d4f10>
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3763%252F10813763%252Finterior_boot-1774767585564.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3763/10813763/interior_boot-1774767585564.jpg saved to cache
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 844b82ff-98cb-5a98-ab6f-116f74757aea
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fbff90>
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3763%252F10813763%252Finstrument_cluster-1774767641357.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3763/10813763/instrument_cluster-1774767641357.jpg saved to cache
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 844b82ff-98cb-5a98-ab6f-116f74757aea
2026-03-29 20:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 844b82ff-98cb-5a98-ab6f-116f74757aea, skipping ID generation
2026-03-29 20:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 844b82ff-98cb-5a98-ab6f-116f74757aea with scrape type 1
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 844b82ff-98cb-5a98-ab6f-116f74757aea sending to next pipeline
2026-03-29 20:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 844b82ff-98cb-5a98-ab6f-116f74757aea, identifier: 10813763
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90d71d0>
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9047%252F20459047%252Fexterior_rear_driver-1774629411103.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9047/20459047/exterior_rear_driver-1774629411103.jpg saved to cache
2026-03-29 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76baecea-2974-5d9c-b3e8-0db824fa2811
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f919ed90>
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9047%252F20459047%252Finterior_front_seats-1774712461018.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9047/20459047/interior_front_seats-1774712461018.jpg saved to cache
2026-03-29 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76baecea-2974-5d9c-b3e8-0db824fa2811
2026-03-29 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f919cfd0>
2026-03-29 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9047%252F20459047%252Fexterior_rear_passenger-1774712435215.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9047/20459047/exterior_rear_passenger-1774712435215.jpg saved to cache
2026-03-29 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76baecea-2974-5d9c-b3e8-0db824fa2811
2026-03-29 20:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3af604eb-b084-520d-bc14-12299771621e with identifier: 20148114
2026-03-29 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3af604eb-b084-520d-bc14-12299771621e with identifier: 20148114
2026-03-29 20:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3af604eb-b084-520d-bc14-12299771621e with identifier: 20148114 to the API
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8114/20148114/exterior_front_driver-1774699104049.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '3af604eb-b084-520d-bc14-12299771621e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AK74 NCO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20148114',
'listing': 'auction',
'location': 'Central Bedfordshire Biggleswade',
'make': 'BMW',
'model': 'X1',
'odometer': 10334,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1723188,
'Height': 2358,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8114/20148114/exterior_front_driver-1774699104049.jpg',
'Width': 3144},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1674644,
'Height': 2468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8114/20148114/exterior_rear_driver-1774699123294.jpg',
'Width': 3290},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2402526,
'Height': 2657,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8114/20148114/exterior_front_passenger-1774716985545.jpg',
'Width': 3543},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1751370,
'Height': 2563,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8114/20148114/exterior_rear_passenger-1774699138265.jpg',
'Width': 3417},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2164292,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8114/20148114/interior_front_seats-1774717002595.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2534633,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8114/20148114/interior_rear_seats-1774715940513.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2282433,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8114/20148114/interior_dashboard-1774717013822.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501839,
'Height': 1418,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8114/20148114/instrument_cluster-1774716929255.jpg',
'Width': 1890},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2983417,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8114/20148114/interior_boot-1774717051521.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af604eb-b084-520d-bc14-12299771621e/3af604eb-b084-520d-bc14-12299771621e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113729,
'Height': 576,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8114/20148114/damage_missing_trims-1774717090923.jpg',
'Width': 768}],
'price': 32040,
'price_includes_vat': False,
'registration_date': '2024-11-25',
'seats_number': None,
'seller_name': None,
'title': 'BMW X1 Sdrive 20I M Sport MHEV A',
'transmission': 'automatic',
'trim': 'Sdrive 20I M Sport MHEV A',
'vin': 'WBA32EE0805172032',
'year': 2024}
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720148114%27 HTTP/1.1" 200 None
2026-03-29 20:02:37 [motorway.uk] INFO: Saving data for 20148114: {'created_time': 1774814557.521852, 'last_price_update_time': 1774814557.521864, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20148114') HTTP/1.1" 204 0
2026-03-29 20:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 844b82ff-98cb-5a98-ab6f-116f74757aea with identifier: 10813763
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Beige HTTP/1.1" 200 None
2026-03-29 20:02:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 844b82ff-98cb-5a98-ab6f-116f74757aea with identifier: 10813763
2026-03-29 20:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 844b82ff-98cb-5a98-ab6f-116f74757aea with identifier: 10813763 to the API
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3763/10813763/instrument_cluster-1774767641357.jpg>
{'auction_title': '',
'category': None,
'color': 'Beige',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '844b82ff-98cb-5a98-ab6f-116f74757aea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT66 KSF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10813763',
'listing': 'auction',
'location': 'Greater London Bromley',
'make': 'BMW',
'model': '4 Series',
'odometer': 74170,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1378576,
'Height': 2584,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_front_driver-1774767272208.jpg',
'Width': 3445},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1738337,
'Height': 2980,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_rear_driver-1774768064355.jpg',
'Width': 3973},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1560036,
'Height': 2771,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_front_passenger-1774767294092.jpg',
'Width': 3695},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2179483,
'Height': 3021,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3763/10813763/exterior_rear_passenger-1774767374391.jpg',
'Width': 4028},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1420293,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3763/10813763/interior_front_seats-1774767478412.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1362726,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3763/10813763/interior_rear_seats-1774767544818.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 854464,
'Height': 2986,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3763/10813763/10813763-interior_dashboard-modified-1774779499460.jpeg',
'Width': 3981},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1694207,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3763/10813763/instrument_cluster-1774767641357.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1628963,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3763/10813763/interior_boot-1774767585564.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844b82ff-98cb-5a98-ab6f-116f74757aea/844b82ff-98cb-5a98-ab6f-116f74757aea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2522050,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3763/10813763/10813763-docs_service_history-default-1774766815740.jpg?ixlib=js-3.8.0&auto=format&s=f18e7e2c407b97382dcb20a484a8a659',
'Width': 4032}],
'price': 15181,
'price_includes_vat': False,
'registration_date': '2016-09-08',
'seats_number': None,
'seller_name': None,
'title': 'BMW 440I Gran Coupe M Sport A',
'transmission': 'automatic',
'trim': '440I Gran Coupe M Sport A',
'vin': 'WBA4E320X0G386884',
'year': 2016}
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710813763%27 HTTP/1.1" 200 None
2026-03-29 20:02:38 [motorway.uk] INFO: Saving data for 10813763: {'created_time': 1774814558.069379, 'last_price_update_time': 1774814558.069389, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10813763') HTTP/1.1" 204 0
2026-03-29 20:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_front_driver-1774699634681.jpg> (referer: None)
2026-03-29 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_rear_driver-1774699658775.jpg> (referer: None)
2026-03-29 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_front_passenger-1774699714820.jpg> (referer: None)
2026-03-29 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_rear_passenger-1774699674485.jpg> (referer: None)
2026-03-29 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9047/20459047/exterior_front_passenger-1774712363604.jpg> (referer: None)
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96740d0>
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2595%252F20462595%252Fexterior_front_driver-1774699634681.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_front_driver-1774699634681.jpg saved to cache
2026-03-29 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8655410>
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2595%252F20462595%252Fexterior_rear_driver-1774699658775.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_rear_driver-1774699658775.jpg saved to cache
2026-03-29 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9599e50>
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2595%252F20462595%252Fexterior_front_passenger-1774699714820.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_front_passenger-1774699714820.jpg saved to cache
2026-03-29 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9158350>
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2595%252F20462595%252Fexterior_rear_passenger-1774699674485.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_rear_passenger-1774699674485.jpg saved to cache
2026-03-29 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d
2026-03-29 20:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d, skipping ID generation
2026-03-29 20:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d with scrape type 1
2026-03-29 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d sending to next pipeline
2026-03-29 20:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d, identifier: 20462595
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95f12d0>
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9047%252F20459047%252Fexterior_front_passenger-1774712363604.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9047/20459047/exterior_front_passenger-1774712363604.jpg saved to cache
2026-03-29 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76baecea-2974-5d9c-b3e8-0db824fa2811
2026-03-29 20:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76baecea-2974-5d9c-b3e8-0db824fa2811, skipping ID generation
2026-03-29 20:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76baecea-2974-5d9c-b3e8-0db824fa2811 with scrape type 1
2026-03-29 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76baecea-2974-5d9c-b3e8-0db824fa2811 sending to next pipeline
2026-03-29 20:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 76baecea-2974-5d9c-b3e8-0db824fa2811, identifier: 20459047
2026-03-29 20:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d with identifier: 20462595
2026-03-29 20:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d with identifier: 20462595
2026-03-29 20:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d with identifier: 20462595 to the API
2026-03-29 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_rear_passenger-1774699674485.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HF20 MWW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20462595',
'listing': 'auction',
'location': 'Hampshire Southampton',
'make': 'Volvo',
'model': 'XC40',
'odometer': 36300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1916369,
'Height': 2607,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_front_driver-1774699634681.jpg',
'Width': 3476},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1616105,
'Height': 2635,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_rear_driver-1774699658775.jpg',
'Width': 3513},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1632704,
'Height': 2460,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_front_passenger-1774699714820.jpg',
'Width': 3280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1719672,
'Height': 2590,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2595/20462595/exterior_rear_passenger-1774699674485.jpg',
'Width': 3453},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2995184,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2595/20462595/interior_front_seats-1774700653704.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2799506,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2595/20462595/interior_rear_seats-1774700672281.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1864682,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2595/20462595/interior_dashboard-1774700725713.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1954715,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2595/20462595/instrument_cluster-1774700934209.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3978978,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2595/20462595/interior_boot-1774700787314.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d/fa7f6d54-abbb-5c07-98c5-ac3349b6ee5d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322386,
'Height': 1067,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2595/20462595/docs_service_history-1774701152299.jpg?ixlib=js-3.8.0&auto=format&s=012449000a7c94a31ee244571f5d5627',
'Width': 3231}],
'price': 20617,
'price_includes_vat': False,
'registration_date': '2020-03-19',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC40 R-DESIGN PRO T4 Auto',
'transmission': 'automatic',
'trim': 'R-DESIGN PRO T4 Auto',
'vin': 'YV1XZACBDL2306641',
'year': 2020}
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720462595%27 HTTP/1.1" 200 None
2026-03-29 20:02:39 [motorway.uk] INFO: Saving data for 20462595: {'created_time': 1774814559.264954, 'last_price_update_time': 1774814559.264965, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20462595') HTTP/1.1" 204 0
2026-03-29 20:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 76baecea-2974-5d9c-b3e8-0db824fa2811 with identifier: 20459047
2026-03-29 20:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 76baecea-2974-5d9c-b3e8-0db824fa2811 with identifier: 20459047
2026-03-29 20:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 76baecea-2974-5d9c-b3e8-0db824fa2811 with identifier: 20459047 to the API
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/9047/20459047/exterior_front_passenger-1774712363604.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '76baecea-2974-5d9c-b3e8-0db824fa2811',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM23 VHH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20459047',
'listing': 'auction',
'location': 'Greater Manchester Stockport',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 15700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1680726,
'Height': 2846,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9047/20459047/exterior_front_driver-1774712293303.jpg',
'Width': 3795},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1593134,
'Height': 2855,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9047/20459047/exterior_rear_driver-1774629411103.jpg',
'Width': 3807},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2415974,
'Height': 2964,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9047/20459047/exterior_front_passenger-1774712363604.jpg',
'Width': 3952},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1797131,
'Height': 2481,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9047/20459047/exterior_rear_passenger-1774712435215.jpg',
'Width': 3308},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3069932,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9047/20459047/interior_front_seats-1774712461018.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2900941,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9047/20459047/interior_rear_seats-1774630011876.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1890401,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9047/20459047/interior_dashboard-1774712477675.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2794126,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9047/20459047/interior_boot-1774630088856.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1432591,
'Height': 2517,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9047/20459047/wheels_front_driver-1774629542377.jpg',
'Width': 3356},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76baecea-2974-5d9c-b3e8-0db824fa2811/76baecea-2974-5d9c-b3e8-0db824fa2811_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1086548,
'Height': 2433,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9047/20459047/wheels_rear_driver-1774629556798.jpg',
'Width': 3244}],
'price': 17542,
'price_includes_vat': False,
'registration_date': '2023-05-30',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Kona Ultimate GDI HEV S-A',
'transmission': 'automatic',
'trim': 'Ultimate GDI HEV S-A',
'vin': 'KMHK581EVPU123489',
'year': 2023}
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459047%27 HTTP/1.1" 200 None
2026-03-29 20:02:39 [motorway.uk] INFO: Saving data for 20459047: {'created_time': 1774814559.694723, 'last_price_update_time': 1774814559.694734, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20459047') HTTP/1.1" 204 0
2026-03-29 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=432&page=12&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_front_driver-1774520692193.jpg> (referer: None)
2026-03-29 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_front_driver-1774699791411.jpg> (referer: None)
2026-03-29 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_front_driver-1774699586318.jpg> (referer: None)
2026-03-29 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_rear_driver-1774520686090.jpg> (referer: None)
2026-03-29 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6997/20436997/exterior_front_driver-1774692607004.jpg> (referer: None)
2026-03-29 20:02:39 [motorway.uk] INFO: Found listing with ID: 20168160
2026-03-29 20:02:39 [motorway.uk] INFO: Found listing with ID: 19750033
2026-03-29 20:02:39 [motorway.uk] INFO: Found listing with ID: 19427127
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719427127%27 HTTP/1.1" 200 None
2026-03-29 20:02:39 [motorway.uk] INFO: Scrape type for 19427127: 1
2026-03-29 20:02:39 [motorway.uk] INFO: Found listing with ID: 18209819
2026-03-29 20:02:39 [motorway.uk] INFO: Found listing with ID: 18301360
2026-03-29 20:02:39 [motorway.uk] INFO: Found listing with ID: 20315758
2026-03-29 20:02:39 [motorway.uk] INFO: Found listing with ID: 20303235
2026-03-29 20:02:39 [motorway.uk] INFO: Found listing with ID: 20491229
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491229%27 HTTP/1.1" 200 None
2026-03-29 20:02:39 [motorway.uk] INFO: Scrape type for 20491229: 1
2026-03-29 20:02:39 [motorway.uk] INFO: Found listing with ID: 13358851
2026-03-29 20:02:39 [motorway.uk] INFO: Found listing with ID: 20494032
2026-03-29 20:02:39 [motorway.uk] INFO: Found listing with ID: 18839642
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718839642%27 HTTP/1.1" 200 None
2026-03-29 20:02:39 [motorway.uk] INFO: Scrape type for 18839642: 1
2026-03-29 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9158b10>
2026-03-29 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8396%252F19998396%252Fexterior_front_driver-1774520692193.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_front_driver-1774520692193.jpg saved to cache
2026-03-29 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97
2026-03-29 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81f2790>
2026-03-29 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9062%252F3629062%252Fexterior_front_driver-1774699791411.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_front_driver-1774699791411.jpg saved to cache
2026-03-29 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7aa56651-1db2-5dc0-80a5-d141f627d833
2026-03-29 20:02:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7aa56651-1db2-5dc0-80a5-d141f627d833, skipping ID generation
2026-03-29 20:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7aa56651-1db2-5dc0-80a5-d141f627d833 with scrape type 1
2026-03-29 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7aa56651-1db2-5dc0-80a5-d141f627d833 sending to next pipeline
2026-03-29 20:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7aa56651-1db2-5dc0-80a5-d141f627d833, identifier: 3629062
2026-03-29 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94975d0>
2026-03-29 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6965%252F20486965%252Fexterior_front_driver-1774699586318.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_front_driver-1774699586318.jpg saved to cache
2026-03-29 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3b83795-b8da-52c5-adfd-45cceb547866
2026-03-29 20:02:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3b83795-b8da-52c5-adfd-45cceb547866, skipping ID generation
2026-03-29 20:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3b83795-b8da-52c5-adfd-45cceb547866 with scrape type 1
2026-03-29 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3b83795-b8da-52c5-adfd-45cceb547866 sending to next pipeline
2026-03-29 20:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b3b83795-b8da-52c5-adfd-45cceb547866, identifier: 20486965
2026-03-29 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89cf510>
2026-03-29 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8396%252F19998396%252Fexterior_rear_driver-1774520686090.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_rear_driver-1774520686090.jpg saved to cache
2026-03-29 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97
2026-03-29 20:02:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4c9a5ca-3ae7-5354-9fd2-1f3579157d97, skipping ID generation
2026-03-29 20:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97 with scrape type 1
2026-03-29 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4c9a5ca-3ae7-5354-9fd2-1f3579157d97 sending to next pipeline
2026-03-29 20:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d4c9a5ca-3ae7-5354-9fd2-1f3579157d97, identifier: 19998396
2026-03-29 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0ce210>
2026-03-29 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6997%252F20436997%252Fexterior_front_driver-1774692607004.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6997/20436997/exterior_front_driver-1774692607004.jpg saved to cache
2026-03-29 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3
2026-03-29 20:02:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe22ee59-cdcc-56d4-b29a-37052b6c1ce3, skipping ID generation
2026-03-29 20:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3 with scrape type 1
2026-03-29 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe22ee59-cdcc-56d4-b29a-37052b6c1ce3 sending to next pipeline
2026-03-29 20:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fe22ee59-cdcc-56d4-b29a-37052b6c1ce3, identifier: 20436997
2026-03-29 20:02:40 [motorway.uk] INFO: Found listing with ID: 20490324
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490324%27 HTTP/1.1" 200 None
2026-03-29 20:02:40 [motorway.uk] INFO: Scrape type for 20490324: 1
2026-03-29 20:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7aa56651-1db2-5dc0-80a5-d141f627d833 with identifier: 3629062
2026-03-29 20:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7aa56651-1db2-5dc0-80a5-d141f627d833 with identifier: 3629062
2026-03-29 20:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7aa56651-1db2-5dc0-80a5-d141f627d833 with identifier: 3629062 to the API
2026-03-29 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_front_driver-1774699791411.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.7L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '7aa56651-1db2-5dc0-80a5-d141f627d833',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DT17 JVF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3629062',
'listing': 'auction',
'location': 'Neath Port Talbot Principle Area Neath',
'make': 'Kia',
'model': 'Carens',
'odometer': 47890,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1433346,
'Height': 2263,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_front_driver-1774699791411.jpg',
'Width': 3017},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1291431,
'Height': 2257,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_rear_driver-1774699786092.jpg',
'Width': 3009},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1678943,
'Height': 2335,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_front_passenger-1774699788675.jpg',
'Width': 3113},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1208687,
'Height': 2320,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9062/3629062/exterior_rear_passenger-1774699792682.jpg',
'Width': 3093},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3324531,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9062/3629062/interior_front_seats-1774700093092.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2576211,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9062/3629062/interior_rear_seats-1774700094119.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1489483,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9062/3629062/interior_dashboard-1774700106221.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1511579,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9062/3629062/instrument_cluster-1774700159675.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2616676,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9062/3629062/interior_boot-1774700095680.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7aa56651-1db2-5dc0-80a5-d141f627d833/7aa56651-1db2-5dc0-80a5-d141f627d833_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1077945,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9062/3629062/docs_service_history-1774700186147.jpg?ixlib=js-3.8.0&auto=format&s=9e5b8738aabdf69279203033b3b0e702',
'Width': 3840}],
'price': 7976,
'price_includes_vat': False,
'registration_date': '2017-06-29',
'seats_number': None,
'seller_name': None,
'title': 'Kia Carens 4 CRDI ISG S-A',
'transmission': 'automatic',
'trim': '4 CRDI ISG S-A',
'vin': 'KNAHU815VG7165342',
'year': 2017}
2026-03-29 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273629062%27 HTTP/1.1" 200 None
2026-03-29 20:02:41 [motorway.uk] INFO: Saving data for 3629062: {'created_time': 1774814561.13891, 'last_price_update_time': 1774814561.138924, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3629062') HTTP/1.1" 204 0
2026-03-29 20:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b3b83795-b8da-52c5-adfd-45cceb547866 with identifier: 20486965
2026-03-29 20:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b3b83795-b8da-52c5-adfd-45cceb547866 with identifier: 20486965
2026-03-29 20:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b3b83795-b8da-52c5-adfd-45cceb547866 with identifier: 20486965 to the API
2026-03-29 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_front_driver-1774699586318.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'b3b83795-b8da-52c5-adfd-45cceb547866',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LA16 VGP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20486965',
'listing': 'auction',
'location': 'Hertfordshire Hemel Hempstead',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 21927,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2037502,
'Height': 2672,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_front_driver-1774699586318.jpg',
'Width': 3562},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1756282,
'Height': 2649,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_rear_driver-1774699501519.jpg',
'Width': 3532},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1258541,
'Height': 2216,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_front_passenger-1774699541278.jpg',
'Width': 2954},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1922958,
'Height': 2835,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6965/20486965/exterior_rear_passenger-1774699505758.jpg',
'Width': 3780},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2287122,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6965/20486965/interior_front_seats-1774700730875.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1674014,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6965/20486965/interior_rear_seats-1774700736846.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2238858,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6965/20486965/interior_dashboard-1774700750778.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1929242,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6965/20486965/instrument_cluster-1774700442346.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2371121,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6965/20486965/interior_boot-1774700734508.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3b83795-b8da-52c5-adfd-45cceb547866/b3b83795-b8da-52c5-adfd-45cceb547866_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 984450,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6965/20486965/docs_service_history-1774701072986.jpg?ixlib=js-3.8.0&auto=format&s=cf52a40006daa4b1ffcbeaf95fdc306e',
'Width': 3840}],
'price': 10179,
'price_includes_vat': False,
'registration_date': '2016-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Jeep Renegade Limited M-JET 4X4 A',
'transmission': 'automatic',
'trim': 'Limited M-JET 4X4 A',
'vin': '1C4BU0000FPC05018',
'year': 2016}
2026-03-29 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486965%27 HTTP/1.1" 200 None
2026-03-29 20:02:41 [motorway.uk] INFO: Saving data for 20486965: {'created_time': 1774814561.76294, 'last_price_update_time': 1774814561.76295, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20486965') HTTP/1.1" 204 0
2026-03-29 20:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d4c9a5ca-3ae7-5354-9fd2-1f3579157d97 with identifier: 19998396
2026-03-29 20:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d4c9a5ca-3ae7-5354-9fd2-1f3579157d97 with identifier: 19998396
2026-03-29 20:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d4c9a5ca-3ae7-5354-9fd2-1f3579157d97 with identifier: 19998396 to the API
2026-03-29 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_rear_driver-1774520686090.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd4c9a5ca-3ae7-5354-9fd2-1f3579157d97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RA66 TVT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19998396',
'listing': 'auction',
'location': 'Berkshire Crowthorne',
'make': 'Audi',
'model': 'A3',
'odometer': 80963,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1432849,
'Height': 2633,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_front_driver-1774520692193.jpg',
'Width': 3511},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1205214,
'Height': 2023,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_rear_driver-1774520686090.jpg',
'Width': 2697},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2174086,
'Height': 2603,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_front_passenger-1774520703417.jpg',
'Width': 3471},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1700607,
'Height': 2387,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8396/19998396/exterior_rear_passenger-1774520696521.jpg',
'Width': 3182},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1672835,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8396/19998396/interior_front_seats-1774521807768.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2397986,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8396/19998396/interior_rear_seats-1774521553541.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2678474,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8396/19998396/interior_dashboard-1774702623830.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1202764,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8396/19998396/instrument_cluster-1774521481443.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2415334,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8396/19998396/interior_boot-1774521547690.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4c9a5ca-3ae7-5354-9fd2-1f3579157d97/d4c9a5ca-3ae7-5354-9fd2-1f3579157d97_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64865,
'Height': 1188,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8396/19998396/docs_service_history-1774698670475-1.jpeg?ixlib=js-3.8.0&auto=format&s=aabaf9b8f3771385ff7a9de9bb185a7a',
'Width': 918}],
'price': 10564,
'price_includes_vat': False,
'registration_date': '2017-01-31',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 S Line TFSI Quattro S-A',
'transmission': 'automatic',
'trim': 'S Line TFSI Quattro S-A',
'vin': 'WAUZZZ8V2H1027642',
'year': 2017}
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719998396%27 HTTP/1.1" 200 None
2026-03-29 20:02:42 [motorway.uk] INFO: Saving data for 19998396: {'created_time': 1774814562.13817, 'last_price_update_time': 1774814562.138181, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19998396') HTTP/1.1" 204 0
2026-03-29 20:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fe22ee59-cdcc-56d4-b29a-37052b6c1ce3 with identifier: 20436997
2026-03-29 20:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fe22ee59-cdcc-56d4-b29a-37052b6c1ce3 with identifier: 20436997
2026-03-29 20:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fe22ee59-cdcc-56d4-b29a-37052b6c1ce3 with identifier: 20436997 to the API
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6997/20436997/exterior_front_driver-1774692607004.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'fe22ee59-cdcc-56d4-b29a-37052b6c1ce3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EN21 KXF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20436997',
'listing': 'auction',
'location': 'Greater London Barking',
'make': 'BMW',
'model': 'X3',
'odometer': 35900,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1900212,
'Height': 2636,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6997/20436997/exterior_front_driver-1774692607004.jpg',
'Width': 3515},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2156930,
'Height': 2861,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6997/20436997/exterior_rear_driver-1774692628724.jpg',
'Width': 3815},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2342385,
'Height': 2808,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6997/20436997/exterior_front_passenger-1774695715920.jpg',
'Width': 3744},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2074482,
'Height': 2866,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6997/20436997/exterior_rear_passenger-1774692638902.jpg',
'Width': 3821},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3481352,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6997/20436997/interior_front_seats-1774693863285.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2277506,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6997/20436997/interior_rear_seats-1774693809527.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1763021,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6997/20436997/interior_dashboard-1774693833763.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1677658,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6997/20436997/instrument_cluster-1774693625010.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4488848,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6997/20436997/interior_boot-1774693841991.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe22ee59-cdcc-56d4-b29a-37052b6c1ce3/fe22ee59-cdcc-56d4-b29a-37052b6c1ce3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1121014,
'Height': 870,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6997/20436997/docs_service_history-1774694956218.jpg?ixlib=js-3.8.0&auto=format&s=9cdcd83f1b4b63010bf33958f9b6ef97',
'Width': 2437}],
'price': 24165,
'price_includes_vat': False,
'registration_date': '2021-08-05',
'seats_number': None,
'seller_name': None,
'title': 'BMW X3 xDrive 20d M Sport MHEV Auto',
'transmission': 'automatic',
'trim': 'xDrive 20d M Sport MHEV Auto',
'vin': 'WBA36BG010N104865',
'year': 2021}
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720436997%27 HTTP/1.1" 200 None
2026-03-29 20:02:42 [motorway.uk] INFO: Saving data for 20436997: {'created_time': 1774814562.537178, 'last_price_update_time': 1774814562.537188, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20436997') HTTP/1.1" 204 0
2026-03-29 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6556/19286556/docs_service_history-1774722194480-2.jpeg?ixlib=js-3.8.0&auto=format&s=2a626f45c45cec66da37cb8da63eb797> (referer: None)
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 19350653
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 13711845
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713711845%27 HTTP/1.1" 200 None
2026-03-29 20:02:42 [motorway.uk] INFO: Scrape type for 13711845: 1
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 14441433
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 20499741
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 10678898
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710678898%27 HTTP/1.1" 200 None
2026-03-29 20:02:42 [motorway.uk] INFO: Scrape type for 10678898: 1
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 19016165
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719016165%27 HTTP/1.1" 200 None
2026-03-29 20:02:42 [motorway.uk] INFO: Scrape type for 19016165: 1
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 20458519
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 20500024
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 20461118
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720461118%27 HTTP/1.1" 200 None
2026-03-29 20:02:42 [motorway.uk] INFO: Scrape type for 20461118: 1
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 11411855
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711411855%27 HTTP/1.1" 200 None
2026-03-29 20:02:42 [motorway.uk] INFO: Scrape type for 11411855: 1
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 20459543
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 18543563
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 20269831
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 20341046
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 20265542
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 10211430
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 20484735
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 20488534
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 1773065
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%271773065%27 HTTP/1.1" 200 None
2026-03-29 20:02:42 [motorway.uk] INFO: Scrape type for 1773065: 1
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 14164507
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 19886114
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719886114%27 HTTP/1.1" 200 None
2026-03-29 20:02:42 [motorway.uk] INFO: Scrape type for 19886114: 1
2026-03-29 20:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f938cd50>
2026-03-29 20:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbbe981b-30fc-51f9-85a5-d5deae559a56/cbbe981b-30fc-51f9-85a5-d5deae559a56_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6556%252F19286556%252Fdocs_service_history-1774722194480-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2a626f45c45cec66da37cb8da63eb797') HTTP/1.1" 204 0
2026-03-29 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6556/19286556/docs_service_history-1774722194480-2.jpeg?ixlib=js-3.8.0&auto=format&s=2a626f45c45cec66da37cb8da63eb797 saved to cache
2026-03-29 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cbbe981b-30fc-51f9-85a5-d5deae559a56
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 20414483
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 19235402
2026-03-29 20:02:42 [motorway.uk] INFO: Found listing with ID: 20488258
2026-03-29 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7223/20497223/docs_service_history-1774777544522.jpg?ixlib=js-3.8.0&auto=format&s=c7bc856d4e5a2304094f793238e86ae5> (referer: None)
2026-03-29 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7059/20137059/docs_service_history-1774717820344.jpg?ixlib=js-3.8.0&auto=format&s=25470ab3af12c15c9fd1843f39d741d5> (referer: None)
2026-03-29 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7059/20137059/interior_boot-1774713481114.jpg> (referer: None)
2026-03-29 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19687443.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20416082.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11716723.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20463571.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20429190.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa18bf10>
2026-03-29 20:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cbf02a5-5d85-5b99-81ac-84dd692313ff/4cbf02a5-5d85-5b99-81ac-84dd692313ff_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7223%252F20497223%252Fdocs_service_history-1774777544522.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc7bc856d4e5a2304094f793238e86ae5') HTTP/1.1" 204 0
2026-03-29 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7223/20497223/docs_service_history-1774777544522.jpg?ixlib=js-3.8.0&auto=format&s=c7bc856d4e5a2304094f793238e86ae5 saved to cache
2026-03-29 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cbf02a5-5d85-5b99-81ac-84dd692313ff
2026-03-29 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10385844.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:42 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:02:42 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:02:42 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1e$\xde\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\x8b\x02\x00\x1d\xfa\xe3\x00\x00\x00\x00'
2026-03-29 20:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb2790>
2026-03-29 20:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7059%252F20137059%252Fdocs_service_history-1774717820344.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D25470ab3af12c15c9fd1843f39d741d5') HTTP/1.1" 204 0
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7059/20137059/docs_service_history-1774717820344.jpg?ixlib=js-3.8.0&auto=format&s=25470ab3af12c15c9fd1843f39d741d5 saved to cache
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d830cab0-5036-5e8d-801f-771efc6489ca
2026-03-29 20:02:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae99410>
2026-03-29 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7059%252F20137059%252Finterior_boot-1774713481114.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7059/20137059/interior_boot-1774713481114.jpg saved to cache
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d830cab0-5036-5e8d-801f-771efc6489ca
2026-03-29 20:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d830cab0-5036-5e8d-801f-771efc6489ca, skipping ID generation
2026-03-29 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d830cab0-5036-5e8d-801f-771efc6489ca with scrape type 1
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d830cab0-5036-5e8d-801f-771efc6489ca sending to next pipeline
2026-03-29 20:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d830cab0-5036-5e8d-801f-771efc6489ca, identifier: 20137059
2026-03-29 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff29d4b-c906-5bff-9cea-f61df202f62a with identifier: 19687443
2026-03-29 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ff29d4b-c906-5bff-9cea-f61df202f62a with scrape type 1
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ff29d4b-c906-5bff-9cea-f61df202f62a
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7443%252F19687443%252Fexterior_front_driver-1774719391037.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7443/19687443/exterior_front_driver-1774719391037.jpg not downloaded yet
2026-03-29 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a44e57ef-48b7-5d1e-973e-c4154fa23ad0 with identifier: 20416082
2026-03-29 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a44e57ef-48b7-5d1e-973e-c4154fa23ad0 with scrape type 1
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a44e57ef-48b7-5d1e-973e-c4154fa23ad0
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6082%252F20416082%252Fexterior_front_driver-1774697921530.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6082/20416082/exterior_front_driver-1774697921530.jpg not downloaded yet
2026-03-29 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6721187a-38d1-523b-896c-7540b6ce2c3e with identifier: 11716723
2026-03-29 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6721187a-38d1-523b-896c-7540b6ce2c3e with scrape type 1
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6721187a-38d1-523b-896c-7540b6ce2c3e
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6723%252F11716723%252Fexterior_front_driver-1774712195976.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6723/11716723/exterior_front_driver-1774712195976.jpg not downloaded yet
2026-03-29 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340cbf69-778f-51ac-bb3e-6b60dfbcd528 with identifier: 20463571
2026-03-29 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340cbf69-778f-51ac-bb3e-6b60dfbcd528 with scrape type 1
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 340cbf69-778f-51ac-bb3e-6b60dfbcd528
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20463571%252Fexterior_front_driver-1774598343472.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20463571/exterior_front_driver-1774598343472.jpg not downloaded yet
2026-03-29 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9235b29a-de54-5ffb-8eef-fd6f5016e862 with identifier: 20429190
2026-03-29 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9235b29a-de54-5ffb-8eef-fd6f5016e862 with scrape type 1
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9235b29a-de54-5ffb-8eef-fd6f5016e862
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9190%252F20429190%252Fexterior_front_driver-1774710798757.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9190/20429190/exterior_front_driver-1774710798757.jpg not downloaded yet
2026-03-29 20:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d830cab0-5036-5e8d-801f-771efc6489ca with identifier: 20137059
2026-03-29 20:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d830cab0-5036-5e8d-801f-771efc6489ca with identifier: 20137059
2026-03-29 20:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d830cab0-5036-5e8d-801f-771efc6489ca with identifier: 20137059 to the API
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7059/20137059/interior_boot-1774713481114.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd830cab0-5036-5e8d-801f-771efc6489ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MD24 DAA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20137059',
'listing': 'auction',
'location': 'None None',
'make': 'Audi',
'model': 'Q2',
'odometer': 15800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1232965,
'Height': 2543,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_front_driver-1774712962960.jpg',
'Width': 3390},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1861536,
'Height': 2768,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_rear_driver-1774713031314.jpg',
'Width': 3690},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1828944,
'Height': 2600,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_front_passenger-1774713008419.jpg',
'Width': 3467},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1761295,
'Height': 2615,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7059/20137059/exterior_rear_passenger-1774712994279.jpg',
'Width': 3486},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2354873,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7059/20137059/interior_front_seats-1774713361641.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3319118,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7059/20137059/interior_rear_seats-1774715985658.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2213245,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7059/20137059/interior_dashboard-1774716981439.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1755358,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7059/20137059/instrument_cluster-1774717707190.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3607260,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7059/20137059/interior_boot-1774713481114.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d830cab0-5036-5e8d-801f-771efc6489ca/d830cab0-5036-5e8d-801f-771efc6489ca_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2207712,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7059/20137059/docs_service_history-1774717820344.jpg?ixlib=js-3.8.0&auto=format&s=25470ab3af12c15c9fd1843f39d741d5',
'Width': 4032}],
'price': 22733,
'price_includes_vat': False,
'registration_date': '2024-05-29',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q2 S Line 35 TFSI S-A',
'transmission': 'automatic',
'trim': 'S Line 35 TFSI S-A',
'vin': 'WAUZZZGA7RA058417',
'year': 2024}
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720137059%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [motorway.uk] INFO: Saving data for 20137059: {'created_time': 1774814564.017643, 'last_price_update_time': 1774814564.017652, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20137059') HTTP/1.1" 204 0
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7443%252F19687443%252Fexterior_rear_driver-1774719383367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7443/19687443/exterior_rear_driver-1774719383367.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6082%252F20416082%252Fexterior_rear_driver-1774697930685.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6082/20416082/exterior_rear_driver-1774697930685.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6723%252F11716723%252Fexterior_rear_driver-1774712203435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6723/11716723/exterior_rear_driver-1774712203435.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20463571%252Fexterior_rear_driver-1774598360726.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20463571/exterior_rear_driver-1774598360726.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9190%252F20429190%252Fexterior_rear_driver-1774710153088.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9190/20429190/exterior_rear_driver-1774710153088.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7443%252F19687443%252Fexterior_front_passenger-1774719392849.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7443/19687443/exterior_front_passenger-1774719392849.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6082%252F20416082%252Fexterior_front_passenger-1774698047912.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6082/20416082/exterior_front_passenger-1774698047912.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6723%252F11716723%252Fexterior_front_passenger-1774712232960.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6723/11716723/exterior_front_passenger-1774712232960.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20463571%252Fexterior_front_passenger-1774598401504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20463571/exterior_front_passenger-1774598401504.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9190%252F20429190%252Fexterior_front_passenger-1774710831202.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9190/20429190/exterior_front_passenger-1774710831202.jpg not downloaded yet
2026-03-29 20:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 096ca068-7357-51fc-bb6a-11c1336972d0 with identifier: 10385844
2026-03-29 20:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 096ca068-7357-51fc-bb6a-11c1336972d0 with scrape type 1
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 096ca068-7357-51fc-bb6a-11c1336972d0
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5844%252F10385844%252Fexterior_front_driver-1774710488858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5844/10385844/exterior_front_driver-1774710488858.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7443%252F19687443%252Fexterior_rear_passenger-1774719385688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7443/19687443/exterior_rear_passenger-1774719385688.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6082%252F20416082%252Fexterior_rear_passenger-1774697965382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6082/20416082/exterior_rear_passenger-1774697965382.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6723%252F11716723%252Fexterior_rear_passenger-1774712214519.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6723/11716723/exterior_rear_passenger-1774712214519.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20463571%252Fexterior_rear_passenger-1774598388908.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20463571/exterior_rear_passenger-1774598388908.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9190%252F20429190%252Fexterior_rear_passenger-1774710889788.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9190/20429190/exterior_rear_passenger-1774710889788.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5844%252F10385844%252Fexterior_rear_driver-1774707623498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5844/10385844/exterior_rear_driver-1774707623498.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7443%252F19687443%252Finterior_front_seats-1774720707995.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7443/19687443/interior_front_seats-1774720707995.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6082%252F20416082%252Finterior_front_seats-1774699583263.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6082/20416082/interior_front_seats-1774699583263.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6723%252F11716723%252Finterior_front_seats-1774712871416.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6723/11716723/interior_front_seats-1774712871416.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3571%252F20463571%252Finterior_front_seats-1774598758653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3571/20463571/interior_front_seats-1774598758653.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9190%252F20429190%252Finterior_front_seats-1774710511012.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9190/20429190/interior_front_seats-1774710511012.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5844%252F10385844%252Fexterior_front_passenger-1774707565547.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5844/10385844/exterior_front_passenger-1774707565547.jpg not downloaded yet
2026-03-29 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20439498.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7443%252F19687443%252Finterior_rear_seats-1774720659151.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7443/19687443/interior_rear_seats-1774720659151.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6082%252F20416082%252Finterior_dashboard-1774699648720.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6082/20416082/interior_dashboard-1774699648720.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6723%252F11716723%252Finterior_rear_seats-1774712829715.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6723/11716723/interior_rear_seats-1774712829715.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3571%252F20463571%252Finterior_rear_seats-1774598706909.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3571/20463571/interior_rear_seats-1774598706909.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9190%252F20429190%252Finterior_rear_seats-1774710509741.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9190/20429190/interior_rear_seats-1774710509741.jpg not downloaded yet
2026-03-29 20:02:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5844%252F10385844%252Fexterior_rear_passenger-1774707560573.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5844/10385844/exterior_rear_passenger-1774707560573.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7443%252F19687443%252Finterior_dashboard-1774720473567.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7443/19687443/interior_dashboard-1774720473567.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6082%252F20416082%252Finstrument_cluster-1774699179566.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6082/20416082/instrument_cluster-1774699179566.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6723%252F11716723%252Finterior_dashboard-1774712858022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6723/11716723/interior_dashboard-1774712858022.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3571%252F20463571%252Finterior_dashboard-1774689909811.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3571/20463571/interior_dashboard-1774689909811.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9190%252F20429190%252Finterior_dashboard-1774710519887.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9190/20429190/interior_dashboard-1774710519887.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5844%252F10385844%252Finterior_front_seats-1774709184073.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5844/10385844/interior_front_seats-1774709184073.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7443%252F19687443%252Finstrument_cluster-1774783302912.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7443/19687443/instrument_cluster-1774783302912.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6082%252F20416082%252Finterior_boot-1774717268418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6082/20416082/interior_boot-1774717268418.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6723%252F11716723%252Finterior_boot-1774712937208.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6723/11716723/interior_boot-1774712937208.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20463571%252Finstrument_cluster-1774598787465.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20463571/instrument_cluster-1774598787465.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9190%252F20429190%252Finterior_boot-1774710511998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9190/20429190/interior_boot-1774710511998.jpg not downloaded yet
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5844%252F10385844%252Finterior_rear_seats-1774708948752.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5844/10385844/interior_rear_seats-1774708948752.jpg not downloaded yet
2026-03-29 20:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b303a091-c659-5473-a3a1-47c536778e8b with identifier: 20439498
2026-03-29 20:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b303a091-c659-5473-a3a1-47c536778e8b with scrape type 1
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b303a091-c659-5473-a3a1-47c536778e8b
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9498%252F20439498%252Fexterior_front_driver-1774543904116.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9498/20439498/exterior_front_driver-1774543904116.jpg not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7443%252F19687443%252Finterior_boot-1774720354937.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7443/19687443/interior_boot-1774720354937.jpg not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6082%252F20416082%252Fdocs_service_history-1774703580079.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9f789d397b5bff0a938df571789823be%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6082/20416082/docs_service_history-1774703580079.jpg?ixlib=js-3.8.0&auto=format&s=9f789d397b5bff0a938df571789823be not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6723%252F11716723%252Fdocs_service_history-1774714055623.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da76c66161de689138d8324467f54331d%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6723/11716723/docs_service_history-1774714055623.jpg?ixlib=js-3.8.0&auto=format&s=a76c66161de689138d8324467f54331d not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3571%252F20463571%252Finterior_boot-1774598737486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3571/20463571/interior_boot-1774598737486.jpg not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9190%252F20429190%252Fdocs_service_history-1774710628055.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D929a756df0df5b627c7c1559c048cc02%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9190/20429190/docs_service_history-1774710628055.jpg?ixlib=js-3.8.0&auto=format&s=929a756df0df5b627c7c1559c048cc02 not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5844%252F10385844%252Finterior_dashboard-1774710557289.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5844/10385844/interior_dashboard-1774710557289.jpg not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9498%252F20439498%252Fexterior_rear_driver-1774543898438.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9498/20439498/exterior_rear_driver-1774543898438.jpg not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7443%252F19687443%252Fdocs_service_history-1774720935859.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2db68d1e8ec438c343f3881958d93d69%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7443/19687443/docs_service_history-1774720935859.jpg?ixlib=js-3.8.0&auto=format&s=2db68d1e8ec438c343f3881958d93d69 not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6082%252F20416082%252Fdamage_scratches-1774698171762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6082/20416082/damage_scratches-1774698171762.jpg not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6723%252F11716723%252Fdocs_service_history-1774714056799.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcc222681b7bcedadd6c0d57a1d6629a6%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6723/11716723/docs_service_history-1774714056799.jpg?ixlib=js-3.8.0&auto=format&s=cc222681b7bcedadd6c0d57a1d6629a6 not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3571%252F20463571%252Fdocs_service_history-1774608451274.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D44cc4db9d2621086180005675c3dd5b8%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3571/20463571/docs_service_history-1774608451274.jpg?ixlib=js-3.8.0&auto=format&s=44cc4db9d2621086180005675c3dd5b8 not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9190%252F20429190%252Fdamage_scratches-1774710237764.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9190/20429190/damage_scratches-1774710237764.jpg not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5844%252F10385844%252Finstrument_cluster-1774708952594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5844/10385844/instrument_cluster-1774708952594.jpg not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9498%252F20439498%252Fexterior_front_passenger-1774543902920.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9498/20439498/exterior_front_passenger-1774543902920.jpg not downloaded yet
2026-03-29 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19899454.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9190/20429190/exterior_front_driver-1774710798757.jpg> (referer: None)
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5844%252F10385844%252Finterior_boot-1774708946111.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5844/10385844/interior_boot-1774708946111.jpg not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9498%252F20439498%252Fexterior_rear_passenger-1774543900803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9498/20439498/exterior_rear_passenger-1774543900803.jpg not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5844%252F10385844%252Fdocs_service_history-1774709293614.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd484d540fa8d7cea3cf56c638cb8d20c%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5844/10385844/docs_service_history-1774709293614.jpg?ixlib=js-3.8.0&auto=format&s=d484d540fa8d7cea3cf56c638cb8d20c not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9498%252F20439498%252Finterior_front_seats-1774544952624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9498/20439498/interior_front_seats-1774544952624.jpg not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9498%252F20439498%252Finterior_rear_seats-1774544912518.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9498/20439498/interior_rear_seats-1774544912518.jpg not downloaded yet
2026-03-29 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9190/20429190/exterior_rear_driver-1774710153088.jpg> (referer: None)
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9498%252F20439498%252Finterior_dashboard-1774544926590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9498/20439498/interior_dashboard-1774544926590.jpg not downloaded yet
2026-03-29 20:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8607cd15-7376-5596-bb52-433c8a2daa97 with identifier: 19899454
2026-03-29 20:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8607cd15-7376-5596-bb52-433c8a2daa97 with scrape type 1
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8607cd15-7376-5596-bb52-433c8a2daa97
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F19899454%252Fexterior_front_driver-1774716732528.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_front_driver-1774716732528.jpg not downloaded yet
2026-03-29 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a80f90>
2026-03-29 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235b29a-de54-5ffb-8eef-fd6f5016e862/9235b29a-de54-5ffb-8eef-fd6f5016e862_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9190%252F20429190%252Fexterior_front_driver-1774710798757.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9190/20429190/exterior_front_driver-1774710798757.jpg saved to cache
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9235b29a-de54-5ffb-8eef-fd6f5016e862
2026-03-29 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7443/19687443/exterior_rear_driver-1774719383367.jpg> (referer: None)
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9498%252F20439498%252Finterior_boot-1774544906201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9498/20439498/interior_boot-1774544906201.jpg not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F19899454%252Fexterior_rear_driver-1774716758441.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_rear_driver-1774716758441.jpg not downloaded yet
2026-03-29 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=468&page=13&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9498%252F20439498%252Fdocs_service_history-1774556558290-3.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1bcf9d1abacacacfde251ba4c94d04b7%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9498/20439498/docs_service_history-1774556558290-3.jpeg?ixlib=js-3.8.0&auto=format&s=1bcf9d1abacacacfde251ba4c94d04b7 not downloaded yet
2026-03-29 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ab80d0>
2026-03-29 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235b29a-de54-5ffb-8eef-fd6f5016e862/9235b29a-de54-5ffb-8eef-fd6f5016e862_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9190%252F20429190%252Fexterior_rear_driver-1774710153088.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9190/20429190/exterior_rear_driver-1774710153088.jpg saved to cache
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9235b29a-de54-5ffb-8eef-fd6f5016e862
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F19899454%252Fexterior_front_passenger-1774716781854.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_front_passenger-1774716781854.jpg not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9498%252F20439498%252Fdocs_service_history-1774627844088.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd8bacce6a4ccec07cc71ecfac6e46f49%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9498/20439498/docs_service_history-1774627844088.jpg?ixlib=js-3.8.0&auto=format&s=d8bacce6a4ccec07cc71ecfac6e46f49 not downloaded yet
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F19899454%252Fexterior_rear_passenger-1774716785410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_rear_passenger-1774716785410.jpg not downloaded yet
2026-03-29 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadb7b90>
2026-03-29 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ff29d4b-c906-5bff-9cea-f61df202f62a/1ff29d4b-c906-5bff-9cea-f61df202f62a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7443%252F19687443%252Fexterior_rear_driver-1774719383367.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7443/19687443/exterior_rear_driver-1774719383367.jpg saved to cache
2026-03-29 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ff29d4b-c906-5bff-9cea-f61df202f62a
2026-03-29 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6723/11716723/exterior_rear_driver-1774712203435.jpg> (referer: None)
2026-03-29 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3571/20463571/docs_service_history-1774608451274.jpg?ixlib=js-3.8.0&auto=format&s=44cc4db9d2621086180005675c3dd5b8> (referer: None)
2026-03-29 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3571/20463571/exterior_rear_driver-1774598360726.jpg> (referer: None)
2026-03-29 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F19899454%252Finterior_front_seats-1774716804401.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/19899454/interior_front_seats-1774716804401.jpg not downloaded yet
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20462264
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720462264%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [motorway.uk] INFO: Scrape type for 20462264: 1
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F19899454%252Finterior_rear_seats-1774716812159.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/19899454/interior_rear_seats-1774716812159.jpg not downloaded yet
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20078752
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20484739
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20424839
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 16384485
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 19642157
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 18664090
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 19912374
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20481823
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 10709908
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20486849
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20467542
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 17665821
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 2147652
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20382820
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20413228
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20369309
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720369309%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [motorway.uk] INFO: Scrape type for 20369309: 1
2026-03-29 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9190/20429190/interior_front_seats-1774710511012.jpg> (referer: None)
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F19899454%252Finterior_dashboard-1774716837033.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/19899454/interior_dashboard-1774716837033.jpg not downloaded yet
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20039478
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 18265628
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718265628%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [motorway.uk] INFO: Scrape type for 18265628: 1
2026-03-29 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3571/20463571/exterior_front_driver-1774598343472.jpg> (referer: None)
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F19899454%252Finterior_boot-1774716828336.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/19899454/interior_boot-1774716828336.jpg not downloaded yet
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20220021
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20487110
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487110%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [motorway.uk] INFO: Scrape type for 20487110: 1
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81058d0>
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6721187a-38d1-523b-896c-7540b6ce2c3e/6721187a-38d1-523b-896c-7540b6ce2c3e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6723%252F11716723%252Fexterior_rear_driver-1774712203435.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6723/11716723/exterior_rear_driver-1774712203435.jpg saved to cache
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6721187a-38d1-523b-896c-7540b6ce2c3e
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e3e5d0>
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340cbf69-778f-51ac-bb3e-6b60dfbcd528/340cbf69-778f-51ac-bb3e-6b60dfbcd528_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3571%252F20463571%252Fdocs_service_history-1774608451274.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D44cc4db9d2621086180005675c3dd5b8') HTTP/1.1" 204 0
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3571/20463571/docs_service_history-1774608451274.jpg?ixlib=js-3.8.0&auto=format&s=44cc4db9d2621086180005675c3dd5b8 saved to cache
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 340cbf69-778f-51ac-bb3e-6b60dfbcd528
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F19899454%252Fdamage_scratches-1774716865120.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/19899454/damage_scratches-1774716865120.jpg not downloaded yet
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 18634459
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 11969339
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20487185
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487185%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [motorway.uk] INFO: Scrape type for 20487185: 2
2026-03-29 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18839642.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac95d50>
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340cbf69-778f-51ac-bb3e-6b60dfbcd528/340cbf69-778f-51ac-bb3e-6b60dfbcd528_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20463571%252Fexterior_rear_driver-1774598360726.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20463571/exterior_rear_driver-1774598360726.jpg saved to cache
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 340cbf69-778f-51ac-bb3e-6b60dfbcd528
2026-03-29 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13711845.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F19899454%252Fdamage_scratches-1774716874505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/19899454/damage_scratches-1774716874505.jpg not downloaded yet
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 18469041
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20456356
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 18709305
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20490237
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 19442969
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20171226
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 18254903
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 9247330
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20221098
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20269740
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720269740%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [motorway.uk] INFO: Scrape type for 20269740: 1
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ab9850>
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235b29a-de54-5ffb-8eef-fd6f5016e862/9235b29a-de54-5ffb-8eef-fd6f5016e862_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9190%252F20429190%252Finterior_front_seats-1774710511012.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9190/20429190/interior_front_seats-1774710511012.jpg saved to cache
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9235b29a-de54-5ffb-8eef-fd6f5016e862
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700e0abd0>
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340cbf69-778f-51ac-bb3e-6b60dfbcd528/340cbf69-778f-51ac-bb3e-6b60dfbcd528_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3571%252F20463571%252Fexterior_front_driver-1774598343472.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3571/20463571/exterior_front_driver-1774598343472.jpg saved to cache
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 340cbf69-778f-51ac-bb3e-6b60dfbcd528
2026-03-29 20:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 899d953e-e9a5-50f4-87a3-62d5f5e7a338 with identifier: 18839642
2026-03-29 20:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338 with scrape type 1
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9642%252F18839642%252Fexterior_front_driver-1774698250746.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_front_driver-1774698250746.jpg not downloaded yet
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 20454557
2026-03-29 20:02:46 [motorway.uk] INFO: Found listing with ID: 18587365
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718587365%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [motorway.uk] INFO: Scrape type for 18587365: 1
2026-03-29 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9190/20429190/damage_scratches-1774710237764.jpg> (referer: None)
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9642%252F18839642%252Fexterior_rear_driver-1774698375637.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_rear_driver-1774698375637.jpg not downloaded yet
2026-03-29 20:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baecc2a4-6eae-58a2-afcf-41fc5c4e6b90 with identifier: 13711845
2026-03-29 20:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90 with scrape type 1
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1845%252F13711845%252Fexterior_front_driver-1774620224894.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1845/13711845/exterior_front_driver-1774620224894.jpg not downloaded yet
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9642%252F18839642%252Fexterior_front_passenger-1774698345479.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_front_passenger-1774698345479.jpg not downloaded yet
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1845%252F13711845%252Fexterior_rear_driver-1774620244383.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1845/13711845/exterior_rear_driver-1774620244383.jpg not downloaded yet
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9642%252F18839642%252Fexterior_rear_passenger-1774698375918.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_rear_passenger-1774698375918.jpg not downloaded yet
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1845%252F13711845%252Fexterior_front_passenger-1774620264961.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1845/13711845/exterior_front_passenger-1774620264961.jpg not downloaded yet
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9642%252F18839642%252Finterior_front_seats-1774698439123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9642/18839642/interior_front_seats-1774698439123.jpg not downloaded yet
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1845%252F13711845%252Fexterior_rear_passenger-1774713281174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1845/13711845/exterior_rear_passenger-1774713281174.jpg not downloaded yet
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9642%252F18839642%252Finterior_rear_seats-1774698504045.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9642/18839642/interior_rear_seats-1774698504045.jpg not downloaded yet
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac941d0>
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235b29a-de54-5ffb-8eef-fd6f5016e862/9235b29a-de54-5ffb-8eef-fd6f5016e862_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9190%252F20429190%252Fdamage_scratches-1774710237764.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9190/20429190/damage_scratches-1774710237764.jpg saved to cache
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9235b29a-de54-5ffb-8eef-fd6f5016e862
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1845%252F13711845%252Finterior_front_seats-1774713294065.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1845/13711845/interior_front_seats-1774713294065.jpg not downloaded yet
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9642%252F18839642%252F18839642-interior_dashboard-modified-1774702141555.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9642/18839642/18839642-interior_dashboard-modified-1774702141555.jpeg not downloaded yet
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1845%252F13711845%252Finterior_rear_seats-1774620514796.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1845/13711845/interior_rear_seats-1774620514796.jpg not downloaded yet
2026-03-29 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9498/20439498/docs_service_history-1774627844088.jpg?ixlib=js-3.8.0&auto=format&s=d8bacce6a4ccec07cc71ecfac6e46f49> (referer: None)
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9642%252F18839642%252F18839642-instrument_cluster-modified-1774702413817.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9642/18839642/18839642-instrument_cluster-modified-1774702413817.jpeg not downloaded yet
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1845%252F13711845%252Finterior_dashboard-1774713305316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1845/13711845/interior_dashboard-1774713305316.jpg not downloaded yet
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9642%252F18839642%252Finterior_boot-1774698634533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9642/18839642/interior_boot-1774698634533.jpg not downloaded yet
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1845%252F13711845%252Finstrument_cluster-1774620578994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1845/13711845/instrument_cluster-1774620578994.jpg not downloaded yet
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9642%252F18839642%252Fdocs_service_history-1774700740571.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da56bc4fb3580c86db58696860463c000%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9642/18839642/docs_service_history-1774700740571.jpg?ixlib=js-3.8.0&auto=format&s=a56bc4fb3580c86db58696860463c000 not downloaded yet
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1845%252F13711845%252Finterior_boot-1774620569508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1845/13711845/interior_boot-1774620569508.jpg not downloaded yet
2026-03-29 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_front_driver-1774698250746.jpg> (referer: None)
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1845%252F13711845%252Fdocs_service_history-1774620849047.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9ef330c1122c27363db99f0db1122c4d%27 HTTP/1.1" 200 None
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1845/13711845/docs_service_history-1774620849047.jpg?ixlib=js-3.8.0&auto=format&s=9ef330c1122c27363db99f0db1122c4d not downloaded yet
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81b7790>
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b303a091-c659-5473-a3a1-47c536778e8b/b303a091-c659-5473-a3a1-47c536778e8b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9498%252F20439498%252Fdocs_service_history-1774627844088.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd8bacce6a4ccec07cc71ecfac6e46f49') HTTP/1.1" 204 0
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9498/20439498/docs_service_history-1774627844088.jpg?ixlib=js-3.8.0&auto=format&s=d8bacce6a4ccec07cc71ecfac6e46f49 saved to cache
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b303a091-c659-5473-a3a1-47c536778e8b
2026-03-29 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9498/20439498/interior_dashboard-1774544926590.jpg> (referer: None)
2026-03-29 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9498/20439498/interior_boot-1774544906201.jpg> (referer: None)
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9648390>
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9642%252F18839642%252Fexterior_front_driver-1774698250746.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_front_driver-1774698250746.jpg saved to cache
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a11c10>
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b303a091-c659-5473-a3a1-47c536778e8b/b303a091-c659-5473-a3a1-47c536778e8b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9498%252F20439498%252Finterior_dashboard-1774544926590.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9498/20439498/interior_dashboard-1774544926590.jpg saved to cache
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b303a091-c659-5473-a3a1-47c536778e8b
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9264f50>
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b303a091-c659-5473-a3a1-47c536778e8b/b303a091-c659-5473-a3a1-47c536778e8b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9498%252F20439498%252Finterior_boot-1774544906201.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9498/20439498/interior_boot-1774544906201.jpg saved to cache
2026-03-29 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b303a091-c659-5473-a3a1-47c536778e8b
2026-03-29 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_front_passenger-1774716781854.jpg> (referer: None)
2026-03-29 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_rear_passenger-1774716785410.jpg> (referer: None)
2026-03-29 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9454/19899454/damage_scratches-1774716874505.jpg> (referer: None)
2026-03-29 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1845/13711845/docs_service_history-1774620849047.jpg?ixlib=js-3.8.0&auto=format&s=9ef330c1122c27363db99f0db1122c4d> (referer: None)
2026-03-29 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6082/20416082/exterior_rear_driver-1774697930685.jpg> (referer: None)
2026-03-29 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490324.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9498/20439498/interior_rear_seats-1774544912518.jpg> (referer: None)
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f911d390>
2026-03-29 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F19899454%252Fexterior_front_passenger-1774716781854.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_front_passenger-1774716781854.jpg saved to cache
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8607cd15-7376-5596-bb52-433c8a2daa97
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a10350>
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F19899454%252Fexterior_rear_passenger-1774716785410.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_rear_passenger-1774716785410.jpg saved to cache
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8607cd15-7376-5596-bb52-433c8a2daa97
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700de0310>
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F19899454%252Fdamage_scratches-1774716874505.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/19899454/damage_scratches-1774716874505.jpg saved to cache
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8607cd15-7376-5596-bb52-433c8a2daa97
2026-03-29 20:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a12d50>
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1845%252F13711845%252Fdocs_service_history-1774620849047.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9ef330c1122c27363db99f0db1122c4d') HTTP/1.1" 204 0
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1845/13711845/docs_service_history-1774620849047.jpg?ixlib=js-3.8.0&auto=format&s=9ef330c1122c27363db99f0db1122c4d saved to cache
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90
2026-03-29 20:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f5a4d0>
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a44e57ef-48b7-5d1e-973e-c4154fa23ad0/a44e57ef-48b7-5d1e-973e-c4154fa23ad0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6082%252F20416082%252Fexterior_rear_driver-1774697930685.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6082/20416082/exterior_rear_driver-1774697930685.jpg saved to cache
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a44e57ef-48b7-5d1e-973e-c4154fa23ad0
2026-03-29 20:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8 with identifier: 20490324
2026-03-29 20:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8 with scrape type 1
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0324%252F20490324%252Fexterior_front_driver-1774711796617.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0324/20490324/exterior_front_driver-1774711796617.jpg not downloaded yet
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90bb850>
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b303a091-c659-5473-a3a1-47c536778e8b/b303a091-c659-5473-a3a1-47c536778e8b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9498%252F20439498%252Finterior_rear_seats-1774544912518.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9498/20439498/interior_rear_seats-1774544912518.jpg saved to cache
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b303a091-c659-5473-a3a1-47c536778e8b
2026-03-29 20:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9642/18839642/docs_service_history-1774700740571.jpg?ixlib=js-3.8.0&auto=format&s=a56bc4fb3580c86db58696860463c000> (referer: None)
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0324%252F20490324%252Fexterior_rear_driver-1774713322209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0324/20490324/exterior_rear_driver-1774713322209.jpg not downloaded yet
2026-03-29 20:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16271814.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0324%252F20490324%252Fexterior_front_passenger-1774711876971.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0324/20490324/exterior_front_passenger-1774711876971.jpg not downloaded yet
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0324%252F20490324%252Fexterior_rear_passenger-1774713224703.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0324/20490324/exterior_rear_passenger-1774713224703.jpg not downloaded yet
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0324%252F20490324%252Finterior_front_seats-1774714573781.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0324/20490324/interior_front_seats-1774714573781.jpg not downloaded yet
2026-03-29 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0324%252F20490324%252Finterior_rear_seats-1774712346426.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0324/20490324/interior_rear_seats-1774712346426.jpg not downloaded yet
2026-03-29 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1845/13711845/interior_rear_seats-1774620514796.jpg> (referer: None)
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0324%252F20490324%252Finterior_dashboard-1774713239559.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0324/20490324/interior_dashboard-1774713239559.jpg not downloaded yet
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0324%252F20490324%252Finterior_boot-1774714596968.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0324/20490324/interior_boot-1774714596968.jpg not downloaded yet
2026-03-29 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafbe350>
2026-03-29 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9642%252F18839642%252Fdocs_service_history-1774700740571.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da56bc4fb3580c86db58696860463c000') HTTP/1.1" 204 0
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9642/18839642/docs_service_history-1774700740571.jpg?ixlib=js-3.8.0&auto=format&s=a56bc4fb3580c86db58696860463c000 saved to cache
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338
2026-03-29 20:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4fb2af7-b38b-5ba3-80ee-dbccd65237de with identifier: 16271814
2026-03-29 20:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de with scrape type 1
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1814%252F16271814%252Fexterior_front_driver-1774717952404.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1814/16271814/exterior_front_driver-1774717952404.jpg not downloaded yet
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0324%252F20490324%252Fdocs_service_history-1774711509365.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D452392946621465e9ca5d80e268da8c1%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0324/20490324/docs_service_history-1774711509365.jpg?ixlib=js-3.8.0&auto=format&s=452392946621465e9ca5d80e268da8c1 not downloaded yet
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1814%252F16271814%252Fexterior_rear_driver-1774714664497.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1814/16271814/exterior_rear_driver-1774714664497.jpg not downloaded yet
2026-03-29 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19930182.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19886114.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0324%252F20490324%252Fdocs_service_history-1774711509672.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D57cf5808617f96693c4c81693cec6b29%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0324/20490324/docs_service_history-1774711509672.jpg?ixlib=js-3.8.0&auto=format&s=57cf5808617f96693c4c81693cec6b29 not downloaded yet
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1814%252F16271814%252Fexterior_front_passenger-1774717970301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1814/16271814/exterior_front_passenger-1774717970301.jpg not downloaded yet
2026-03-29 20:02:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:02:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85c5a50>
2026-03-29 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1845%252F13711845%252Finterior_rear_seats-1774620514796.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1845/13711845/interior_rear_seats-1774620514796.jpg saved to cache
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1814%252F16271814%252Fexterior_rear_passenger-1774714713688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1814/16271814/exterior_rear_passenger-1774714713688.jpg not downloaded yet
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1814%252F16271814%252Finterior_front_seats-1774715405244.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1814/16271814/interior_front_seats-1774715405244.jpg not downloaded yet
2026-03-29 20:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19f0ae3f-e581-50ab-8325-c08b1c0dbc56 with identifier: 19930182
2026-03-29 20:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56 with scrape type 1
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0182%252F19930182%252Fexterior_front_driver-1774626894847.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_front_driver-1774626894847.jpg not downloaded yet
2026-03-29 20:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 572d1c49-572c-517b-8634-90a18f81fffd with identifier: 19886114
2026-03-29 20:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572d1c49-572c-517b-8634-90a18f81fffd with scrape type 1
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 572d1c49-572c-517b-8634-90a18f81fffd
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6114%252F19886114%252Fexterior_front_driver-1773942385179.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6114/19886114/exterior_front_driver-1773942385179.jpg already downloaded
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6114%252F19886114%252Fexterior_rear_driver-1773942519668.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6114/19886114/exterior_rear_driver-1773942519668.jpg already downloaded
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6114%252F19886114%252Fexterior_front_passenger-1773942416463.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6114/19886114/exterior_front_passenger-1773942416463.jpg already downloaded
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6114%252F19886114%252Fexterior_rear_passenger-1773942403922.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6114/19886114/exterior_rear_passenger-1773942403922.jpg already downloaded
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6114%252F19886114%252Finterior_front_seats-1773943113946.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6114/19886114/interior_front_seats-1773943113946.jpg already downloaded
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6114%252F19886114%252Finterior_rear_seats-1773943086803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6114/19886114/interior_rear_seats-1773943086803.jpg already downloaded
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6114%252F19886114%252Finterior_dashboard-1773945557954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6114/19886114/interior_dashboard-1773945557954.jpg already downloaded
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6114%252F19886114%252Finstrument_cluster-1773943061311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6114/19886114/instrument_cluster-1773943061311.jpg already downloaded
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6114%252F19886114%252Finterior_boot-1773943047628.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6114/19886114/interior_boot-1773943047628.jpg already downloaded
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6114%252F19886114%252Fdocs_service_history-1773944924232.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1f891402352f5e6de34fdc4ee9271116%27 HTTP/1.1" 200 None
2026-03-29 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6114/19886114/docs_service_history-1773944924232.jpg?ixlib=js-3.8.0&auto=format&s=1f891402352f5e6de34fdc4ee9271116 already downloaded
2026-03-29 20:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 572d1c49-572c-517b-8634-90a18f81fffd, identifier: 19886114
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1814%252F16271814%252Finterior_rear_seats-1774715265860.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1814/16271814/interior_rear_seats-1774715265860.jpg not downloaded yet
2026-03-29 20:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 572d1c49-572c-517b-8634-90a18f81fffd with identifier: 19886114
2026-03-29 20:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 572d1c49-572c-517b-8634-90a18f81fffd with identifier: 19886114
2026-03-29 20:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 572d1c49-572c-517b-8634-90a18f81fffd with identifier: 19886114 to the API
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19886114.json>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '572d1c49-572c-517b-8634-90a18f81fffd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR18 VME',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19886114',
'listing': 'auction',
'location': 'Hertfordshire Bushey',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 12850,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/6114/19886114/exterior_front_driver-1773942385179.jpg',
'https://motorway-photos-redacted.imgix.net/6114/19886114/exterior_rear_driver-1773942519668.jpg',
'https://motorway-photos-redacted.imgix.net/6114/19886114/exterior_front_passenger-1773942416463.jpg',
'https://motorway-photos-redacted.imgix.net/6114/19886114/exterior_rear_passenger-1773942403922.jpg',
'https://motorway-photos.imgix.net/6114/19886114/interior_front_seats-1773943113946.jpg',
'https://motorway-photos.imgix.net/6114/19886114/interior_rear_seats-1773943086803.jpg',
'https://motorway-photos-modified.imgix.net/6114/19886114/interior_dashboard-1773945557954.jpg',
'https://motorway-photos-redacted.imgix.net/6114/19886114/instrument_cluster-1773943061311.jpg',
'https://motorway-photos.imgix.net/6114/19886114/interior_boot-1773943047628.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/6114/19886114/docs_service_history-1773944924232.jpg?ixlib=js-3.8.0&auto=format&s=1f891402352f5e6de34fdc4ee9271116'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf58bef0-22d5-5290-9021-bcb8b0cd216b/cf58bef0-22d5-5290-9021-bcb8b0cd216b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 721612,
'Height': 2413,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6114/19886114/exterior_front_driver-1773942385179.jpg',
'Width': 2815},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf58bef0-22d5-5290-9021-bcb8b0cd216b/cf58bef0-22d5-5290-9021-bcb8b0cd216b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 723529,
'Height': 2275,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6114/19886114/exterior_rear_driver-1773942519668.jpg',
'Width': 3033},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf58bef0-22d5-5290-9021-bcb8b0cd216b/cf58bef0-22d5-5290-9021-bcb8b0cd216b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1291372,
'Height': 2282,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6114/19886114/exterior_front_passenger-1773942416463.jpg',
'Width': 3043},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf58bef0-22d5-5290-9021-bcb8b0cd216b/cf58bef0-22d5-5290-9021-bcb8b0cd216b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763993,
'Height': 2265,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6114/19886114/exterior_rear_passenger-1773942403922.jpg',
'Width': 3020},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf58bef0-22d5-5290-9021-bcb8b0cd216b/cf58bef0-22d5-5290-9021-bcb8b0cd216b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7531200,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/6114/19886114/interior_front_seats-1773943113946.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf58bef0-22d5-5290-9021-bcb8b0cd216b/cf58bef0-22d5-5290-9021-bcb8b0cd216b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6243424,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/6114/19886114/interior_rear_seats-1773943086803.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf58bef0-22d5-5290-9021-bcb8b0cd216b/cf58bef0-22d5-5290-9021-bcb8b0cd216b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1449487,
'Height': 4080,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6114/19886114/interior_dashboard-1773945557954.jpg',
'Width': 5440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf58bef0-22d5-5290-9021-bcb8b0cd216b/cf58bef0-22d5-5290-9021-bcb8b0cd216b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5857416,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6114/19886114/instrument_cluster-1773943061311.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf58bef0-22d5-5290-9021-bcb8b0cd216b/cf58bef0-22d5-5290-9021-bcb8b0cd216b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7202282,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/6114/19886114/interior_boot-1773943047628.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf58bef0-22d5-5290-9021-bcb8b0cd216b/cf58bef0-22d5-5290-9021-bcb8b0cd216b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1074529,
'Height': 3060,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6114/19886114/docs_service_history-1773944924232.jpg?ixlib=js-3.8.0&auto=format&s=1f891402352f5e6de34fdc4ee9271116',
'Width': 4080}],
'price': 9800,
'price_includes_vat': False,
'registration_date': '2018-06-29',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Vignale Turbo',
'transmission': 'manual',
'trim': 'Vignale Turbo',
'vin': 'WF0JXXGAHJJJ01877',
'year': 2018}
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719886114%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [motorway.uk] INFO: Saving data for 19886114: {'created_time': 1774814570.50424, 'last_price_update_time': 1774814570.504252, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19886114') HTTP/1.1" 204 0
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0182%252F19930182%252Fexterior_rear_driver-1774626917359.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_rear_driver-1774626917359.jpg not downloaded yet
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9642/18839642/18839642-instrument_cluster-modified-1774702413817.jpeg> (referer: None)
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1814%252F16271814%252Finterior_dashboard-1774715299869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1814/16271814/interior_dashboard-1774715299869.jpg not downloaded yet
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0182%252F19930182%252Fexterior_front_passenger-1774626965119.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_front_passenger-1774626965119.jpg not downloaded yet
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1814%252F16271814%252Finstrument_cluster-1774715340227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1814/16271814/instrument_cluster-1774715340227.jpg not downloaded yet
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0182%252F19930182%252Fexterior_rear_passenger-1774626934207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_rear_passenger-1774626934207.jpg not downloaded yet
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1814%252F16271814%252Finterior_boot-1774715379293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1814/16271814/interior_boot-1774715379293.jpg not downloaded yet
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0182%252F19930182%252Finterior_front_seats-1774627469442.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0182/19930182/interior_front_seats-1774627469442.jpg not downloaded yet
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1814%252F16271814%252Fdocs_service_history-1774715565677.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc064f6522e94b3481c134635e8ede5cc%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1814/16271814/docs_service_history-1774715565677.jpg?ixlib=js-3.8.0&auto=format&s=c064f6522e94b3481c134635e8ede5cc not downloaded yet
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0182%252F19930182%252Finterior_rear_seats-1774627484764.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0182/19930182/interior_rear_seats-1774627484764.jpg not downloaded yet
2026-03-29 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf16290>
2026-03-29 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9642%252F18839642%252F18839642-instrument_cluster-modified-1774702413817.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9642/18839642/18839642-instrument_cluster-modified-1774702413817.jpeg saved to cache
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0182%252F19930182%252Finterior_dashboard-1774627519621.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0182/19930182/interior_dashboard-1774627519621.jpg not downloaded yet
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1845/13711845/interior_boot-1774620569508.jpg> (referer: None)
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20269740.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0182%252F19930182%252Finstrument_cluster-1774627558786.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0182/19930182/instrument_cluster-1774627558786.jpg not downloaded yet
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18587365.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0182%252F19930182%252Finterior_boot-1774627546271.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0182/19930182/interior_boot-1774627546271.jpg not downloaded yet
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0182%252F19930182%252Fdamage_scratches-1774627047864.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0182/19930182/damage_scratches-1774627047864.jpg not downloaded yet
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9642/18839642/interior_boot-1774698634533.jpg> (referer: None)
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9642/18839642/interior_rear_seats-1774698504045.jpg> (referer: None)
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0324/20490324/exterior_rear_driver-1774713322209.jpg> (referer: None)
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1845/13711845/instrument_cluster-1774620578994.jpg> (referer: None)
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0324/20490324/exterior_front_driver-1774711796617.jpg> (referer: None)
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1814/16271814/exterior_front_passenger-1774717970301.jpg> (referer: None)
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1814/16271814/exterior_rear_passenger-1774714713688.jpg> (referer: None)
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1845/13711845/interior_dashboard-1774713305316.jpg> (referer: None)
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1845/13711845/interior_front_seats-1774713294065.jpg> (referer: None)
2026-03-29 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9642/18839642/18839642-interior_dashboard-modified-1774702141555.jpeg> (referer: None)
2026-03-29 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0324/20490324/interior_front_seats-1774714573781.jpg> (referer: None)
2026-03-29 20:02:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:02:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf6d090>
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1845%252F13711845%252Finterior_boot-1774620569508.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1845/13711845/interior_boot-1774620569508.jpg saved to cache
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90
2026-03-29 20:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9084286-3b87-560e-a7b7-2460fa97be51 with identifier: 20269740
2026-03-29 20:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9084286-3b87-560e-a7b7-2460fa97be51 with scrape type 1
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9084286-3b87-560e-a7b7-2460fa97be51
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9740%252F20269740%252Fexterior_front_driver-1774539134479.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_front_driver-1774539134479.jpg not downloaded yet
2026-03-29 20:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c539b5e-b885-5389-b93c-c5fb6c5129af with identifier: 18587365
2026-03-29 20:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c539b5e-b885-5389-b93c-c5fb6c5129af with scrape type 1
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c539b5e-b885-5389-b93c-c5fb6c5129af
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7365%252F18587365%252Fexterior_front_driver-1774782175207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_front_driver-1774782175207.jpg not downloaded yet
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f924fa10>
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9642%252F18839642%252Finterior_boot-1774698634533.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9642/18839642/interior_boot-1774698634533.jpg saved to cache
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafd6550>
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9642%252F18839642%252Finterior_rear_seats-1774698504045.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9642/18839642/interior_rear_seats-1774698504045.jpg saved to cache
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf596d0>
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0324%252F20490324%252Fexterior_rear_driver-1774713322209.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0324/20490324/exterior_rear_driver-1774713322209.jpg saved to cache
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8
2026-03-29 20:02:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad70990>
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1845%252F13711845%252Finstrument_cluster-1774620578994.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1845/13711845/instrument_cluster-1774620578994.jpg saved to cache
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf5ad10>
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0324%252F20490324%252Fexterior_front_driver-1774711796617.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0324/20490324/exterior_front_driver-1774711796617.jpg saved to cache
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f907fc50>
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1814%252F16271814%252Fexterior_front_passenger-1774717970301.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1814/16271814/exterior_front_passenger-1774717970301.jpg saved to cache
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad907d0>
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1814%252F16271814%252Fexterior_rear_passenger-1774714713688.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1814/16271814/exterior_rear_passenger-1774714713688.jpg saved to cache
2026-03-29 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafd50d0>
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1845%252F13711845%252Finterior_dashboard-1774713305316.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1845/13711845/interior_dashboard-1774713305316.jpg saved to cache
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad90a10>
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1845%252F13711845%252Finterior_front_seats-1774713294065.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1845/13711845/interior_front_seats-1774713294065.jpg saved to cache
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f924fa50>
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9642%252F18839642%252F18839642-interior_dashboard-modified-1774702141555.jpeg') HTTP/1.1" 204 0
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9642/18839642/18839642-interior_dashboard-modified-1774702141555.jpeg saved to cache
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8aba6d0>
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0324%252F20490324%252Finterior_front_seats-1774714573781.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0324/20490324/interior_front_seats-1774714573781.jpg saved to cache
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9740%252F20269740%252Fexterior_rear_driver-1774539157511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_rear_driver-1774539157511.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7365%252F18587365%252Fexterior_rear_driver-1774781980513.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_rear_driver-1774781980513.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9740%252F20269740%252Fexterior_front_passenger-1774539183575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_front_passenger-1774539183575.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7365%252F18587365%252Fexterior_front_passenger-1774782013842.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_front_passenger-1774782013842.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9740%252F20269740%252Fexterior_rear_passenger-1774539160412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_rear_passenger-1774539160412.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7365%252F18587365%252Fexterior_rear_passenger-1774782051806.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_rear_passenger-1774782051806.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9740%252F20269740%252Finterior_front_seats-1774539879383.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9740/20269740/interior_front_seats-1774539879383.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7365%252F18587365%252Finterior_front_seats-1774625924811.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7365/18587365/interior_front_seats-1774625924811.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9740%252F20269740%252Finterior_rear_seats-1774539906558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9740/20269740/interior_rear_seats-1774539906558.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7365%252F18587365%252Finterior_rear_seats-1774784438335.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7365/18587365/interior_rear_seats-1774784438335.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9740%252F20269740%252Finterior_dashboard-1774539933683.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9740/20269740/interior_dashboard-1774539933683.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7365%252F18587365%252Finterior_dashboard-1774781932853.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7365/18587365/interior_dashboard-1774781932853.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9740%252F20269740%252Finstrument_cluster-1774539977264.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9740/20269740/instrument_cluster-1774539977264.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7365%252F18587365%252Finstrument_cluster-1774626015722.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7365/18587365/instrument_cluster-1774626015722.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9740%252F20269740%252Finterior_boot-1774539993809.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9740/20269740/interior_boot-1774539993809.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7365%252F18587365%252Finterior_boot-1774780868016.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7365/18587365/interior_boot-1774780868016.jpg not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9740%252F20269740%252Fdocs_service_history-1774540535541.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dde60cfc00dd158f5d3fa965775aa20e5%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9740/20269740/docs_service_history-1774540535541.jpg?ixlib=js-3.8.0&auto=format&s=de60cfc00dd158f5d3fa965775aa20e5 not downloaded yet
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7365%252F18587365%252Fdocs_service_history-1774626478079.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6d4558988d0bae9bedea969f92fdd051%27 HTTP/1.1" 200 None
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7365/18587365/docs_service_history-1774626478079.jpg?ixlib=js-3.8.0&auto=format&s=6d4558988d0bae9bedea969f92fdd051 not downloaded yet
2026-03-29 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_front_driver-1774782175207.jpg> (referer: None)
2026-03-29 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1814/16271814/interior_rear_seats-1774715265860.jpg> (referer: None)
2026-03-29 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_rear_driver-1774781980513.jpg> (referer: None)
2026-03-29 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0182/19930182/interior_rear_seats-1774627484764.jpg> (referer: None)
2026-03-29 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0182/19930182/interior_dashboard-1774627519621.jpg> (referer: None)
2026-03-29 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1814/16271814/docs_service_history-1774715565677.jpg?ixlib=js-3.8.0&auto=format&s=c064f6522e94b3481c134635e8ede5cc> (referer: None)
2026-03-29 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1814/16271814/instrument_cluster-1774715340227.jpg> (referer: None)
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8138e90>
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7365%252F18587365%252Fexterior_front_driver-1774782175207.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_front_driver-1774782175207.jpg saved to cache
2026-03-29 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c539b5e-b885-5389-b93c-c5fb6c5129af
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa2ee50>
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1814%252F16271814%252Finterior_rear_seats-1774715265860.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1814/16271814/interior_rear_seats-1774715265860.jpg saved to cache
2026-03-29 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf81e50>
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7365%252F18587365%252Fexterior_rear_driver-1774781980513.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_rear_driver-1774781980513.jpg saved to cache
2026-03-29 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c539b5e-b885-5389-b93c-c5fb6c5129af
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa2e990>
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0182%252F19930182%252Finterior_rear_seats-1774627484764.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0182/19930182/interior_rear_seats-1774627484764.jpg saved to cache
2026-03-29 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e6d350>
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0182%252F19930182%252Finterior_dashboard-1774627519621.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0182/19930182/interior_dashboard-1774627519621.jpg saved to cache
2026-03-29 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8aa2290>
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1814%252F16271814%252Fdocs_service_history-1774715565677.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc064f6522e94b3481c134635e8ede5cc') HTTP/1.1" 204 0
2026-03-29 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1814/16271814/docs_service_history-1774715565677.jpg?ixlib=js-3.8.0&auto=format&s=c064f6522e94b3481c134635e8ede5cc saved to cache
2026-03-29 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e75fd0>
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1814%252F16271814%252Finstrument_cluster-1774715340227.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1814/16271814/instrument_cluster-1774715340227.jpg saved to cache
2026-03-29 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de
2026-03-29 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9740/20269740/docs_service_history-1774540535541.jpg?ixlib=js-3.8.0&auto=format&s=de60cfc00dd158f5d3fa965775aa20e5> (referer: None)
2026-03-29 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_rear_driver-1774539157511.jpg> (referer: None)
2026-03-29 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1814/16271814/interior_boot-1774715379293.jpg> (referer: None)
2026-03-29 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_rear_passenger-1774626934207.jpg> (referer: None)
2026-03-29 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_front_driver-1774539134479.jpg> (referer: None)
2026-03-29 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0182/19930182/instrument_cluster-1774627558786.jpg> (referer: None)
2026-03-29 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0182/19930182/interior_boot-1774627546271.jpg> (referer: None)
2026-03-29 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7365/18587365/interior_boot-1774780868016.jpg> (referer: None)
2026-03-29 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0182/19930182/damage_scratches-1774627047864.jpg> (referer: None)
2026-03-29 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0182/19930182/interior_front_seats-1774627469442.jpg> (referer: None)
2026-03-29 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7365/18587365/interior_rear_seats-1774784438335.jpg> (referer: None)
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf80b50>
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9740%252F20269740%252Fdocs_service_history-1774540535541.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dde60cfc00dd158f5d3fa965775aa20e5') HTTP/1.1" 204 0
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9740/20269740/docs_service_history-1774540535541.jpg?ixlib=js-3.8.0&auto=format&s=de60cfc00dd158f5d3fa965775aa20e5 saved to cache
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9084286-3b87-560e-a7b7-2460fa97be51
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f961b290>
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9740%252F20269740%252Fexterior_rear_driver-1774539157511.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_rear_driver-1774539157511.jpg saved to cache
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9084286-3b87-560e-a7b7-2460fa97be51
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8de8550>
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1814%252F16271814%252Finterior_boot-1774715379293.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1814/16271814/interior_boot-1774715379293.jpg saved to cache
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f961b3d0>
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0182%252F19930182%252Fexterior_rear_passenger-1774626934207.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_rear_passenger-1774626934207.jpg saved to cache
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8de8390>
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9740%252F20269740%252Fexterior_front_driver-1774539134479.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_front_driver-1774539134479.jpg saved to cache
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9084286-3b87-560e-a7b7-2460fa97be51
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700e0a190>
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0182%252F19930182%252Finstrument_cluster-1774627558786.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0182/19930182/instrument_cluster-1774627558786.jpg saved to cache
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c5e410>
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0182%252F19930182%252Finterior_boot-1774627546271.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0182/19930182/interior_boot-1774627546271.jpg saved to cache
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ad0310>
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7365%252F18587365%252Finterior_boot-1774780868016.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7365/18587365/interior_boot-1774780868016.jpg saved to cache
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c539b5e-b885-5389-b93c-c5fb6c5129af
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c5e390>
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0182%252F19930182%252Fdamage_scratches-1774627047864.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0182/19930182/damage_scratches-1774627047864.jpg saved to cache
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81fae10>
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0182%252F19930182%252Finterior_front_seats-1774627469442.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0182/19930182/interior_front_seats-1774627469442.jpg saved to cache
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56
2026-03-29 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487185.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:02:54 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x00\xb2l\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x87\xef\x00\x00\x886\x00\x00\x00\x00'
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadecb90>
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7365%252F18587365%252Finterior_rear_seats-1774784438335.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7365/18587365/interior_rear_seats-1774784438335.jpg saved to cache
2026-03-29 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c539b5e-b885-5389-b93c-c5fb6c5129af
2026-03-29 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7365/18587365/interior_dashboard-1774781932853.jpg> (referer: None)
2026-03-29 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7365/18587365/instrument_cluster-1774626015722.jpg> (referer: None)
2026-03-29 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9740/20269740/instrument_cluster-1774539977264.jpg> (referer: None)
2026-03-29 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9740/20269740/interior_dashboard-1774539933683.jpg> (referer: None)
2026-03-29 20:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9740/20269740/interior_boot-1774539993809.jpg> (referer: None)
2026-03-29 20:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6fa2d37-fe02-57d0-9b27-c786273f8777 with identifier: 20487185
2026-03-29 20:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6fa2d37-fe02-57d0-9b27-c786273f8777 with scrape type 2
2026-03-29 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6fa2d37-fe02-57d0-9b27-c786273f8777 with scrape type 2
2026-03-29 20:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e6fa2d37-fe02-57d0-9b27-c786273f8777, identifier: 20487185
2026-03-29 20:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e6fa2d37-fe02-57d0-9b27-c786273f8777 with identifier: 20487185
2026-03-29 20:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e6fa2d37-fe02-57d0-9b27-c786273f8777 with identifier: 20487185
2026-03-29 20:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e6fa2d37-fe02-57d0-9b27-c786273f8777 with identifier: 20487185 to the API
2026-03-29 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487185.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e6fa2d37-fe02-57d0-9b27-c786273f8777',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'NL69 EVK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487185',
'listing': 'auction',
'location': 'Cambridgeshire Cambridge',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 51301,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 5555,
'price_includes_vat': False,
'registration_date': '2019-09-17',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Aygo X-PLAY VVT-i',
'transmission': 'manual',
'trim': 'X-PLAY VVT-i',
'vin': 'JTDKGNEC00N466552',
'year': 2019}
2026-03-29 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487185%27 HTTP/1.1" 200 None
2026-03-29 20:02:55 [motorway.uk] INFO: Saving data for 20487185: {'auction_closing_time': 1774884600.0, 'created_time': 1774728109.530633, 'last_price_update_time': 1774814575.746447}
2026-03-29 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487185') HTTP/1.1" 204 0
2026-03-29 20:02:55 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:02:55 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:02:55 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x0f\xa1I\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02G\x89\x00\x0f{?\x00\x00\x00\x00'
2026-03-29 20:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1139d0>
2026-03-29 20:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7365%252F18587365%252Finterior_dashboard-1774781932853.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7365/18587365/interior_dashboard-1774781932853.jpg saved to cache
2026-03-29 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c539b5e-b885-5389-b93c-c5fb6c5129af
2026-03-29 20:02:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ef8090>
2026-03-29 20:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7365%252F18587365%252Finstrument_cluster-1774626015722.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7365/18587365/instrument_cluster-1774626015722.jpg saved to cache
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c539b5e-b885-5389-b93c-c5fb6c5129af
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f968a610>
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9740%252F20269740%252Finstrument_cluster-1774539977264.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9740/20269740/instrument_cluster-1774539977264.jpg saved to cache
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9084286-3b87-560e-a7b7-2460fa97be51
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabf2f90>
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9740%252F20269740%252Finterior_dashboard-1774539933683.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9740/20269740/interior_dashboard-1774539933683.jpg saved to cache
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9084286-3b87-560e-a7b7-2460fa97be51
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae68610>
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9740%252F20269740%252Finterior_boot-1774539993809.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9740/20269740/interior_boot-1774539993809.jpg saved to cache
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9084286-3b87-560e-a7b7-2460fa97be51
2026-03-29 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_front_passenger-1774782013842.jpg> (referer: None)
2026-03-29 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_rear_passenger-1774782051806.jpg> (referer: None)
2026-03-29 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7365/18587365/docs_service_history-1774626478079.jpg?ixlib=js-3.8.0&auto=format&s=6d4558988d0bae9bedea969f92fdd051> (referer: None)
2026-03-29 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_rear_passenger-1774539160412.jpg> (referer: None)
2026-03-29 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_front_passenger-1774539183575.jpg> (referer: None)
2026-03-29 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_front_driver-1774626894847.jpg> (referer: None)
2026-03-29 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1814/16271814/interior_dashboard-1774715299869.jpg> (referer: None)
2026-03-29 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_rear_driver-1774626917359.jpg> (referer: None)
2026-03-29 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_front_passenger-1774626965119.jpg> (referer: None)
2026-03-29 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1814/16271814/interior_front_seats-1774715405244.jpg> (referer: None)
2026-03-29 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9740/20269740/interior_front_seats-1774539879383.jpg> (referer: None)
2026-03-29 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7365/18587365/interior_front_seats-1774625924811.jpg> (referer: None)
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f13a90>
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7365%252F18587365%252Fexterior_front_passenger-1774782013842.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_front_passenger-1774782013842.jpg saved to cache
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c539b5e-b885-5389-b93c-c5fb6c5129af
2026-03-29 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9740/20269740/interior_rear_seats-1774539906558.jpg> (referer: None)
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c83290>
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7365%252F18587365%252Fexterior_rear_passenger-1774782051806.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_rear_passenger-1774782051806.jpg saved to cache
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c539b5e-b885-5389-b93c-c5fb6c5129af
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadbed10>
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7365%252F18587365%252Fdocs_service_history-1774626478079.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6d4558988d0bae9bedea969f92fdd051') HTTP/1.1" 204 0
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7365/18587365/docs_service_history-1774626478079.jpg?ixlib=js-3.8.0&auto=format&s=6d4558988d0bae9bedea969f92fdd051 saved to cache
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c539b5e-b885-5389-b93c-c5fb6c5129af
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa6c450>
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9740%252F20269740%252Fexterior_rear_passenger-1774539160412.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_rear_passenger-1774539160412.jpg saved to cache
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9084286-3b87-560e-a7b7-2460fa97be51
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f813bed0>
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9740%252F20269740%252Fexterior_front_passenger-1774539183575.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_front_passenger-1774539183575.jpg saved to cache
2026-03-29 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9084286-3b87-560e-a7b7-2460fa97be51
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f13d10>
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0182%252F19930182%252Fexterior_front_driver-1774626894847.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_front_driver-1774626894847.jpg saved to cache
2026-03-29 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadc6a10>
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1814%252F16271814%252Finterior_dashboard-1774715299869.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1814/16271814/interior_dashboard-1774715299869.jpg saved to cache
2026-03-29 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9323890>
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0182%252F19930182%252Fexterior_rear_driver-1774626917359.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_rear_driver-1774626917359.jpg saved to cache
2026-03-29 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1def10>
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0182%252F19930182%252Fexterior_front_passenger-1774626965119.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_front_passenger-1774626965119.jpg saved to cache
2026-03-29 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56
2026-03-29 20:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19f0ae3f-e581-50ab-8325-c08b1c0dbc56, skipping ID generation
2026-03-29 20:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56 with scrape type 1
2026-03-29 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19f0ae3f-e581-50ab-8325-c08b1c0dbc56 sending to next pipeline
2026-03-29 20:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 19f0ae3f-e581-50ab-8325-c08b1c0dbc56, identifier: 19930182
2026-03-29 20:02:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabf2190>
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1814%252F16271814%252Finterior_front_seats-1774715405244.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1814/16271814/interior_front_seats-1774715405244.jpg saved to cache
2026-03-29 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de
2026-03-29 20:02:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c83110>
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9740%252F20269740%252Finterior_front_seats-1774539879383.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9740/20269740/interior_front_seats-1774539879383.jpg saved to cache
2026-03-29 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9084286-3b87-560e-a7b7-2460fa97be51
2026-03-29 20:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 19f0ae3f-e581-50ab-8325-c08b1c0dbc56 with identifier: 19930182
2026-03-29 20:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 19f0ae3f-e581-50ab-8325-c08b1c0dbc56 with identifier: 19930182
2026-03-29 20:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 19f0ae3f-e581-50ab-8325-c08b1c0dbc56 with identifier: 19930182 to the API
2026-03-29 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_front_passenger-1774626965119.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '19f0ae3f-e581-50ab-8325-c08b1c0dbc56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LC65 DJF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19930182',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Vauxhall',
'model': 'Corsa',
'odometer': 51350,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1785087,
'Height': 2360,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_front_driver-1774626894847.jpg',
'Width': 3147},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1938887,
'Height': 2480,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_rear_driver-1774626917359.jpg',
'Width': 3306},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2307749,
'Height': 2742,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_front_passenger-1774626965119.jpg',
'Width': 3656},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2027653,
'Height': 2501,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0182/19930182/exterior_rear_passenger-1774626934207.jpg',
'Width': 3335},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3367038,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0182/19930182/interior_front_seats-1774627469442.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3380382,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0182/19930182/interior_rear_seats-1774627484764.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4375459,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0182/19930182/interior_dashboard-1774627519621.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3387015,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0182/19930182/instrument_cluster-1774627558786.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3220143,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0182/19930182/interior_boot-1774627546271.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19f0ae3f-e581-50ab-8325-c08b1c0dbc56/19f0ae3f-e581-50ab-8325-c08b1c0dbc56_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2518501,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0182/19930182/damage_scratches-1774627047864.jpg',
'Width': 4032}],
'price': 4900,
'price_includes_vat': False,
'registration_date': '2015-11-27',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Corsa Energy AC Auto',
'transmission': 'automatic',
'trim': 'Energy AC Auto',
'vin': 'W0L0XEP68G4046528',
'year': 2015}
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719930182%27 HTTP/1.1" 200 None
2026-03-29 20:02:58 [motorway.uk] INFO: Saving data for 19930182: {'created_time': 1774814578.130466, 'last_price_update_time': 1774814578.130477, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19930182') HTTP/1.1" 204 0
2026-03-29 20:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e3c5d0>
2026-03-29 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7365%252F18587365%252Finterior_front_seats-1774625924811.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7365/18587365/interior_front_seats-1774625924811.jpg saved to cache
2026-03-29 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c539b5e-b885-5389-b93c-c5fb6c5129af
2026-03-29 20:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c539b5e-b885-5389-b93c-c5fb6c5129af, skipping ID generation
2026-03-29 20:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c539b5e-b885-5389-b93c-c5fb6c5129af with scrape type 1
2026-03-29 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c539b5e-b885-5389-b93c-c5fb6c5129af sending to next pipeline
2026-03-29 20:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4c539b5e-b885-5389-b93c-c5fb6c5129af, identifier: 18587365
2026-03-29 20:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4c539b5e-b885-5389-b93c-c5fb6c5129af with identifier: 18587365
2026-03-29 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4c539b5e-b885-5389-b93c-c5fb6c5129af with identifier: 18587365
2026-03-29 20:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4c539b5e-b885-5389-b93c-c5fb6c5129af with identifier: 18587365 to the API
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7365/18587365/interior_front_seats-1774625924811.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '4c539b5e-b885-5389-b93c-c5fb6c5129af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RS03 KSS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18587365',
'listing': 'auction',
'location': 'Somerset Bridgwater',
'make': 'Ford',
'model': 'Focus',
'odometer': 36510,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1101681,
'Height': 2136,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_front_driver-1774782175207.jpg',
'Width': 2848},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 806930,
'Height': 1883,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_rear_driver-1774781980513.jpg',
'Width': 2510},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 810850,
'Height': 1809,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_front_passenger-1774782013842.jpg',
'Width': 2412},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 867407,
'Height': 1926,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7365/18587365/exterior_rear_passenger-1774782051806.jpg',
'Width': 2568},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3120300,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7365/18587365/interior_front_seats-1774625924811.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 80475,
'Height': 240,
'OriginUrl': 'https://motorway-photos.imgix.net/7365/18587365/interior_rear_seats-1774784438335.jpg',
'Width': 320},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1173714,
'Height': 1512,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7365/18587365/interior_dashboard-1774781932853.jpg',
'Width': 2016},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2104075,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7365/18587365/instrument_cluster-1774626015722.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2062565,
'Height': 2620,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7365/18587365/interior_boot-1774780868016.jpg',
'Width': 3493},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c539b5e-b885-5389-b93c-c5fb6c5129af/4c539b5e-b885-5389-b93c-c5fb6c5129af_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5557302,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7365/18587365/docs_service_history-1774626478079.jpg?ixlib=js-3.8.0&auto=format&s=6d4558988d0bae9bedea969f92fdd051',
'Width': 4032}],
'price': 24714,
'price_includes_vat': False,
'registration_date': '2017-06-20',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus RS',
'transmission': 'manual',
'trim': 'RS',
'vin': 'WF05XXGCC5HU41344',
'year': 2017}
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718587365%27 HTTP/1.1" 200 None
2026-03-29 20:02:58 [motorway.uk] INFO: Saving data for 18587365: {'created_time': 1774814578.735755, 'last_price_update_time': 1774814578.735766, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18587365') HTTP/1.1" 204 0
2026-03-29 20:02:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:02:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:02:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700deb750>
2026-03-29 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9740%252F20269740%252Finterior_rear_seats-1774539906558.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9740/20269740/interior_rear_seats-1774539906558.jpg saved to cache
2026-03-29 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9084286-3b87-560e-a7b7-2460fa97be51
2026-03-29 20:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9084286-3b87-560e-a7b7-2460fa97be51, skipping ID generation
2026-03-29 20:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9084286-3b87-560e-a7b7-2460fa97be51 with scrape type 1
2026-03-29 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9084286-3b87-560e-a7b7-2460fa97be51 sending to next pipeline
2026-03-29 20:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d9084286-3b87-560e-a7b7-2460fa97be51, identifier: 20269740
2026-03-29 20:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d9084286-3b87-560e-a7b7-2460fa97be51 with identifier: 20269740
2026-03-29 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d9084286-3b87-560e-a7b7-2460fa97be51 with identifier: 20269740
2026-03-29 20:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d9084286-3b87-560e-a7b7-2460fa97be51 with identifier: 20269740 to the API
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9740/20269740/interior_rear_seats-1774539906558.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd9084286-3b87-560e-a7b7-2460fa97be51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OW69 BYU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20269740',
'listing': 'auction',
'location': 'Oxfordshire Abingdon',
'make': 'Ford',
'model': 'Puma',
'odometer': 67000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1958731,
'Height': 2673,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_front_driver-1774539134479.jpg',
'Width': 3564},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2358231,
'Height': 2605,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_rear_driver-1774539157511.jpg',
'Width': 3473},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1759436,
'Height': 2687,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_front_passenger-1774539183575.jpg',
'Width': 3583},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1364196,
'Height': 2465,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9740/20269740/exterior_rear_passenger-1774539160412.jpg',
'Width': 3286},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3640646,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9740/20269740/interior_front_seats-1774539879383.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4106346,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9740/20269740/interior_rear_seats-1774539906558.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2799646,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9740/20269740/interior_dashboard-1774539933683.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2008184,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9740/20269740/instrument_cluster-1774539977264.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3917821,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9740/20269740/interior_boot-1774539993809.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9084286-3b87-560e-a7b7-2460fa97be51/d9084286-3b87-560e-a7b7-2460fa97be51_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 406684,
'Height': 3176,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9740/20269740/docs_service_history-1774540535541.jpg?ixlib=js-3.8.0&auto=format&s=de60cfc00dd158f5d3fa965775aa20e5',
'Width': 2135}],
'price': 6888,
'price_includes_vat': False,
'registration_date': '2020-01-28',
'seats_number': None,
'seller_name': None,
'title': 'Ford Puma Titanium First ED MHEV',
'transmission': 'manual',
'trim': 'Titanium First ED MHEV',
'vin': 'WF02XXERK2KM19426',
'year': 2020}
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720269740%27 HTTP/1.1" 200 None
2026-03-29 20:02:59 [motorway.uk] INFO: Saving data for 20269740: {'created_time': 1774814579.351577, 'last_price_update_time': 1774814579.351589, 'auction_closing_time': 1774884600.0}
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20269740') HTTP/1.1" 204 0
2026-03-29 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0324/20490324/docs_service_history-1774711509365.jpg?ixlib=js-3.8.0&auto=format&s=452392946621465e9ca5d80e268da8c1> (referer: None)
2026-03-29 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0324/20490324/docs_service_history-1774711509672.jpg?ixlib=js-3.8.0&auto=format&s=57cf5808617f96693c4c81693cec6b29> (referer: None)
2026-03-29 20:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1814/16271814/exterior_front_driver-1774717952404.jpg> (referer: None)
2026-03-29 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1814/16271814/exterior_rear_driver-1774714664497.jpg> (referer: None)
2026-03-29 20:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0324/20490324/interior_boot-1774714596968.jpg> (referer: None)
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cf8350>
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0324%252F20490324%252Fdocs_service_history-1774711509365.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D452392946621465e9ca5d80e268da8c1') HTTP/1.1" 204 0
2026-03-29 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0324/20490324/docs_service_history-1774711509365.jpg?ixlib=js-3.8.0&auto=format&s=452392946621465e9ca5d80e268da8c1 saved to cache
2026-03-29 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfc8b10>
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0324%252F20490324%252Fdocs_service_history-1774711509672.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D57cf5808617f96693c4c81693cec6b29') HTTP/1.1" 204 0
2026-03-29 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0324/20490324/docs_service_history-1774711509672.jpg?ixlib=js-3.8.0&auto=format&s=57cf5808617f96693c4c81693cec6b29 saved to cache
2026-03-29 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89eb210>
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1814%252F16271814%252Fexterior_front_driver-1774717952404.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1814/16271814/exterior_front_driver-1774717952404.jpg saved to cache
2026-03-29 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf77d50>
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1814%252F16271814%252Fexterior_rear_driver-1774714664497.jpg') HTTP/1.1" 204 0
2026-03-29 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1814/16271814/exterior_rear_driver-1774714664497.jpg saved to cache
2026-03-29 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de
2026-03-29 20:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4fb2af7-b38b-5ba3-80ee-dbccd65237de, skipping ID generation
2026-03-29 20:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de with scrape type 1
2026-03-29 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4fb2af7-b38b-5ba3-80ee-dbccd65237de sending to next pipeline
2026-03-29 20:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b4fb2af7-b38b-5ba3-80ee-dbccd65237de, identifier: 16271814
2026-03-29 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e5a690>
2026-03-29 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0324%252F20490324%252Finterior_boot-1774714596968.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0324/20490324/interior_boot-1774714596968.jpg saved to cache
2026-03-29 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8
2026-03-29 20:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b4fb2af7-b38b-5ba3-80ee-dbccd65237de with identifier: 16271814
2026-03-29 20:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b4fb2af7-b38b-5ba3-80ee-dbccd65237de with identifier: 16271814
2026-03-29 20:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b4fb2af7-b38b-5ba3-80ee-dbccd65237de with identifier: 16271814 to the API
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1814/16271814/exterior_rear_driver-1774714664497.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': 'b4fb2af7-b38b-5ba3-80ee-dbccd65237de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MH19 OYO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16271814',
'listing': 'auction',
'location': 'Greater Manchester Stockport',
'make': 'Renault',
'model': 'Zoe',
'odometer': 14397,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1893615,
'Height': 2566,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1814/16271814/exterior_front_driver-1774717952404.jpg',
'Width': 3421},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1310144,
'Height': 2903,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1814/16271814/exterior_rear_driver-1774714664497.jpg',
'Width': 3871},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1673925,
'Height': 2426,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1814/16271814/exterior_front_passenger-1774717970301.jpg',
'Width': 3235},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1642610,
'Height': 2750,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1814/16271814/exterior_rear_passenger-1774714713688.jpg',
'Width': 3666},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3500459,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1814/16271814/interior_front_seats-1774715405244.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3067403,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1814/16271814/interior_rear_seats-1774715265860.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1832064,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1814/16271814/interior_dashboard-1774715299869.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2471106,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1814/16271814/instrument_cluster-1774715340227.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1936996,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1814/16271814/interior_boot-1774715379293.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4fb2af7-b38b-5ba3-80ee-dbccd65237de/b4fb2af7-b38b-5ba3-80ee-dbccd65237de_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1125124,
'Height': 4453,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1814/16271814/docs_service_history-1774715565677.jpg?ixlib=js-3.8.0&auto=format&s=c064f6522e94b3481c134635e8ede5cc',
'Width': 3046}],
'price': 5025,
'price_includes_vat': False,
'registration_date': '2019-06-26',
'seats_number': None,
'seller_name': None,
'title': 'Renault ZOE I Dynamique NAV ZE 40 Auto',
'transmission': 'automatic',
'trim': 'ZOE I Dynamique NAV ZE 40 Auto',
'vin': 'VF1AG000863620472',
'year': 2019}
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716271814%27 HTTP/1.1" 200 None
2026-03-29 20:03:00 [motorway.uk] INFO: Saving data for 16271814: {'created_time': 1774814580.737679, 'last_price_update_time': 1774814580.737689, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16271814') HTTP/1.1" 204 0
2026-03-29 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_rear_passenger-1774698375918.jpg> (referer: None)
2026-03-29 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_rear_driver-1774698375637.jpg> (referer: None)
2026-03-29 20:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_front_passenger-1774698345479.jpg> (referer: None)
2026-03-29 20:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9642/18839642/interior_front_seats-1774698439123.jpg> (referer: None)
2026-03-29 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1845/13711845/exterior_rear_driver-1774620244383.jpg> (referer: None)
2026-03-29 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9454/19899454/damage_scratches-1774716865120.jpg> (referer: None)
2026-03-29 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1845/13711845/exterior_front_driver-1774620224894.jpg> (referer: None)
2026-03-29 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0324/20490324/exterior_front_passenger-1774711876971.jpg> (referer: None)
2026-03-29 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1845/13711845/exterior_front_passenger-1774620264961.jpg> (referer: None)
2026-03-29 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0324/20490324/interior_dashboard-1774713239559.jpg> (referer: None)
2026-03-29 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0324/20490324/exterior_rear_passenger-1774713224703.jpg> (referer: None)
2026-03-29 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1845/13711845/exterior_rear_passenger-1774713281174.jpg> (referer: None)
2026-03-29 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faef1010>
2026-03-29 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9642%252F18839642%252Fexterior_rear_passenger-1774698375918.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_rear_passenger-1774698375918.jpg saved to cache
2026-03-29 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338
2026-03-29 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1848d0>
2026-03-29 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9642%252F18839642%252Fexterior_rear_driver-1774698375637.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_rear_driver-1774698375637.jpg saved to cache
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ad3490>
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9642%252F18839642%252Fexterior_front_passenger-1774698345479.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_front_passenger-1774698345479.jpg saved to cache
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facabd90>
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9642%252F18839642%252Finterior_front_seats-1774698439123.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9642/18839642/interior_front_seats-1774698439123.jpg saved to cache
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338
2026-03-29 20:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 899d953e-e9a5-50f4-87a3-62d5f5e7a338, skipping ID generation
2026-03-29 20:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338 with scrape type 1
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 899d953e-e9a5-50f4-87a3-62d5f5e7a338 sending to next pipeline
2026-03-29 20:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 899d953e-e9a5-50f4-87a3-62d5f5e7a338, identifier: 18839642
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9587210>
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1845%252F13711845%252Fexterior_rear_driver-1774620244383.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1845/13711845/exterior_rear_driver-1774620244383.jpg saved to cache
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9152550>
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F19899454%252Fdamage_scratches-1774716865120.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/19899454/damage_scratches-1774716865120.jpg saved to cache
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8607cd15-7376-5596-bb52-433c8a2daa97
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa187c50>
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1845%252F13711845%252Fexterior_front_driver-1774620224894.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1845/13711845/exterior_front_driver-1774620224894.jpg saved to cache
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e58dd0>
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0324%252F20490324%252Fexterior_front_passenger-1774711876971.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0324/20490324/exterior_front_passenger-1774711876971.jpg saved to cache
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa098f10>
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1845%252F13711845%252Fexterior_front_passenger-1774620264961.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1845/13711845/exterior_front_passenger-1774620264961.jpg saved to cache
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa06e90>
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0324%252F20490324%252Finterior_dashboard-1774713239559.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0324/20490324/interior_dashboard-1774713239559.jpg saved to cache
2026-03-29 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa4bed0>
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0324%252F20490324%252Fexterior_rear_passenger-1774713224703.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0324/20490324/exterior_rear_passenger-1774713224703.jpg saved to cache
2026-03-29 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8
2026-03-29 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9591c10>
2026-03-29 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1845%252F13711845%252Fexterior_rear_passenger-1774713281174.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1845/13711845/exterior_rear_passenger-1774713281174.jpg saved to cache
2026-03-29 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90
2026-03-29 20:03:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: baecc2a4-6eae-58a2-afcf-41fc5c4e6b90, skipping ID generation
2026-03-29 20:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90 with scrape type 1
2026-03-29 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item baecc2a4-6eae-58a2-afcf-41fc5c4e6b90 sending to next pipeline
2026-03-29 20:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: baecc2a4-6eae-58a2-afcf-41fc5c4e6b90, identifier: 13711845
2026-03-29 20:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 899d953e-e9a5-50f4-87a3-62d5f5e7a338 with identifier: 18839642
2026-03-29 20:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 899d953e-e9a5-50f4-87a3-62d5f5e7a338 with identifier: 18839642
2026-03-29 20:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 899d953e-e9a5-50f4-87a3-62d5f5e7a338 with identifier: 18839642 to the API
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9642/18839642/interior_front_seats-1774698439123.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '899d953e-e9a5-50f4-87a3-62d5f5e7a338',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RV20 WFS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18839642',
'listing': 'auction',
'location': 'West Berkshire Reading',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 44607,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 632580,
'Height': 1637,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_front_driver-1774698250746.jpg',
'Width': 2182},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441603,
'Height': 1414,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_rear_driver-1774698375637.jpg',
'Width': 1885},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 830930,
'Height': 1956,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_front_passenger-1774698345479.jpg',
'Width': 2608},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 625185,
'Height': 1581,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9642/18839642/exterior_rear_passenger-1774698375918.jpg',
'Width': 2108},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1857767,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9642/18839642/interior_front_seats-1774698439123.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2118664,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9642/18839642/interior_rear_seats-1774698504045.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2464224,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9642/18839642/18839642-interior_dashboard-modified-1774702141555.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452612,
'Height': 1552,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9642/18839642/18839642-instrument_cluster-modified-1774702413817.jpeg',
'Width': 2070},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2049800,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9642/18839642/interior_boot-1774698634533.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_899d953e-e9a5-50f4-87a3-62d5f5e7a338/899d953e-e9a5-50f4-87a3-62d5f5e7a338_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225146,
'Height': 2340,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9642/18839642/docs_service_history-1774700740571.jpg?ixlib=js-3.8.0&auto=format&s=a56bc4fb3580c86db58696860463c000',
'Width': 1080}],
'price': 18333,
'price_includes_vat': False,
'registration_date': '2020-07-17',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery Sport R-DYNAMIC SE A',
'transmission': 'automatic',
'trim': 'Sport R-DYNAMIC SE A',
'vin': 'SALCA2AX2LH870459',
'year': 2020}
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718839642%27 HTTP/1.1" 200 None
2026-03-29 20:03:02 [motorway.uk] INFO: Saving data for 18839642: {'created_time': 1774814582.751473, 'last_price_update_time': 1774814582.751485, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18839642') HTTP/1.1" 204 0
2026-03-29 20:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: baecc2a4-6eae-58a2-afcf-41fc5c4e6b90 with identifier: 13711845
2026-03-29 20:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: baecc2a4-6eae-58a2-afcf-41fc5c4e6b90 with identifier: 13711845
2026-03-29 20:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: baecc2a4-6eae-58a2-afcf-41fc5c4e6b90 with identifier: 13711845 to the API
2026-03-29 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/1845/13711845/exterior_rear_passenger-1774713281174.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'baecc2a4-6eae-58a2-afcf-41fc5c4e6b90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YD68 XGL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13711845',
'listing': 'auction',
'location': 'Essex Hockley',
'make': 'BMW',
'model': 'M4',
'odometer': 28150,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1860299,
'Height': 2610,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1845/13711845/exterior_front_driver-1774620224894.jpg',
'Width': 3480},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1730109,
'Height': 2696,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1845/13711845/exterior_rear_driver-1774620244383.jpg',
'Width': 3594},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2202446,
'Height': 2736,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1845/13711845/exterior_front_passenger-1774620264961.jpg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2529741,
'Height': 2681,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1845/13711845/exterior_rear_passenger-1774713281174.jpg',
'Width': 3575},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2866245,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1845/13711845/interior_front_seats-1774713294065.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3203080,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1845/13711845/interior_rear_seats-1774620514796.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2685471,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1845/13711845/interior_dashboard-1774713305316.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2931502,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1845/13711845/instrument_cluster-1774620578994.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3910881,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1845/13711845/interior_boot-1774620569508.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baecc2a4-6eae-58a2-afcf-41fc5c4e6b90/baecc2a4-6eae-58a2-afcf-41fc5c4e6b90_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533949,
'Height': 724,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1845/13711845/docs_service_history-1774620849047.jpg?ixlib=js-3.8.0&auto=format&s=9ef330c1122c27363db99f0db1122c4d',
'Width': 1863}],
'price': 27965,
'price_includes_vat': False,
'registration_date': '2018-10-19',
'seats_number': None,
'seller_name': None,
'title': 'BMW M4 Competition Package S-A',
'transmission': 'automatic',
'trim': 'Competition Package S-A',
'vin': 'WBS4Y92040AG10159',
'year': 2018}
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713711845%27 HTTP/1.1" 200 None
2026-03-29 20:03:03 [motorway.uk] INFO: Saving data for 13711845: {'created_time': 1774814583.206254, 'last_price_update_time': 1774814583.206264, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13711845') HTTP/1.1" 204 0
2026-03-29 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=504&page=14&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0324/20490324/interior_rear_seats-1774712346426.jpg> (referer: None)
2026-03-29 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9454/19899454/interior_boot-1774716828336.jpg> (referer: None)
2026-03-29 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9454/19899454/interior_dashboard-1774716837033.jpg> (referer: None)
2026-03-29 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9454/19899454/interior_rear_seats-1774716812159.jpg> (referer: None)
2026-03-29 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9498/20439498/docs_service_history-1774556558290-3.jpeg?ixlib=js-3.8.0&auto=format&s=1bcf9d1abacacacfde251ba4c94d04b7> (referer: None)
2026-03-29 20:03:03 [motorway.uk] INFO: Found listing with ID: 20480434
2026-03-29 20:03:03 [motorway.uk] INFO: Found listing with ID: 20396926
2026-03-29 20:03:03 [motorway.uk] INFO: Found listing with ID: 10578729
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710578729%27 HTTP/1.1" 200 None
2026-03-29 20:03:03 [motorway.uk] INFO: Scrape type for 10578729: 1
2026-03-29 20:03:03 [motorway.uk] INFO: Found listing with ID: 20367865
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720367865%27 HTTP/1.1" 200 None
2026-03-29 20:03:03 [motorway.uk] INFO: Scrape type for 20367865: 1
2026-03-29 20:03:03 [motorway.uk] INFO: Found listing with ID: 20457058
2026-03-29 20:03:03 [motorway.uk] INFO: Found listing with ID: 19559218
2026-03-29 20:03:03 [motorway.uk] INFO: Found listing with ID: 19677086
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719677086%27 HTTP/1.1" 200 None
2026-03-29 20:03:03 [motorway.uk] INFO: Scrape type for 19677086: 1
2026-03-29 20:03:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93a4590>
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0324%252F20490324%252Finterior_rear_seats-1774712346426.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0324/20490324/interior_rear_seats-1774712346426.jpg saved to cache
2026-03-29 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8
2026-03-29 20:03:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8, skipping ID generation
2026-03-29 20:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8 with scrape type 1
2026-03-29 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8 sending to next pipeline
2026-03-29 20:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8, identifier: 20490324
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a33fd0>
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F19899454%252Finterior_boot-1774716828336.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/19899454/interior_boot-1774716828336.jpg saved to cache
2026-03-29 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8607cd15-7376-5596-bb52-433c8a2daa97
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c82590>
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F19899454%252Finterior_dashboard-1774716837033.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/19899454/interior_dashboard-1774716837033.jpg saved to cache
2026-03-29 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8607cd15-7376-5596-bb52-433c8a2daa97
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8954610>
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F19899454%252Finterior_rear_seats-1774716812159.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/19899454/interior_rear_seats-1774716812159.jpg saved to cache
2026-03-29 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8607cd15-7376-5596-bb52-433c8a2daa97
2026-03-29 20:03:03 [motorway.uk] INFO: Found listing with ID: 20487346
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487346%27 HTTP/1.1" 200 None
2026-03-29 20:03:03 [motorway.uk] INFO: Scrape type for 20487346: 1
2026-03-29 20:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8 with identifier: 20490324
2026-03-29 20:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8 with identifier: 20490324
2026-03-29 20:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8 with identifier: 20490324 to the API
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0324/20490324/interior_rear_seats-1774712346426.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ66 OCP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20490324',
'listing': 'auction',
'location': 'Essex Clacton-on-Sea',
'make': 'SsangYong',
'model': 'Musso',
'odometer': 77272,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2439829,
'Height': 2936,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0324/20490324/exterior_front_driver-1774711796617.jpg',
'Width': 3914},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1595166,
'Height': 2636,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0324/20490324/exterior_rear_driver-1774713322209.jpg',
'Width': 3514},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2298054,
'Height': 2788,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0324/20490324/exterior_front_passenger-1774711876971.jpg',
'Width': 3717},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3192061,
'Height': 2912,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0324/20490324/exterior_rear_passenger-1774713224703.jpg',
'Width': 3883},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2514499,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0324/20490324/interior_front_seats-1774714573781.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5306831,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0324/20490324/interior_rear_seats-1774712346426.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2800408,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0324/20490324/interior_dashboard-1774713239559.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3329767,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0324/20490324/interior_boot-1774714596968.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 871138,
'Height': 2592,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0324/20490324/docs_service_history-1774711509365.jpg?ixlib=js-3.8.0&auto=format&s=452392946621465e9ca5d80e268da8c1',
'Width': 4075},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8/88270ed5-c63f-5c7c-8fd5-730f4eb2f1f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 788924,
'Height': 2338,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0324/20490324/docs_service_history-1774711509672.jpg?ixlib=js-3.8.0&auto=format&s=57cf5808617f96693c4c81693cec6b29',
'Width': 3541}],
'price': 5296,
'price_includes_vat': False,
'registration_date': '2016-11-05',
'seats_number': None,
'seller_name': None,
'title': 'SsangYong Musso EX Auto',
'transmission': 'automatic',
'trim': 'EX Auto',
'vin': 'KPADA1EESGP281599',
'year': 2016}
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490324%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [motorway.uk] INFO: Saving data for 20490324: {'created_time': 1774814584.419481, 'last_price_update_time': 1774814584.419492, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20490324') HTTP/1.1" 204 0
2026-03-29 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487110.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20477373
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720477373%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [motorway.uk] INFO: Scrape type for 20477373: 1
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 17851318
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20277040
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720277040%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [motorway.uk] INFO: Scrape type for 20277040: 1
2026-03-29 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93dac50>
2026-03-29 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b303a091-c659-5473-a3a1-47c536778e8b/b303a091-c659-5473-a3a1-47c536778e8b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9498%252F20439498%252Fdocs_service_history-1774556558290-3.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1bcf9d1abacacacfde251ba4c94d04b7') HTTP/1.1" 204 0
2026-03-29 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9498/20439498/docs_service_history-1774556558290-3.jpeg?ixlib=js-3.8.0&auto=format&s=1bcf9d1abacacacfde251ba4c94d04b7 saved to cache
2026-03-29 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b303a091-c659-5473-a3a1-47c536778e8b
2026-03-29 20:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20456360
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 18732558
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 5611886
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275611886%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [motorway.uk] INFO: Scrape type for 5611886: 1
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20341222
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 14816704
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 17084288
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20485139
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20087813
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 16608213
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20487775
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487775%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [motorway.uk] INFO: Scrape type for 20487775: 1
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 19936274
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 19950167
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719950167%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [motorway.uk] INFO: Scrape type for 19950167: 1
2026-03-29 20:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996 with identifier: 20487110
2026-03-29 20:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996 with scrape type 1
2026-03-29 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7110%252F20487110%252Fexterior_front_driver-1774703793394.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_front_driver-1774703793394.jpeg not downloaded yet
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 15737342
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20202633
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 19867021
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719867021%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [motorway.uk] INFO: Scrape type for 19867021: 1
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7110%252F20487110%252Fexterior_rear_driver-1774703923586.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_rear_driver-1774703923586.jpeg not downloaded yet
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20331785
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20471533
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471533%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [motorway.uk] INFO: Scrape type for 20471533: 1
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7110%252F20487110%252Fexterior_front_passenger-1774703863987.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_front_passenger-1774703863987.jpeg not downloaded yet
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 19734644
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719734644%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [motorway.uk] INFO: Scrape type for 19734644: 1
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7110%252F20487110%252Fexterior_rear_passenger-1774703770113.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_rear_passenger-1774703770113.jpeg not downloaded yet
2026-03-29 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9498/20439498/exterior_rear_passenger-1774543900803.jpg> (referer: None)
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 16989772
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20488442
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20387458
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20469643
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20272813
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 7883635
2026-03-29 20:03:04 [motorway.uk] INFO: Found listing with ID: 20386196
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720386196%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [motorway.uk] INFO: Scrape type for 20386196: 1
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7110%252F20487110%252Finterior_front_seats-1774704233307.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7110/20487110/interior_front_seats-1774704233307.jpeg not downloaded yet
2026-03-29 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5844/10385844/docs_service_history-1774709293614.jpg?ixlib=js-3.8.0&auto=format&s=d484d540fa8d7cea3cf56c638cb8d20c> (referer: None)
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7110%252F20487110%252Finterior_rear_seats-1774704176344.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7110/20487110/interior_rear_seats-1774704176344.jpeg not downloaded yet
2026-03-29 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_rear_driver-1774716758441.jpg> (referer: None)
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7110%252F20487110%252Finterior_dashboard-1774704143567.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7110/20487110/interior_dashboard-1774704143567.jpeg not downloaded yet
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7110%252F20487110%252Finstrument_cluster-1774704218404.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7110/20487110/instrument_cluster-1774704218404.jpeg not downloaded yet
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7110%252F20487110%252Finterior_boot-1774704108711.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7110/20487110/interior_boot-1774704108711.jpeg not downloaded yet
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7110%252F20487110%252F20487110-docs_service_history-modified-1774706179671.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D51b792ef92befb40e0d566e5f30af8f8%27 HTTP/1.1" 200 None
2026-03-29 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7110/20487110/20487110-docs_service_history-modified-1774706179671.jpeg?ixlib=js-3.8.0&auto=format&s=51b792ef92befb40e0d566e5f30af8f8 not downloaded yet
2026-03-29 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_front_driver-1774716732528.jpg> (referer: None)
2026-03-29 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8dd0ed0>
2026-03-29 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b303a091-c659-5473-a3a1-47c536778e8b/b303a091-c659-5473-a3a1-47c536778e8b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9498%252F20439498%252Fexterior_rear_passenger-1774543900803.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9498/20439498/exterior_rear_passenger-1774543900803.jpg saved to cache
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b303a091-c659-5473-a3a1-47c536778e8b
2026-03-29 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9498/20439498/exterior_front_passenger-1774543902920.jpg> (referer: None)
2026-03-29 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18265628.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9010d50>
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096ca068-7357-51fc-bb6a-11c1336972d0/096ca068-7357-51fc-bb6a-11c1336972d0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5844%252F10385844%252Fdocs_service_history-1774709293614.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd484d540fa8d7cea3cf56c638cb8d20c') HTTP/1.1" 204 0
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5844/10385844/docs_service_history-1774709293614.jpg?ixlib=js-3.8.0&auto=format&s=d484d540fa8d7cea3cf56c638cb8d20c saved to cache
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 096ca068-7357-51fc-bb6a-11c1336972d0
2026-03-29 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20369309.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81f9050>
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F19899454%252Fexterior_rear_driver-1774716758441.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_rear_driver-1774716758441.jpg saved to cache
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8607cd15-7376-5596-bb52-433c8a2daa97
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94c18d0>
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9454%252F19899454%252Fexterior_front_driver-1774716732528.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_front_driver-1774716732528.jpg saved to cache
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8607cd15-7376-5596-bb52-433c8a2daa97
2026-03-29 20:03:05 [scrapy.extensions.logstats] INFO: Crawled 127 pages (at 35 pages/min), scraped 69 items (at 31 items/min)
2026-03-29 20:03:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 300MiB
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facce250>
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b303a091-c659-5473-a3a1-47c536778e8b/b303a091-c659-5473-a3a1-47c536778e8b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9498%252F20439498%252Fexterior_front_passenger-1774543902920.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9498/20439498/exterior_front_passenger-1774543902920.jpg saved to cache
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b303a091-c659-5473-a3a1-47c536778e8b
2026-03-29 20:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f2b305d-8163-5457-8d7b-cdb65c268085 with identifier: 18265628
2026-03-29 20:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f2b305d-8163-5457-8d7b-cdb65c268085 with scrape type 1
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f2b305d-8163-5457-8d7b-cdb65c268085
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5628%252F18265628%252Fexterior_front_driver-1774696379067.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_front_driver-1774696379067.jpg not downloaded yet
2026-03-29 20:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f425d8f1-19f2-5425-88b9-b12b8195c6b3 with identifier: 20369309
2026-03-29 20:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f425d8f1-19f2-5425-88b9-b12b8195c6b3 with scrape type 1
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f425d8f1-19f2-5425-88b9-b12b8195c6b3
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9309%252F20369309%252Fexterior_front_driver-1774708090597.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_front_driver-1774708090597.jpg not downloaded yet
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5628%252F18265628%252Fexterior_rear_driver-1774696392710.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_rear_driver-1774696392710.jpg not downloaded yet
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9309%252F20369309%252Fexterior_rear_driver-1774708114887.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_rear_driver-1774708114887.jpg not downloaded yet
2026-03-29 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9454/19899454/interior_front_seats-1774716804401.jpg> (referer: None)
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5628%252F18265628%252Fexterior_front_passenger-1774696418215.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_front_passenger-1774696418215.jpg not downloaded yet
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9309%252F20369309%252Fexterior_front_passenger-1774708146403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_front_passenger-1774708146403.jpg not downloaded yet
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5628%252F18265628%252Fexterior_rear_passenger-1774696402453.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_rear_passenger-1774696402453.jpg not downloaded yet
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9309%252F20369309%252Fexterior_rear_passenger-1774708132597.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_rear_passenger-1774708132597.jpg not downloaded yet
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5628%252F18265628%252Finterior_front_seats-1774696721269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5628/18265628/interior_front_seats-1774696721269.jpg not downloaded yet
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9309%252F20369309%252Finterior_front_seats-1774708433812.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9309/20369309/interior_front_seats-1774708433812.jpg not downloaded yet
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5628%252F18265628%252Finterior_rear_seats-1774696660020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5628/18265628/interior_rear_seats-1774696660020.jpg not downloaded yet
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9309%252F20369309%252Finterior_rear_seats-1774708506430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9309/20369309/interior_rear_seats-1774708506430.jpg not downloaded yet
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c5cfd0>
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9454%252F19899454%252Finterior_front_seats-1774716804401.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9454/19899454/interior_front_seats-1774716804401.jpg saved to cache
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8607cd15-7376-5596-bb52-433c8a2daa97
2026-03-29 20:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8607cd15-7376-5596-bb52-433c8a2daa97, skipping ID generation
2026-03-29 20:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8607cd15-7376-5596-bb52-433c8a2daa97 with scrape type 1
2026-03-29 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8607cd15-7376-5596-bb52-433c8a2daa97 sending to next pipeline
2026-03-29 20:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8607cd15-7376-5596-bb52-433c8a2daa97, identifier: 19899454
2026-03-29 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5844/10385844/interior_boot-1774708946111.jpg> (referer: None)
2026-03-29 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5628%252F18265628%252Finterior_dashboard-1774703082638.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5628/18265628/interior_dashboard-1774703082638.jpg not downloaded yet
2026-03-29 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9309%252F20369309%252Finterior_dashboard-1774708537316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9309/20369309/interior_dashboard-1774708537316.jpg not downloaded yet
2026-03-29 20:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8607cd15-7376-5596-bb52-433c8a2daa97 with identifier: 19899454
2026-03-29 20:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8607cd15-7376-5596-bb52-433c8a2daa97 with identifier: 19899454
2026-03-29 20:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8607cd15-7376-5596-bb52-433c8a2daa97 with identifier: 19899454 to the API
2026-03-29 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9454/19899454/interior_front_seats-1774716804401.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '8607cd15-7376-5596-bb52-433c8a2daa97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'CGZ 6880',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19899454',
'listing': 'auction',
'location': 'Hertfordshire Stevenage',
'make': 'MINI',
'model': 'One',
'odometer': 54865,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2283676,
'Height': 2687,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_front_driver-1774716732528.jpg',
'Width': 3583},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1373767,
'Height': 2398,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_rear_driver-1774716758441.jpg',
'Width': 3197},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2377221,
'Height': 2762,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_front_passenger-1774716781854.jpg',
'Width': 3683},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2640324,
'Height': 2810,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9454/19899454/exterior_rear_passenger-1774716785410.jpg',
'Width': 3747},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2597755,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9454/19899454/interior_front_seats-1774716804401.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2905461,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9454/19899454/interior_rear_seats-1774716812159.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1903026,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9454/19899454/interior_dashboard-1774716837033.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1642912,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9454/19899454/interior_boot-1774716828336.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1556067,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9454/19899454/damage_scratches-1774716865120.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8607cd15-7376-5596-bb52-433c8a2daa97/8607cd15-7376-5596-bb52-433c8a2daa97_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1660699,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9454/19899454/damage_scratches-1774716874505.jpg',
'Width': 4032}],
'price': 5292,
'price_includes_vat': False,
'registration_date': '2016-06-30',
'seats_number': None,
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'vin': 'WMWXS120502C82006',
'year': 2016}
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719899454%27 HTTP/1.1" 200 None
2026-03-29 20:03:08 [motorway.uk] INFO: Saving data for 19899454: {'created_time': 1774814588.298415, 'last_price_update_time': 1774814588.298428, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19899454') HTTP/1.1" 204 0
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5628%252F18265628%252Finterior_boot-1774696697468.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5628/18265628/interior_boot-1774696697468.jpg not downloaded yet
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9309%252F20369309%252Finstrument_cluster-1774708540018.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9309/20369309/instrument_cluster-1774708540018.jpg not downloaded yet
2026-03-29 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a64950>
2026-03-29 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096ca068-7357-51fc-bb6a-11c1336972d0/096ca068-7357-51fc-bb6a-11c1336972d0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5844%252F10385844%252Finterior_boot-1774708946111.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5844/10385844/interior_boot-1774708946111.jpg saved to cache
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 096ca068-7357-51fc-bb6a-11c1336972d0
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5628%252F18265628%252Fdocs_service_history-1774696790637.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D06eab3d3d592b88273cfe358c642520c%27 HTTP/1.1" 200 None
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5628/18265628/docs_service_history-1774696790637.jpg?ixlib=js-3.8.0&auto=format&s=06eab3d3d592b88273cfe358c642520c not downloaded yet
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9309%252F20369309%252Finterior_boot-1774708541238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9309/20369309/interior_boot-1774708541238.jpg not downloaded yet
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5628%252F18265628%252Fdocs_service_history-1774696809350.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4676dfcff512d1f41db1126a94846d15%27 HTTP/1.1" 200 None
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5628/18265628/docs_service_history-1774696809350.jpg?ixlib=js-3.8.0&auto=format&s=4676dfcff512d1f41db1126a94846d15 not downloaded yet
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9309%252F20369309%252Fdocs_service_history-1774708746081.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D548df8822c451559fa64f28637bd3732%27 HTTP/1.1" 200 None
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9309/20369309/docs_service_history-1774708746081.jpg?ixlib=js-3.8.0&auto=format&s=548df8822c451559fa64f28637bd3732 not downloaded yet
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10578729.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19677086.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20477373.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487346.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20462264.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20367865.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9498/20439498/interior_front_seats-1774544952624.jpg> (referer: None)
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_rear_passenger-1774703770113.jpeg> (referer: None)
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7110/20487110/20487110-docs_service_history-modified-1774706179671.jpeg?ixlib=js-3.8.0&auto=format&s=51b792ef92befb40e0d566e5f30af8f8> (referer: None)
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7110/20487110/interior_rear_seats-1774704176344.jpeg> (referer: None)
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7110/20487110/instrument_cluster-1774704218404.jpeg> (referer: None)
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7110/20487110/interior_front_seats-1774704233307.jpeg> (referer: None)
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_rear_driver-1774708114887.jpg> (referer: None)
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7110/20487110/interior_dashboard-1774704143567.jpeg> (referer: None)
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7110/20487110/interior_boot-1774704108711.jpeg> (referer: None)
2026-03-29 20:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d49e9e1a-9993-5399-9602-891efcc72d09 with identifier: 10578729
2026-03-29 20:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d49e9e1a-9993-5399-9602-891efcc72d09 with scrape type 1
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d49e9e1a-9993-5399-9602-891efcc72d09
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8729%252F10578729%252Fexterior_front_driver-1774690074650.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_front_driver-1774690074650.jpg not downloaded yet
2026-03-29 20:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dd43f3b-a18c-5a20-b589-fea6f7bc46de with identifier: 19677086
2026-03-29 20:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de with scrape type 1
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7086%252F19677086%252Fexterior_front_driver-1774626903470.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7086/19677086/exterior_front_driver-1774626903470.jpg not downloaded yet
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8729%252F10578729%252Fexterior_rear_driver-1774689952165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_rear_driver-1774689952165.jpg not downloaded yet
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7086%252F19677086%252Fexterior_rear_driver-1774627775534.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7086/19677086/exterior_rear_driver-1774627775534.jpg not downloaded yet
2026-03-29 20:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9309/20369309/docs_service_history-1774708746081.jpg?ixlib=js-3.8.0&auto=format&s=548df8822c451559fa64f28637bd3732> (referer: None)
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8729%252F10578729%252Fexterior_front_passenger-1774690031082.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_front_passenger-1774690031082.jpg not downloaded yet
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7086%252F19677086%252Fexterior_front_passenger-1774626888209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7086/19677086/exterior_front_passenger-1774626888209.jpg not downloaded yet
2026-03-29 20:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3 with identifier: 20477373
2026-03-29 20:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3 with scrape type 1
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7373%252F20477373%252Fexterior_front_driver-1774688324602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7373/20477373/exterior_front_driver-1774688324602.jpg not downloaded yet
2026-03-29 20:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69a72c6d-8f4d-5545-b47e-8f4e3861d284 with identifier: 20487346
2026-03-29 20:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284 with scrape type 1
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7346%252F20487346%252Fexterior_front_driver-1774710518663.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_front_driver-1774710518663.jpg not downloaded yet
2026-03-29 20:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d968fad-6d20-553a-86fc-fb276df54233 with identifier: 20462264
2026-03-29 20:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d968fad-6d20-553a-86fc-fb276df54233 with scrape type 1
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d968fad-6d20-553a-86fc-fb276df54233
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2264%252F20462264%252Fexterior_front_driver-1774777968885.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_front_driver-1774777968885.jpg not downloaded yet
2026-03-29 20:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7304634-f068-51bc-8dd9-8e2a9dcb63af with identifier: 20367865
2026-03-29 20:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7304634-f068-51bc-8dd9-8e2a9dcb63af with scrape type 1
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7304634-f068-51bc-8dd9-8e2a9dcb63af
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7865%252F20367865%252Fexterior_front_driver-1774706815673.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7865/20367865/exterior_front_driver-1774706815673.jpg not downloaded yet
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf16450>
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b303a091-c659-5473-a3a1-47c536778e8b/b303a091-c659-5473-a3a1-47c536778e8b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9498%252F20439498%252Finterior_front_seats-1774544952624.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9498/20439498/interior_front_seats-1774544952624.jpg saved to cache
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b303a091-c659-5473-a3a1-47c536778e8b
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f822ec10>
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7110%252F20487110%252Fexterior_rear_passenger-1774703770113.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_rear_passenger-1774703770113.jpeg saved to cache
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa146d0>
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7110%252F20487110%252F20487110-docs_service_history-modified-1774706179671.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D51b792ef92befb40e0d566e5f30af8f8') HTTP/1.1" 204 0
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7110/20487110/20487110-docs_service_history-modified-1774706179671.jpeg?ixlib=js-3.8.0&auto=format&s=51b792ef92befb40e0d566e5f30af8f8 saved to cache
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00,\xef\x1c\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02o\x05\x00,\xe4~\x00\x00\x00\x00'
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f851c190>
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7110%252F20487110%252Finterior_rear_seats-1774704176344.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7110/20487110/interior_rear_seats-1774704176344.jpeg saved to cache
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00!?\xf6\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01r$\x00!5X\x00\x00\x00\x00'
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f852afd0>
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7110%252F20487110%252Finstrument_cluster-1774704218404.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7110/20487110/instrument_cluster-1774704218404.jpeg saved to cache
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00/\xa4\x93\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x92n\x00/\x99\xf5\x00\x00\x00\x00'
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8513250>
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7110%252F20487110%252Finterior_front_seats-1774704233307.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7110/20487110/interior_front_seats-1774704233307.jpeg saved to cache
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadbf910>
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9309%252F20369309%252Fexterior_rear_driver-1774708114887.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_rear_driver-1774708114887.jpg saved to cache
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f425d8f1-19f2-5425-88b9-b12b8195c6b3
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00(\xc6E\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02i\x8d\x00(\xbb\xa7\x00\x00\x00\x00'
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8514850>
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7110%252F20487110%252Finterior_dashboard-1774704143567.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7110/20487110/interior_dashboard-1774704143567.jpeg saved to cache
2026-03-29 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00/R\x02\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x99\xd8\x00/Gd\x00\x00\x00\x00'
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f851fe90>
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7110%252F20487110%252Finterior_boot-1774704108711.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7110/20487110/interior_boot-1774704108711.jpeg saved to cache
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8729%252F10578729%252Fexterior_rear_passenger-1774690050360.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_rear_passenger-1774690050360.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7086%252F19677086%252Fexterior_rear_passenger-1774626914774.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7086/19677086/exterior_rear_passenger-1774626914774.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7373%252F20477373%252Fexterior_rear_driver-1774634051698.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7373/20477373/exterior_rear_driver-1774634051698.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7346%252F20487346%252Fexterior_rear_driver-1774710536787.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_rear_driver-1774710536787.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2264%252F20462264%252Fexterior_rear_driver-1774777991949.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_rear_driver-1774777991949.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7865%252F20367865%252Fexterior_rear_driver-1774706822377.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7865/20367865/exterior_rear_driver-1774706822377.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8729%252F10578729%252Finterior_front_seats-1774690505716.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8729/10578729/interior_front_seats-1774690505716.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7086%252F19677086%252Finterior_front_seats-1774627292519.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7086/19677086/interior_front_seats-1774627292519.jpg not downloaded yet
2026-03-29 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8512790>
2026-03-29 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9309%252F20369309%252Fdocs_service_history-1774708746081.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D548df8822c451559fa64f28637bd3732') HTTP/1.1" 204 0
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9309/20369309/docs_service_history-1774708746081.jpg?ixlib=js-3.8.0&auto=format&s=548df8822c451559fa64f28637bd3732 saved to cache
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f425d8f1-19f2-5425-88b9-b12b8195c6b3
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7373%252F20477373%252Fexterior_front_passenger-1774634079402.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7373/20477373/exterior_front_passenger-1774634079402.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7346%252F20487346%252Fexterior_front_passenger-1774710560902.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_front_passenger-1774710560902.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2264%252F20462264%252Fexterior_front_passenger-1774778027087.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_front_passenger-1774778027087.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7865%252F20367865%252Fexterior_front_passenger-1774706820103.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7865/20367865/exterior_front_passenger-1774706820103.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8729%252F10578729%252Finterior_rear_seats-1774690579122.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8729/10578729/interior_rear_seats-1774690579122.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7086%252F19677086%252Finterior_rear_seats-1774627287526.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7086/19677086/interior_rear_seats-1774627287526.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7373%252F20477373%252Fexterior_rear_passenger-1774634068568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7373/20477373/exterior_rear_passenger-1774634068568.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7346%252F20487346%252Fexterior_rear_passenger-1774710558610.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_rear_passenger-1774710558610.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2264%252F20462264%252Fexterior_rear_passenger-1774778009195.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_rear_passenger-1774778009195.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7865%252F20367865%252Fexterior_rear_passenger-1774713038772.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7865/20367865/exterior_rear_passenger-1774713038772.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8729%252F10578729%252Finterior_dashboard-1774690623323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8729/10578729/interior_dashboard-1774690623323.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7086%252F19677086%252Finterior_dashboard-1774627393382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7086/19677086/interior_dashboard-1774627393382.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7373%252F20477373%252Finterior_front_seats-1774634435831.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7373/20477373/interior_front_seats-1774634435831.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7346%252F20487346%252Finterior_front_seats-1774711208737.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7346/20487346/interior_front_seats-1774711208737.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2264%252F20462264%252Finterior_front_seats-1774778739384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2264/20462264/interior_front_seats-1774778739384.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7865%252F20367865%252Finterior_front_seats-1774712207230.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7865/20367865/interior_front_seats-1774712207230.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8729%252F10578729%252Finstrument_cluster-1774690613022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8729/10578729/instrument_cluster-1774690613022.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7086%252F19677086%252Finstrument_cluster-1774627667497.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7086/19677086/instrument_cluster-1774627667497.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7373%252F20477373%252Finterior_rear_seats-1774634456296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7373/20477373/interior_rear_seats-1774634456296.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7346%252F20487346%252Finterior_rear_seats-1774710892374.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7346/20487346/interior_rear_seats-1774710892374.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2264%252F20462264%252Finterior_rear_seats-1774778665156.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2264/20462264/interior_rear_seats-1774778665156.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7865%252F20367865%252Finterior_rear_seats-1774712102236.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7865/20367865/interior_rear_seats-1774712102236.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8729%252F10578729%252Finterior_boot-1774690641550.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8729/10578729/interior_boot-1774690641550.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7086%252F19677086%252Finterior_boot-1774627367824.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7086/19677086/interior_boot-1774627367824.jpg not downloaded yet
2026-03-29 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7086/19677086/exterior_rear_passenger-1774626914774.jpg> (referer: None)
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7373%252F20477373%252Finterior_dashboard-1774688345229.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7373/20477373/interior_dashboard-1774688345229.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7346%252F20487346%252Finterior_dashboard-1774710925168.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7346/20487346/interior_dashboard-1774710925168.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2264%252F20462264%252Finterior_dashboard-1774778692210.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2264/20462264/interior_dashboard-1774778692210.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7865%252F20367865%252Finterior_dashboard-1774712121121.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7865/20367865/interior_dashboard-1774712121121.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8729%252F10578729%252Fdocs_service_history-1774690811496.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4ae703abf69d1fbb71c745f424dd49eb%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8729/10578729/docs_service_history-1774690811496.jpg?ixlib=js-3.8.0&auto=format&s=4ae703abf69d1fbb71c745f424dd49eb not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7086%252F19677086%252Fdocs_service_history-1774704831666.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5ea287f407f3777eadbb46675aa6769f%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7086/19677086/docs_service_history-1774704831666.jpg?ixlib=js-3.8.0&auto=format&s=5ea287f407f3777eadbb46675aa6769f not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7373%252F20477373%252Finstrument_cluster-1774688360370.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7373/20477373/instrument_cluster-1774688360370.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7346%252F20487346%252Finstrument_cluster-1774710982422.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7346/20487346/instrument_cluster-1774710982422.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2264%252F20462264%252Finstrument_cluster-1774778752317.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2264/20462264/instrument_cluster-1774778752317.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7865%252F20367865%252Finstrument_cluster-1774712140900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7865/20367865/instrument_cluster-1774712140900.jpg not downloaded yet
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7373%252F20477373%252Finterior_boot-1774634552675.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7373/20477373/interior_boot-1774634552675.jpg not downloaded yet
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7346%252F20487346%252Finterior_boot-1774710928333.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7346/20487346/interior_boot-1774710928333.jpg not downloaded yet
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2264%252F20462264%252Finterior_boot-1774778694881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2264/20462264/interior_boot-1774778694881.jpg not downloaded yet
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7865%252F20367865%252Finterior_boot-1774712107339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7865/20367865/interior_boot-1774712107339.jpg not downloaded yet
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8819990>
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7086%252F19677086%252Fexterior_rear_passenger-1774626914774.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7086/19677086/exterior_rear_passenger-1774626914774.jpg saved to cache
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7373%252F20477373%252Fdocs_service_history-1774636219474.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddbeac0678b541622e0b90f2fc74e4cec%27 HTTP/1.1" 200 None
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7373/20477373/docs_service_history-1774636219474.png?ixlib=js-3.8.0&auto=format&s=dbeac0678b541622e0b90f2fc74e4cec not downloaded yet
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7346%252F20487346%252Fdocs_service_history-1774711478306.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9048a82c26d177ad692d368cda886cf4%27 HTTP/1.1" 200 None
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7346/20487346/docs_service_history-1774711478306.jpg?ixlib=js-3.8.0&auto=format&s=9048a82c26d177ad692d368cda886cf4 not downloaded yet
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2264%252F20462264%252Fdocs_service_history-1774779774637.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dabba7b01884f8c76cc65a261c44ca993%27 HTTP/1.1" 200 None
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2264/20462264/docs_service_history-1774779774637.jpg?ixlib=js-3.8.0&auto=format&s=abba7b01884f8c76cc65a261c44ca993 not downloaded yet
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7865%252F20367865%252Fdocs_service_history-1774712326192.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd0fc76d91de58b104535f324f8c5ba0d%27 HTTP/1.1" 200 None
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7865/20367865/docs_service_history-1774712326192.jpg?ixlib=js-3.8.0&auto=format&s=d0fc76d91de58b104535f324f8c5ba0d not downloaded yet
2026-03-29 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_front_driver-1774777968885.jpg> (referer: None)
2026-03-29 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7865/20367865/exterior_rear_driver-1774706822377.jpg> (referer: None)
2026-03-29 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7865/20367865/exterior_front_driver-1774706815673.jpg> (referer: None)
2026-03-29 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9309/20369309/instrument_cluster-1774708540018.jpg> (referer: None)
2026-03-29 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_rear_passenger-1774690050360.jpg> (referer: None)
2026-03-29 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_rear_driver-1774710536787.jpg> (referer: None)
2026-03-29 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5628/18265628/docs_service_history-1774696809350.jpg?ixlib=js-3.8.0&auto=format&s=4676dfcff512d1f41db1126a94846d15> (referer: None)
2026-03-29 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5628/18265628/docs_service_history-1774696790637.jpg?ixlib=js-3.8.0&auto=format&s=06eab3d3d592b88273cfe358c642520c> (referer: None)
2026-03-29 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9309/20369309/interior_boot-1774708541238.jpg> (referer: None)
2026-03-29 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7373/20477373/exterior_front_driver-1774688324602.jpg> (referer: None)
2026-03-29 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7373/20477373/exterior_rear_driver-1774634051698.jpg> (referer: None)
2026-03-29 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7086/19677086/exterior_front_passenger-1774626888209.jpg> (referer: None)
2026-03-29 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_rear_driver-1774777991949.jpg> (referer: None)
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae08610>
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2264%252F20462264%252Fexterior_front_driver-1774777968885.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_front_driver-1774777968885.jpg saved to cache
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d968fad-6d20-553a-86fc-fb276df54233
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9137910>
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7865%252F20367865%252Fexterior_rear_driver-1774706822377.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7865/20367865/exterior_rear_driver-1774706822377.jpg saved to cache
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7304634-f068-51bc-8dd9-8e2a9dcb63af
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fe4a50>
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7865%252F20367865%252Fexterior_front_driver-1774706815673.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7865/20367865/exterior_front_driver-1774706815673.jpg saved to cache
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7304634-f068-51bc-8dd9-8e2a9dcb63af
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ce0d10>
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9309%252F20369309%252Finstrument_cluster-1774708540018.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9309/20369309/instrument_cluster-1774708540018.jpg saved to cache
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f425d8f1-19f2-5425-88b9-b12b8195c6b3
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9135a10>
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8729%252F10578729%252Fexterior_rear_passenger-1774690050360.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_rear_passenger-1774690050360.jpg saved to cache
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d49e9e1a-9993-5399-9602-891efcc72d09
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf7b450>
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7346%252F20487346%252Fexterior_rear_driver-1774710536787.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_rear_driver-1774710536787.jpg saved to cache
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fe5610>
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5628%252F18265628%252Fdocs_service_history-1774696809350.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4676dfcff512d1f41db1126a94846d15') HTTP/1.1" 204 0
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5628/18265628/docs_service_history-1774696809350.jpg?ixlib=js-3.8.0&auto=format&s=4676dfcff512d1f41db1126a94846d15 saved to cache
2026-03-29 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f2b305d-8163-5457-8d7b-cdb65c268085
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9038910>
2026-03-29 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5628%252F18265628%252Fdocs_service_history-1774696790637.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D06eab3d3d592b88273cfe358c642520c') HTTP/1.1" 204 0
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5628/18265628/docs_service_history-1774696790637.jpg?ixlib=js-3.8.0&auto=format&s=06eab3d3d592b88273cfe358c642520c saved to cache
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f2b305d-8163-5457-8d7b-cdb65c268085
2026-03-29 20:03:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ce0310>
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9309%252F20369309%252Finterior_boot-1774708541238.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9309/20369309/interior_boot-1774708541238.jpg saved to cache
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f425d8f1-19f2-5425-88b9-b12b8195c6b3
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae08450>
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7373%252F20477373%252Fexterior_front_driver-1774688324602.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7373/20477373/exterior_front_driver-1774688324602.jpg saved to cache
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700da2d10>
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7373%252F20477373%252Fexterior_rear_driver-1774634051698.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7373/20477373/exterior_rear_driver-1774634051698.jpg saved to cache
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f903bc10>
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7086%252F19677086%252Fexterior_front_passenger-1774626888209.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7086/19677086/exterior_front_passenger-1774626888209.jpg saved to cache
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ce10d0>
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2264%252F20462264%252Fexterior_rear_driver-1774777991949.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_rear_driver-1774777991949.jpg saved to cache
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d968fad-6d20-553a-86fc-fb276df54233
2026-03-29 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_front_driver-1774710518663.jpg> (referer: None)
2026-03-29 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7865/20367865/docs_service_history-1774712326192.jpg?ixlib=js-3.8.0&auto=format&s=d0fc76d91de58b104535f324f8c5ba0d> (referer: None)
2026-03-29 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7865/20367865/interior_rear_seats-1774712102236.jpg> (referer: None)
2026-03-29 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_front_passenger-1774690031082.jpg> (referer: None)
2026-03-29 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7346/20487346/docs_service_history-1774711478306.jpg?ixlib=js-3.8.0&auto=format&s=9048a82c26d177ad692d368cda886cf4> (referer: None)
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0e4e50>
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7346%252F20487346%252Fexterior_front_driver-1774710518663.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_front_driver-1774710518663.jpg saved to cache
2026-03-29 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284
2026-03-29 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2264/20462264/docs_service_history-1774779774637.jpg?ixlib=js-3.8.0&auto=format&s=abba7b01884f8c76cc65a261c44ca993> (referer: None)
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90c8b10>
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7865%252F20367865%252Fdocs_service_history-1774712326192.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd0fc76d91de58b104535f324f8c5ba0d') HTTP/1.1" 204 0
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7865/20367865/docs_service_history-1774712326192.jpg?ixlib=js-3.8.0&auto=format&s=d0fc76d91de58b104535f324f8c5ba0d saved to cache
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7304634-f068-51bc-8dd9-8e2a9dcb63af
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8625250>
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7865%252F20367865%252Finterior_rear_seats-1774712102236.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7865/20367865/interior_rear_seats-1774712102236.jpg saved to cache
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7304634-f068-51bc-8dd9-8e2a9dcb63af
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8511190>
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8729%252F10578729%252Fexterior_front_passenger-1774690031082.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_front_passenger-1774690031082.jpg saved to cache
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d49e9e1a-9993-5399-9602-891efcc72d09
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a6dd50>
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7346%252F20487346%252Fdocs_service_history-1774711478306.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9048a82c26d177ad692d368cda886cf4') HTTP/1.1" 204 0
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7346/20487346/docs_service_history-1774711478306.jpg?ixlib=js-3.8.0&auto=format&s=9048a82c26d177ad692d368cda886cf4 saved to cache
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284
2026-03-29 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7086/19677086/docs_service_history-1774704831666.jpg?ixlib=js-3.8.0&auto=format&s=5ea287f407f3777eadbb46675aa6769f> (referer: None)
2026-03-29 20:03:13 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (14693113) larger than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7373/20477373/docs_service_history-1774636219474.png?ixlib=js-3.8.0&auto=format&s=dbeac0678b541622e0b90f2fc74e4cec>.
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9449b90>
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2264%252F20462264%252Fdocs_service_history-1774779774637.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dabba7b01884f8c76cc65a261c44ca993') HTTP/1.1" 204 0
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2264/20462264/docs_service_history-1774779774637.jpg?ixlib=js-3.8.0&auto=format&s=abba7b01884f8c76cc65a261c44ca993 saved to cache
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d968fad-6d20-553a-86fc-fb276df54233
2026-03-29 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7373/20477373/instrument_cluster-1774688360370.jpg> (referer: None)
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae68b10>
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7086%252F19677086%252Fdocs_service_history-1774704831666.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5ea287f407f3777eadbb46675aa6769f') HTTP/1.1" 204 0
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7086/19677086/docs_service_history-1774704831666.jpg?ixlib=js-3.8.0&auto=format&s=5ea287f407f3777eadbb46675aa6769f saved to cache
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de
2026-03-29 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7346/20487346/instrument_cluster-1774710982422.jpg> (referer: None)
2026-03-29 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8729/10578729/docs_service_history-1774690811496.jpg?ixlib=js-3.8.0&auto=format&s=4ae703abf69d1fbb71c745f424dd49eb> (referer: None)
2026-03-29 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7086/19677086/interior_boot-1774627367824.jpg> (referer: None)
2026-03-29 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7865/20367865/interior_dashboard-1774712121121.jpg> (referer: None)
2026-03-29 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7865/20367865/instrument_cluster-1774712140900.jpg> (referer: None)
2026-03-29 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2264/20462264/instrument_cluster-1774778752317.jpg> (referer: None)
2026-03-29 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7865/20367865/interior_boot-1774712107339.jpg> (referer: None)
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f909a950>
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7373%252F20477373%252Finstrument_cluster-1774688360370.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7373/20477373/instrument_cluster-1774688360370.jpg saved to cache
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca9b90>
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7346%252F20487346%252Finstrument_cluster-1774710982422.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7346/20487346/instrument_cluster-1774710982422.jpg saved to cache
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1f6f10>
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8729%252F10578729%252Fdocs_service_history-1774690811496.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4ae703abf69d1fbb71c745f424dd49eb') HTTP/1.1" 204 0
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8729/10578729/docs_service_history-1774690811496.jpg?ixlib=js-3.8.0&auto=format&s=4ae703abf69d1fbb71c745f424dd49eb saved to cache
2026-03-29 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d49e9e1a-9993-5399-9602-891efcc72d09
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d7c690>
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7086%252F19677086%252Finterior_boot-1774627367824.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7086/19677086/interior_boot-1774627367824.jpg saved to cache
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1f4850>
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7865%252F20367865%252Finterior_dashboard-1774712121121.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7865/20367865/interior_dashboard-1774712121121.jpg saved to cache
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7304634-f068-51bc-8dd9-8e2a9dcb63af
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d7c250>
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7865%252F20367865%252Finstrument_cluster-1774712140900.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7865/20367865/instrument_cluster-1774712140900.jpg saved to cache
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7304634-f068-51bc-8dd9-8e2a9dcb63af
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f924b4d0>
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2264%252F20462264%252Finstrument_cluster-1774778752317.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2264/20462264/instrument_cluster-1774778752317.jpg saved to cache
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d968fad-6d20-553a-86fc-fb276df54233
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1f74d0>
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7865%252F20367865%252Finterior_boot-1774712107339.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7865/20367865/interior_boot-1774712107339.jpg saved to cache
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7304634-f068-51bc-8dd9-8e2a9dcb63af
2026-03-29 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7086/19677086/instrument_cluster-1774627667497.jpg> (referer: None)
2026-03-29 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7346/20487346/interior_boot-1774710928333.jpg> (referer: None)
2026-03-29 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7346/20487346/interior_dashboard-1774710925168.jpg> (referer: None)
2026-03-29 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2264/20462264/interior_boot-1774778694881.jpg> (referer: None)
2026-03-29 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7373/20477373/interior_boot-1774634552675.jpg> (referer: None)
2026-03-29 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2264/20462264/interior_dashboard-1774778692210.jpg> (referer: None)
2026-03-29 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7373/20477373/interior_dashboard-1774688345229.jpg> (referer: None)
2026-03-29 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7346/20487346/interior_rear_seats-1774710892374.jpg> (referer: None)
2026-03-29 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7373/20477373/interior_rear_seats-1774634456296.jpg> (referer: None)
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f863f7d0>
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7086%252F19677086%252Finstrument_cluster-1774627667497.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7086/19677086/instrument_cluster-1774627667497.jpg saved to cache
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de
2026-03-29 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7086/19677086/interior_dashboard-1774627393382.jpg> (referer: None)
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700dcb490>
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7346%252F20487346%252Finterior_boot-1774710928333.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7346/20487346/interior_boot-1774710928333.jpg saved to cache
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f964a090>
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7346%252F20487346%252Finterior_dashboard-1774710925168.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7346/20487346/interior_dashboard-1774710925168.jpg saved to cache
2026-03-29 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d17850>
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2264%252F20462264%252Finterior_boot-1774778694881.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2264/20462264/interior_boot-1774778694881.jpg saved to cache
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d968fad-6d20-553a-86fc-fb276df54233
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1dc8d0>
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7373%252F20477373%252Finterior_boot-1774634552675.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7373/20477373/interior_boot-1774634552675.jpg saved to cache
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94df190>
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2264%252F20462264%252Finterior_dashboard-1774778692210.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2264/20462264/interior_dashboard-1774778692210.jpg saved to cache
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d968fad-6d20-553a-86fc-fb276df54233
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f926a910>
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7373%252F20477373%252Finterior_dashboard-1774688345229.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7373/20477373/interior_dashboard-1774688345229.jpg saved to cache
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93dbad0>
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7346%252F20487346%252Finterior_rear_seats-1774710892374.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7346/20487346/interior_rear_seats-1774710892374.jpg saved to cache
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93da310>
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7373%252F20477373%252Finterior_rear_seats-1774634456296.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7373/20477373/interior_rear_seats-1774634456296.jpg saved to cache
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3
2026-03-29 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8729/10578729/instrument_cluster-1774690613022.jpg> (referer: None)
2026-03-29 20:03:15 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7373/20477373/docs_service_history-1774636219474.png?ixlib=js-3.8.0&auto=format&s=dbeac0678b541622e0b90f2fc74e4cec>.
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e223d0>
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7086%252F19677086%252Finterior_dashboard-1774627393382.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7086/19677086/interior_dashboard-1774627393382.jpg saved to cache
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de
2026-03-29 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2264/20462264/interior_rear_seats-1774778665156.jpg> (referer: None)
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae6a6d0>
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8729%252F10578729%252Finstrument_cluster-1774690613022.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8729/10578729/instrument_cluster-1774690613022.jpg saved to cache
2026-03-29 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d49e9e1a-9993-5399-9602-891efcc72d09
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e420d0>
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2264%252F20462264%252Finterior_rear_seats-1774778665156.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2264/20462264/interior_rear_seats-1774778665156.jpg saved to cache
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d968fad-6d20-553a-86fc-fb276df54233
2026-03-29 20:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7346/20487346/interior_front_seats-1774711208737.jpg> (referer: None)
2026-03-29 20:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7086/19677086/interior_rear_seats-1774627287526.jpg> (referer: None)
2026-03-29 20:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7865/20367865/interior_front_seats-1774712207230.jpg> (referer: None)
2026-03-29 20:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7373/20477373/interior_front_seats-1774634435831.jpg> (referer: None)
2026-03-29 20:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2264/20462264/interior_front_seats-1774778739384.jpg> (referer: None)
2026-03-29 20:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_rear_passenger-1774778009195.jpg> (referer: None)
2026-03-29 20:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7373/20477373/docs_service_history-1774636219474.png?ixlib=js-3.8.0&auto=format&s=dbeac0678b541622e0b90f2fc74e4cec> (referer: None)
2026-03-29 20:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_rear_passenger-1774710558610.jpg> (referer: None)
2026-03-29 20:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7865/20367865/exterior_front_passenger-1774706820103.jpg> (referer: None)
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb26d0>
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7346%252F20487346%252Finterior_front_seats-1774711208737.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7346/20487346/interior_front_seats-1774711208737.jpg saved to cache
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90cb310>
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7086%252F19677086%252Finterior_rear_seats-1774627287526.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7086/19677086/interior_rear_seats-1774627287526.jpg saved to cache
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de
2026-03-29 20:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7373/20477373/exterior_rear_passenger-1774634068568.jpg> (referer: None)
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabd1010>
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7865%252F20367865%252Finterior_front_seats-1774712207230.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7865/20367865/interior_front_seats-1774712207230.jpg saved to cache
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7304634-f068-51bc-8dd9-8e2a9dcb63af
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac84250>
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7373%252F20477373%252Finterior_front_seats-1774634435831.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7373/20477373/interior_front_seats-1774634435831.jpg saved to cache
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae694d0>
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2264%252F20462264%252Finterior_front_seats-1774778739384.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2264/20462264/interior_front_seats-1774778739384.jpg saved to cache
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d968fad-6d20-553a-86fc-fb276df54233
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94495d0>
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2264%252F20462264%252Fexterior_rear_passenger-1774778009195.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_rear_passenger-1774778009195.jpg saved to cache
2026-03-29 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d968fad-6d20-553a-86fc-fb276df54233
2026-03-29 20:03:16 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:03:16 [PIL.PngImagePlugin] DEBUG: STREAM b'iCCP' 41 355
2026-03-29 20:03:16 [PIL.PngImagePlugin] DEBUG: iCCP profile name b'kCGColorSpaceDisplayP3'
2026-03-29 20:03:16 [PIL.PngImagePlugin] DEBUG: Compression method 0
2026-03-29 20:03:16 [PIL.PngImagePlugin] DEBUG: STREAM b'cICP' 408 4
2026-03-29 20:03:16 [PIL.PngImagePlugin] DEBUG: b'cICP' 408 4 (unknown)
2026-03-29 20:03:16 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 424 120
2026-03-29 20:03:16 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 556 9
2026-03-29 20:03:16 [PIL.PngImagePlugin] DEBUG: STREAM b'iDOT' 577 28
2026-03-29 20:03:16 [PIL.PngImagePlugin] DEBUG: b'iDOT' 577 28 (unknown)
2026-03-29 20:03:16 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 617 16384
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9456ad0>
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_9.png HTTP/1.1" 201 0
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7373%252F20477373%252Fdocs_service_history-1774636219474.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddbeac0678b541622e0b90f2fc74e4cec') HTTP/1.1" 204 0
2026-03-29 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7373/20477373/docs_service_history-1774636219474.png?ixlib=js-3.8.0&auto=format&s=dbeac0678b541622e0b90f2fc74e4cec saved to cache
2026-03-29 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa158390>
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7346%252F20487346%252Fexterior_rear_passenger-1774710558610.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_rear_passenger-1774710558610.jpg saved to cache
2026-03-29 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9456490>
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7865%252F20367865%252Fexterior_front_passenger-1774706820103.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7865/20367865/exterior_front_passenger-1774706820103.jpg saved to cache
2026-03-29 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7304634-f068-51bc-8dd9-8e2a9dcb63af
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ddd690>
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7373%252F20477373%252Fexterior_rear_passenger-1774634068568.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7373/20477373/exterior_rear_passenger-1774634068568.jpg saved to cache
2026-03-29 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3
2026-03-29 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_front_passenger-1774778027087.jpg> (referer: None)
2026-03-29 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8729/10578729/interior_dashboard-1774690623323.jpg> (referer: None)
2026-03-29 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7865/20367865/exterior_rear_passenger-1774713038772.jpg> (referer: None)
2026-03-29 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8729/10578729/interior_rear_seats-1774690579122.jpg> (referer: None)
2026-03-29 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8729/10578729/interior_boot-1774690641550.jpg> (referer: None)
2026-03-29 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_front_passenger-1774710560902.jpg> (referer: None)
2026-03-29 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7086/19677086/exterior_rear_driver-1774627775534.jpg> (referer: None)
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ddf3d0>
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2264%252F20462264%252Fexterior_front_passenger-1774778027087.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_front_passenger-1774778027087.jpg saved to cache
2026-03-29 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d968fad-6d20-553a-86fc-fb276df54233
2026-03-29 20:03:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d968fad-6d20-553a-86fc-fb276df54233, skipping ID generation
2026-03-29 20:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d968fad-6d20-553a-86fc-fb276df54233 with scrape type 1
2026-03-29 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d968fad-6d20-553a-86fc-fb276df54233 sending to next pipeline
2026-03-29 20:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5d968fad-6d20-553a-86fc-fb276df54233, identifier: 20462264
2026-03-29 20:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5d968fad-6d20-553a-86fc-fb276df54233 with identifier: 20462264
2026-03-29 20:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5d968fad-6d20-553a-86fc-fb276df54233 with identifier: 20462264
2026-03-29 20:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5d968fad-6d20-553a-86fc-fb276df54233 with identifier: 20462264 to the API
2026-03-29 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_front_passenger-1774778027087.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '5d968fad-6d20-553a-86fc-fb276df54233',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LS17 UFZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20462264',
'listing': 'auction',
'location': 'Hertfordshire Stevenage',
'make': 'Audi',
'model': 'A3',
'odometer': 50000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1227332,
'Height': 2177,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_front_driver-1774777968885.jpg',
'Width': 2902},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1503503,
'Height': 2477,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_rear_driver-1774777991949.jpg',
'Width': 3303},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1383789,
'Height': 2468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_front_passenger-1774778027087.jpg',
'Width': 3291},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1757823,
'Height': 2632,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2264/20462264/exterior_rear_passenger-1774778009195.jpg',
'Width': 3509},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4018884,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2264/20462264/interior_front_seats-1774778739384.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4848278,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2264/20462264/interior_rear_seats-1774778665156.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1681225,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2264/20462264/interior_dashboard-1774778692210.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2637512,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2264/20462264/instrument_cluster-1774778752317.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3640147,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2264/20462264/interior_boot-1774778694881.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d968fad-6d20-553a-86fc-fb276df54233/5d968fad-6d20-553a-86fc-fb276df54233_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2613189,
'Height': 2827,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2264/20462264/docs_service_history-1774779774637.jpg?ixlib=js-3.8.0&auto=format&s=abba7b01884f8c76cc65a261c44ca993',
'Width': 1985}],
'price': 9674,
'price_includes_vat': False,
'registration_date': '2017-03-27',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 S Line TFSI',
'transmission': 'manual',
'trim': 'S Line TFSI',
'vin': 'WAUZZZ8V5H1017526',
'year': 2017}
2026-03-29 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720462264%27 HTTP/1.1" 200 None
2026-03-29 20:03:18 [motorway.uk] INFO: Saving data for 20462264: {'created_time': 1774814598.717744, 'last_price_update_time': 1774814598.717753, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20462264') HTTP/1.1" 204 0
2026-03-29 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9607950>
2026-03-29 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8729%252F10578729%252Finterior_dashboard-1774690623323.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8729/10578729/interior_dashboard-1774690623323.jpg saved to cache
2026-03-29 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d49e9e1a-9993-5399-9602-891efcc72d09
2026-03-29 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f881ad10>
2026-03-29 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7865%252F20367865%252Fexterior_rear_passenger-1774713038772.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7865/20367865/exterior_rear_passenger-1774713038772.jpg saved to cache
2026-03-29 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7304634-f068-51bc-8dd9-8e2a9dcb63af
2026-03-29 20:03:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7304634-f068-51bc-8dd9-8e2a9dcb63af, skipping ID generation
2026-03-29 20:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7304634-f068-51bc-8dd9-8e2a9dcb63af with scrape type 1
2026-03-29 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7304634-f068-51bc-8dd9-8e2a9dcb63af sending to next pipeline
2026-03-29 20:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d7304634-f068-51bc-8dd9-8e2a9dcb63af, identifier: 20367865
2026-03-29 20:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8818750>
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8729%252F10578729%252Finterior_rear_seats-1774690579122.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8729/10578729/interior_rear_seats-1774690579122.jpg saved to cache
2026-03-29 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d49e9e1a-9993-5399-9602-891efcc72d09
2026-03-29 20:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae68dd0>
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8729%252F10578729%252Finterior_boot-1774690641550.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8729/10578729/interior_boot-1774690641550.jpg saved to cache
2026-03-29 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d49e9e1a-9993-5399-9602-891efcc72d09
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700e0ae50>
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7346%252F20487346%252Fexterior_front_passenger-1774710560902.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_front_passenger-1774710560902.jpg saved to cache
2026-03-29 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284
2026-03-29 20:03:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69a72c6d-8f4d-5545-b47e-8f4e3861d284, skipping ID generation
2026-03-29 20:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284 with scrape type 1
2026-03-29 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69a72c6d-8f4d-5545-b47e-8f4e3861d284 sending to next pipeline
2026-03-29 20:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 69a72c6d-8f4d-5545-b47e-8f4e3861d284, identifier: 20487346
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8534a90>
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7086%252F19677086%252Fexterior_rear_driver-1774627775534.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7086/19677086/exterior_rear_driver-1774627775534.jpg saved to cache
2026-03-29 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de
2026-03-29 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7086/19677086/exterior_front_driver-1774626903470.jpg> (referer: None)
2026-03-29 20:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d7304634-f068-51bc-8dd9-8e2a9dcb63af with identifier: 20367865
2026-03-29 20:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d7304634-f068-51bc-8dd9-8e2a9dcb63af with identifier: 20367865
2026-03-29 20:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d7304634-f068-51bc-8dd9-8e2a9dcb63af with identifier: 20367865 to the API
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/7865/20367865/exterior_rear_passenger-1774713038772.jpg>
{'auction_title': '',
'category': None,
'color': 'Orange',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd7304634-f068-51bc-8dd9-8e2a9dcb63af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HW23 FSG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20367865',
'listing': 'auction',
'location': 'Isle of Wight Newport',
'make': 'Dacia',
'model': 'Duster',
'odometer': 25691,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1266805,
'Height': 2286,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7865/20367865/exterior_front_driver-1774706815673.jpg',
'Width': 3048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1095536,
'Height': 2146,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7865/20367865/exterior_rear_driver-1774706822377.jpg',
'Width': 2861},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1244058,
'Height': 2283,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7865/20367865/exterior_front_passenger-1774706820103.jpg',
'Width': 3044},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1983822,
'Height': 2603,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7865/20367865/exterior_rear_passenger-1774713038772.jpg',
'Width': 3471},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2843128,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7865/20367865/interior_front_seats-1774712207230.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3930680,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7865/20367865/interior_rear_seats-1774712102236.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2177966,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7865/20367865/interior_dashboard-1774712121121.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2166435,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7865/20367865/instrument_cluster-1774712140900.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3991924,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7865/20367865/interior_boot-1774712107339.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7304634-f068-51bc-8dd9-8e2a9dcb63af/d7304634-f068-51bc-8dd9-8e2a9dcb63af_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1607184,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7865/20367865/docs_service_history-1774712326192.jpg?ixlib=js-3.8.0&auto=format&s=d0fc76d91de58b104535f324f8c5ba0d',
'Width': 3840}],
'price': 11314,
'price_includes_vat': False,
'registration_date': '2023-03-07',
'seats_number': None,
'seller_name': None,
'title': 'Dacia Duster Journey TCE 4X2',
'transmission': 'manual',
'trim': 'Journey TCE 4X2',
'vin': 'VF1HJD20270184970',
'year': 2023}
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720367865%27 HTTP/1.1" 200 None
2026-03-29 20:03:20 [motorway.uk] INFO: Saving data for 20367865: {'created_time': 1774814600.014232, 'last_price_update_time': 1774814600.014241, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20367865') HTTP/1.1" 204 0
2026-03-29 20:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 69a72c6d-8f4d-5545-b47e-8f4e3861d284 with identifier: 20487346
2026-03-29 20:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 69a72c6d-8f4d-5545-b47e-8f4e3861d284 with identifier: 20487346
2026-03-29 20:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 69a72c6d-8f4d-5545-b47e-8f4e3861d284 with identifier: 20487346 to the API
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_front_passenger-1774710560902.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '69a72c6d-8f4d-5545-b47e-8f4e3861d284',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DA55 MAK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487346',
'listing': 'auction',
'location': 'Nottinghamshire Mansfield',
'make': 'BMW',
'model': 'M2',
'odometer': 12850,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1511133,
'Height': 2603,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_front_driver-1774710518663.jpg',
'Width': 3470},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1997285,
'Height': 2906,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_rear_driver-1774710536787.jpg',
'Width': 3875},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1799017,
'Height': 2721,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_front_passenger-1774710560902.jpg',
'Width': 3628},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1325184,
'Height': 2993,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7346/20487346/exterior_rear_passenger-1774710558610.jpg',
'Width': 3991},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2768542,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7346/20487346/interior_front_seats-1774711208737.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2517563,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7346/20487346/interior_rear_seats-1774710892374.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1512622,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7346/20487346/interior_dashboard-1774710925168.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 874442,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7346/20487346/instrument_cluster-1774710982422.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3217708,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7346/20487346/interior_boot-1774710928333.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69a72c6d-8f4d-5545-b47e-8f4e3861d284/69a72c6d-8f4d-5545-b47e-8f4e3861d284_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1687483,
'Height': 1274,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7346/20487346/docs_service_history-1774711478306.jpg?ixlib=js-3.8.0&auto=format&s=9048a82c26d177ad692d368cda886cf4',
'Width': 2267}],
'price': 38136,
'price_includes_vat': False,
'registration_date': '2024-03-29',
'seats_number': None,
'seller_name': None,
'title': 'BMW M240i xDrive Auto',
'transmission': 'automatic',
'trim': '40i xDrive Auto',
'vin': 'WBA52CM0X08E28557',
'year': 2024}
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487346%27 HTTP/1.1" 200 None
2026-03-29 20:03:20 [motorway.uk] INFO: Saving data for 20487346: {'created_time': 1774814600.4007, 'last_price_update_time': 1774814600.400709, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487346') HTTP/1.1" 204 0
2026-03-29 20:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7086/19677086/interior_front_seats-1774627292519.jpg> (referer: None)
2026-03-29 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f24b10>
2026-03-29 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7086%252F19677086%252Fexterior_front_driver-1774626903470.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7086/19677086/exterior_front_driver-1774626903470.jpg saved to cache
2026-03-29 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de
2026-03-29 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ac0610>
2026-03-29 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7086%252F19677086%252Finterior_front_seats-1774627292519.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7086/19677086/interior_front_seats-1774627292519.jpg saved to cache
2026-03-29 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de
2026-03-29 20:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5dd43f3b-a18c-5a20-b589-fea6f7bc46de, skipping ID generation
2026-03-29 20:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de with scrape type 1
2026-03-29 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5dd43f3b-a18c-5a20-b589-fea6f7bc46de sending to next pipeline
2026-03-29 20:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5dd43f3b-a18c-5a20-b589-fea6f7bc46de, identifier: 19677086
2026-03-29 20:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5dd43f3b-a18c-5a20-b589-fea6f7bc46de with identifier: 19677086
2026-03-29 20:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5dd43f3b-a18c-5a20-b589-fea6f7bc46de with identifier: 19677086
2026-03-29 20:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5dd43f3b-a18c-5a20-b589-fea6f7bc46de with identifier: 19677086 to the API
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7086/19677086/interior_front_seats-1774627292519.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '5dd43f3b-a18c-5a20-b589-fea6f7bc46de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KO19 WKX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19677086',
'listing': 'auction',
'location': 'Shropshire Telford',
'make': 'Skoda',
'model': 'Karoq',
'odometer': 88765,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271269,
'Height': 985,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7086/19677086/exterior_front_driver-1774626903470.jpg',
'Width': 1313},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239013,
'Height': 866,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7086/19677086/exterior_rear_driver-1774627775534.jpg',
'Width': 1155},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256774,
'Height': 925,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7086/19677086/exterior_front_passenger-1774626888209.jpg',
'Width': 1233},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293293,
'Height': 957,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7086/19677086/exterior_rear_passenger-1774626914774.jpg',
'Width': 1276},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561651,
'Height': 1821,
'OriginUrl': 'https://motorway-photos.imgix.net/7086/19677086/interior_front_seats-1774627292519.jpg',
'Width': 1366},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478354,
'Height': 1821,
'OriginUrl': 'https://motorway-photos.imgix.net/7086/19677086/interior_rear_seats-1774627287526.jpg',
'Width': 1366},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 451577,
'Height': 1266,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7086/19677086/interior_dashboard-1774627393382.jpg',
'Width': 1688},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322322,
'Height': 1011,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7086/19677086/instrument_cluster-1774627667497.jpg',
'Width': 1349},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490897,
'Height': 1372,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7086/19677086/interior_boot-1774627367824.jpg',
'Width': 1830},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dd43f3b-a18c-5a20-b589-fea6f7bc46de/5dd43f3b-a18c-5a20-b589-fea6f7bc46de_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201987,
'Height': 1784,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7086/19677086/docs_service_history-1774704831666.jpg?ixlib=js-3.8.0&auto=format&s=5ea287f407f3777eadbb46675aa6769f',
'Width': 1320}],
'price': 12050,
'price_includes_vat': False,
'registration_date': '2019-06-07',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Karoq Sportline TSI 4X4 S-A',
'transmission': 'automatic',
'trim': 'Sportline TSI 4X4 S-A',
'vin': 'TMBMR7NU5K2049603',
'year': 2019}
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719677086%27 HTTP/1.1" 200 None
2026-03-29 20:03:21 [motorway.uk] INFO: Saving data for 19677086: {'created_time': 1774814601.11833, 'last_price_update_time': 1774814601.118343, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19677086') HTTP/1.1" 204 0
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5628/18265628/interior_dashboard-1774703082638.jpg> (referer: None)
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_front_driver-1774690074650.jpg> (referer: None)
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9309/20369309/interior_dashboard-1774708537316.jpg> (referer: None)
2026-03-29 20:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_rear_driver-1774689952165.jpg> (referer: None)
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_rear_passenger-1774708132597.jpg> (referer: None)
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_rear_passenger-1774696402453.jpg> (referer: None)
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_front_passenger-1774696418215.jpg> (referer: None)
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7373/20477373/exterior_front_passenger-1774634079402.jpg> (referer: None)
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_front_passenger-1774708146403.jpg> (referer: None)
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9309/20369309/interior_rear_seats-1774708506430.jpg> (referer: None)
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5628/18265628/interior_rear_seats-1774696660020.jpg> (referer: None)
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8729/10578729/interior_front_seats-1774690505716.jpg> (referer: None)
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5628/18265628/interior_boot-1774696697468.jpg> (referer: None)
2026-03-29 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5628/18265628/interior_front_seats-1774696721269.jpg> (referer: None)
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8974e90>
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5628%252F18265628%252Finterior_dashboard-1774703082638.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5628/18265628/interior_dashboard-1774703082638.jpg saved to cache
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f2b305d-8163-5457-8d7b-cdb65c268085
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9688b10>
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8729%252F10578729%252Fexterior_front_driver-1774690074650.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_front_driver-1774690074650.jpg saved to cache
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d49e9e1a-9993-5399-9602-891efcc72d09
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf4ce50>
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9309%252F20369309%252Finterior_dashboard-1774708537316.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9309/20369309/interior_dashboard-1774708537316.jpg saved to cache
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f425d8f1-19f2-5425-88b9-b12b8195c6b3
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9602010>
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8729%252F10578729%252Fexterior_rear_driver-1774689952165.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_rear_driver-1774689952165.jpg saved to cache
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d49e9e1a-9993-5399-9602-891efcc72d09
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faddb1d0>
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9309%252F20369309%252Fexterior_rear_passenger-1774708132597.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_rear_passenger-1774708132597.jpg saved to cache
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f425d8f1-19f2-5425-88b9-b12b8195c6b3
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9600d10>
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5628%252F18265628%252Fexterior_rear_passenger-1774696402453.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_rear_passenger-1774696402453.jpg saved to cache
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f2b305d-8163-5457-8d7b-cdb65c268085
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9267210>
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5628%252F18265628%252Fexterior_front_passenger-1774696418215.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_front_passenger-1774696418215.jpg saved to cache
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f2b305d-8163-5457-8d7b-cdb65c268085
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96036d0>
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7373%252F20477373%252Fexterior_front_passenger-1774634079402.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7373/20477373/exterior_front_passenger-1774634079402.jpg saved to cache
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3
2026-03-29 20:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3, skipping ID generation
2026-03-29 20:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3 with scrape type 1
2026-03-29 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3 sending to next pipeline
2026-03-29 20:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3, identifier: 20477373
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9425cd0>
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9309%252F20369309%252Fexterior_front_passenger-1774708146403.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_front_passenger-1774708146403.jpg saved to cache
2026-03-29 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f425d8f1-19f2-5425-88b9-b12b8195c6b3
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9245910>
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9309%252F20369309%252Finterior_rear_seats-1774708506430.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9309/20369309/interior_rear_seats-1774708506430.jpg saved to cache
2026-03-29 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f425d8f1-19f2-5425-88b9-b12b8195c6b3
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94c9890>
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5628%252F18265628%252Finterior_rear_seats-1774696660020.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5628/18265628/interior_rear_seats-1774696660020.jpg saved to cache
2026-03-29 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f2b305d-8163-5457-8d7b-cdb65c268085
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9653510>
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8729%252F10578729%252Finterior_front_seats-1774690505716.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8729/10578729/interior_front_seats-1774690505716.jpg saved to cache
2026-03-29 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d49e9e1a-9993-5399-9602-891efcc72d09
2026-03-29 20:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d49e9e1a-9993-5399-9602-891efcc72d09, skipping ID generation
2026-03-29 20:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d49e9e1a-9993-5399-9602-891efcc72d09 with scrape type 1
2026-03-29 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d49e9e1a-9993-5399-9602-891efcc72d09 sending to next pipeline
2026-03-29 20:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d49e9e1a-9993-5399-9602-891efcc72d09, identifier: 10578729
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ddd6d0>
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5628%252F18265628%252Finterior_boot-1774696697468.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5628/18265628/interior_boot-1774696697468.jpg saved to cache
2026-03-29 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f2b305d-8163-5457-8d7b-cdb65c268085
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9048350>
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5628%252F18265628%252Finterior_front_seats-1774696721269.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5628/18265628/interior_front_seats-1774696721269.jpg saved to cache
2026-03-29 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f2b305d-8163-5457-8d7b-cdb65c268085
2026-03-29 20:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3 with identifier: 20477373
2026-03-29 20:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3 with identifier: 20477373
2026-03-29 20:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3 with identifier: 20477373 to the API
2026-03-29 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7373/20477373/exterior_front_passenger-1774634079402.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'S123 AVY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20477373',
'listing': 'auction',
'location': 'North Yorkshire Selby',
'make': 'BMW',
'model': 'M4',
'odometer': 36750,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3781914,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7373/20477373/exterior_front_driver-1774688324602.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2700797,
'Height': 2951,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7373/20477373/exterior_rear_driver-1774634051698.jpg',
'Width': 3934},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2721593,
'Height': 2995,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7373/20477373/exterior_front_passenger-1774634079402.jpg',
'Width': 3993},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2293047,
'Height': 2934,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7373/20477373/exterior_rear_passenger-1774634068568.jpg',
'Width': 3912},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3101462,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7373/20477373/interior_front_seats-1774634435831.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2674730,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7373/20477373/interior_rear_seats-1774634456296.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2068916,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7373/20477373/interior_dashboard-1774688345229.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662981,
'Height': 1913,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7373/20477373/instrument_cluster-1774688360370.jpg',
'Width': 2551},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3608911,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7373/20477373/interior_boot-1774634552675.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3/b82c9dfc-f8dd-58ad-b2e0-3ed181ca1ae3_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 14693113,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7373/20477373/docs_service_history-1774636219474.png?ixlib=js-3.8.0&auto=format&s=dbeac0678b541622e0b90f2fc74e4cec',
'Width': 4032}],
'price': 31862,
'price_includes_vat': False,
'registration_date': '2023-02-20',
'seats_number': None,
'seller_name': None,
'title': 'BMW M440D xDrive MHEV Auto',
'transmission': 'automatic',
'trim': '40D xDrive MHEV Auto',
'vin': 'WBA52AS0X0CM20413',
'year': 2023}
2026-03-29 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720477373%27 HTTP/1.1" 200 None
2026-03-29 20:03:23 [motorway.uk] INFO: Saving data for 20477373: {'created_time': 1774814603.33473, 'last_price_update_time': 1774814603.334741, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20477373') HTTP/1.1" 204 0
2026-03-29 20:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d49e9e1a-9993-5399-9602-891efcc72d09 with identifier: 10578729
2026-03-29 20:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d49e9e1a-9993-5399-9602-891efcc72d09 with identifier: 10578729
2026-03-29 20:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d49e9e1a-9993-5399-9602-891efcc72d09 with identifier: 10578729 to the API
2026-03-29 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8729/10578729/interior_front_seats-1774690505716.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd49e9e1a-9993-5399-9602-891efcc72d09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LM21 RXT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10578729',
'listing': 'auction',
'location': 'None Tring',
'make': 'Kia',
'model': 'Sportage',
'odometer': 30600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1821711,
'Height': 2782,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_front_driver-1774690074650.jpg',
'Width': 3709},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2306177,
'Height': 2927,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_rear_driver-1774689952165.jpg',
'Width': 3902},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2348093,
'Height': 2906,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_front_passenger-1774690031082.jpg',
'Width': 3875},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1774726,
'Height': 2507,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8729/10578729/exterior_rear_passenger-1774690050360.jpg',
'Width': 3342},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3510698,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8729/10578729/interior_front_seats-1774690505716.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3271288,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8729/10578729/interior_rear_seats-1774690579122.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1742366,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8729/10578729/interior_dashboard-1774690623323.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2845619,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8729/10578729/instrument_cluster-1774690613022.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3800952,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8729/10578729/interior_boot-1774690641550.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d49e9e1a-9993-5399-9602-891efcc72d09/d49e9e1a-9993-5399-9602-891efcc72d09_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 718610,
'Height': 4058,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8729/10578729/docs_service_history-1774690811496.jpg?ixlib=js-3.8.0&auto=format&s=4ae703abf69d1fbb71c745f424dd49eb',
'Width': 2379}],
'price': 17941,
'price_includes_vat': False,
'registration_date': '2021-04-10',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage GT-LINE S ISG 4X4 S-A',
'transmission': 'automatic',
'trim': 'GT-LINE S ISG 4X4 S-A',
'vin': 'U5YPK816WML994107',
'year': 2021}
2026-03-29 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710578729%27 HTTP/1.1" 200 None
2026-03-29 20:03:24 [motorway.uk] INFO: Saving data for 10578729: {'created_time': 1774814604.684208, 'last_price_update_time': 1774814604.684218, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10578729') HTTP/1.1" 204 0
2026-03-29 20:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9309/20369309/interior_front_seats-1774708433812.jpg> (referer: None)
2026-03-29 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_front_driver-1774708090597.jpg> (referer: None)
2026-03-29 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_rear_driver-1774696392710.jpg> (referer: None)
2026-03-29 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_front_driver-1774696379067.jpg> (referer: None)
2026-03-29 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6723/11716723/docs_service_history-1774714056799.jpg?ixlib=js-3.8.0&auto=format&s=cc222681b7bcedadd6c0d57a1d6629a6> (referer: None)
2026-03-29 20:03:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ab1890>
2026-03-29 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9309%252F20369309%252Finterior_front_seats-1774708433812.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9309/20369309/interior_front_seats-1774708433812.jpg saved to cache
2026-03-29 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f425d8f1-19f2-5425-88b9-b12b8195c6b3
2026-03-29 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ab39d0>
2026-03-29 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9309%252F20369309%252Fexterior_front_driver-1774708090597.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_front_driver-1774708090597.jpg saved to cache
2026-03-29 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f425d8f1-19f2-5425-88b9-b12b8195c6b3
2026-03-29 20:03:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f425d8f1-19f2-5425-88b9-b12b8195c6b3, skipping ID generation
2026-03-29 20:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f425d8f1-19f2-5425-88b9-b12b8195c6b3 with scrape type 1
2026-03-29 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f425d8f1-19f2-5425-88b9-b12b8195c6b3 sending to next pipeline
2026-03-29 20:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f425d8f1-19f2-5425-88b9-b12b8195c6b3, identifier: 20369309
2026-03-29 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ab3b90>
2026-03-29 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5628%252F18265628%252Fexterior_rear_driver-1774696392710.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_rear_driver-1774696392710.jpg saved to cache
2026-03-29 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f2b305d-8163-5457-8d7b-cdb65c268085
2026-03-29 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfd4d10>
2026-03-29 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5628%252F18265628%252Fexterior_front_driver-1774696379067.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_front_driver-1774696379067.jpg saved to cache
2026-03-29 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f2b305d-8163-5457-8d7b-cdb65c268085
2026-03-29 20:03:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f2b305d-8163-5457-8d7b-cdb65c268085, skipping ID generation
2026-03-29 20:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f2b305d-8163-5457-8d7b-cdb65c268085 with scrape type 1
2026-03-29 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f2b305d-8163-5457-8d7b-cdb65c268085 sending to next pipeline
2026-03-29 20:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4f2b305d-8163-5457-8d7b-cdb65c268085, identifier: 18265628
2026-03-29 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0a2350>
2026-03-29 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6721187a-38d1-523b-896c-7540b6ce2c3e/6721187a-38d1-523b-896c-7540b6ce2c3e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6723%252F11716723%252Fdocs_service_history-1774714056799.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcc222681b7bcedadd6c0d57a1d6629a6') HTTP/1.1" 204 0
2026-03-29 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6723/11716723/docs_service_history-1774714056799.jpg?ixlib=js-3.8.0&auto=format&s=cc222681b7bcedadd6c0d57a1d6629a6 saved to cache
2026-03-29 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6721187a-38d1-523b-896c-7540b6ce2c3e
2026-03-29 20:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f425d8f1-19f2-5425-88b9-b12b8195c6b3 with identifier: 20369309
2026-03-29 20:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f425d8f1-19f2-5425-88b9-b12b8195c6b3 with identifier: 20369309
2026-03-29 20:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f425d8f1-19f2-5425-88b9-b12b8195c6b3 with identifier: 20369309 to the API
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_front_driver-1774708090597.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f425d8f1-19f2-5425-88b9-b12b8195c6b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK20 VJY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20369309',
'listing': 'auction',
'location': 'Berkshire Thatcham',
'make': 'Vauxhall',
'model': 'Corsa',
'odometer': 44128,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1559689,
'Height': 2493,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_front_driver-1774708090597.jpg',
'Width': 3324},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2443959,
'Height': 2712,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_rear_driver-1774708114887.jpg',
'Width': 3616},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1595651,
'Height': 2226,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_front_passenger-1774708146403.jpg',
'Width': 2968},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1203937,
'Height': 1943,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9309/20369309/exterior_rear_passenger-1774708132597.jpg',
'Width': 2591},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3034143,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9309/20369309/interior_front_seats-1774708433812.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2950021,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9309/20369309/interior_rear_seats-1774708506430.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1685186,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9309/20369309/interior_dashboard-1774708537316.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2290105,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9309/20369309/instrument_cluster-1774708540018.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4172387,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9309/20369309/interior_boot-1774708541238.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425d8f1-19f2-5425-88b9-b12b8195c6b3/f425d8f1-19f2-5425-88b9-b12b8195c6b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56478,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9309/20369309/docs_service_history-1774708746081.jpg?ixlib=js-3.8.0&auto=format&s=548df8822c451559fa64f28637bd3732',
'Width': 596}],
'price': 7248,
'price_includes_vat': False,
'registration_date': '2020-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Corsa SRI Turbo',
'transmission': 'manual',
'trim': 'SRI Turbo',
'vin': 'VXKUPHNKKL4154844',
'year': 2020}
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720369309%27 HTTP/1.1" 200 None
2026-03-29 20:03:25 [motorway.uk] INFO: Saving data for 20369309: {'created_time': 1774814605.883696, 'last_price_update_time': 1774814605.883706, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20369309') HTTP/1.1" 204 0
2026-03-29 20:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4f2b305d-8163-5457-8d7b-cdb65c268085 with identifier: 18265628
2026-03-29 20:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4f2b305d-8163-5457-8d7b-cdb65c268085 with identifier: 18265628
2026-03-29 20:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4f2b305d-8163-5457-8d7b-cdb65c268085 with identifier: 18265628 to the API
2026-03-29 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_front_driver-1774696379067.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '4f2b305d-8163-5457-8d7b-cdb65c268085',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GV73 EEO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18265628',
'listing': 'auction',
'location': 'West Sussex Bognor Regis',
'make': 'BMW',
'model': '1 Series',
'odometer': 17313,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1603926,
'Height': 2629,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_front_driver-1774696379067.jpg',
'Width': 3505},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1482947,
'Height': 2477,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_rear_driver-1774696392710.jpg',
'Width': 3303},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1421889,
'Height': 2441,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_front_passenger-1774696418215.jpg',
'Width': 3255},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1345234,
'Height': 2297,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5628/18265628/exterior_rear_passenger-1774696402453.jpg',
'Width': 3062},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3485486,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5628/18265628/interior_front_seats-1774696721269.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3506658,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5628/18265628/interior_rear_seats-1774696660020.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1485853,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5628/18265628/interior_dashboard-1774703082638.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3596585,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5628/18265628/interior_boot-1774696697468.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3402476,
'Height': 1228,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5628/18265628/docs_service_history-1774696790637.jpg?ixlib=js-3.8.0&auto=format&s=06eab3d3d592b88273cfe358c642520c',
'Width': 3748},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f2b305d-8163-5457-8d7b-cdb65c268085/4f2b305d-8163-5457-8d7b-cdb65c268085_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2884720,
'Height': 1291,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5628/18265628/docs_service_history-1774696809350.jpg?ixlib=js-3.8.0&auto=format&s=4676dfcff512d1f41db1126a94846d15',
'Width': 3099}],
'price': 24458,
'price_includes_vat': False,
'registration_date': '2024-02-15',
'seats_number': None,
'seller_name': None,
'title': 'BMW 128TI Auto',
'transmission': 'automatic',
'trim': '128TI Auto',
'vin': 'WBA7L520807N99864',
'year': 2024}
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718265628%27 HTTP/1.1" 200 None
2026-03-29 20:03:26 [motorway.uk] INFO: Saving data for 18265628: {'created_time': 1774814606.269507, 'last_price_update_time': 1774814606.269517, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18265628') HTTP/1.1" 204 0
2026-03-29 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=540&page=15&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_front_driver-1774703793394.jpeg> (referer: None)
2026-03-29 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_front_passenger-1774703863987.jpeg> (referer: None)
2026-03-29 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5844/10385844/instrument_cluster-1774708952594.jpg> (referer: None)
2026-03-29 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_rear_driver-1774703923586.jpeg> (referer: None)
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 20301561
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 20480470
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720480470%27 HTTP/1.1" 200 None
2026-03-29 20:03:26 [motorway.uk] INFO: Scrape type for 20480470: 1
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 20025955
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720025955%27 HTTP/1.1" 200 None
2026-03-29 20:03:26 [motorway.uk] INFO: Scrape type for 20025955: 1
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 19072079
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 20478414
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 20390094
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 20355039
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 19897967
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719897967%27 HTTP/1.1" 200 None
2026-03-29 20:03:26 [motorway.uk] INFO: Scrape type for 19897967: 2
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9218390>
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7110%252F20487110%252Fexterior_front_driver-1774703793394.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_front_driver-1774703793394.jpeg saved to cache
2026-03-29 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 20416855
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 20036264
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 20463207
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 18730909
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718730909%27 HTTP/1.1" 200 None
2026-03-29 20:03:26 [motorway.uk] INFO: Scrape type for 18730909: 1
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010f12d0>
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7110%252F20487110%252Fexterior_front_passenger-1774703863987.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_front_passenger-1774703863987.jpeg saved to cache
2026-03-29 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad57f90>
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096ca068-7357-51fc-bb6a-11c1336972d0/096ca068-7357-51fc-bb6a-11c1336972d0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5844%252F10385844%252Finstrument_cluster-1774708952594.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5844/10385844/instrument_cluster-1774708952594.jpg saved to cache
2026-03-29 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 096ca068-7357-51fc-bb6a-11c1336972d0
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d1350>
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7110%252F20487110%252Fexterior_rear_driver-1774703923586.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_rear_driver-1774703923586.jpeg saved to cache
2026-03-29 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996
2026-03-29 20:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996, skipping ID generation
2026-03-29 20:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996 with scrape type 1
2026-03-29 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996 sending to next pipeline
2026-03-29 20:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996, identifier: 20487110
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 20382318
2026-03-29 20:03:26 [motorway.uk] INFO: Found listing with ID: 20398514
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720398514%27 HTTP/1.1" 200 None
2026-03-29 20:03:26 [motorway.uk] INFO: Scrape type for 20398514: 1
2026-03-29 20:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996 with identifier: 20487110
2026-03-29 20:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996 with identifier: 20487110
2026-03-29 20:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996 with identifier: 20487110 to the API
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_rear_driver-1774703923586.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LD20 YPH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487110',
'listing': 'auction',
'location': 'Slough Slough',
'make': 'Volvo',
'model': 'S60',
'odometer': 31141,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1179481,
'Height': 2294,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_front_driver-1774703793394.jpeg',
'Width': 3058},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1851302,
'Height': 2852,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_rear_driver-1774703923586.jpeg',
'Width': 3803},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1412126,
'Height': 2435,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_front_passenger-1774703863987.jpeg',
'Width': 3247},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2045043,
'Height': 3016,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7110/20487110/exterior_rear_passenger-1774703770113.jpeg',
'Width': 4021},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3290881,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7110/20487110/interior_front_seats-1774704233307.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3104289,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7110/20487110/interior_rear_seats-1774704176344.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2830290,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7110/20487110/interior_dashboard-1774704143567.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2273818,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7110/20487110/instrument_cluster-1774704218404.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3271642,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7110/20487110/interior_boot-1774704108711.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996/f2e7ef1d-1145-5adf-9e6b-ca7fa33e3996_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2108289,
'Height': 5376,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7110/20487110/20487110-docs_service_history-modified-1774706179671.jpeg?ixlib=js-3.8.0&auto=format&s=51b792ef92befb40e0d566e5f30af8f8',
'Width': 7168}],
'price': 17446,
'price_includes_vat': False,
'registration_date': '2020-06-23',
'seats_number': None,
'seller_name': None,
'title': 'Volvo S60 R-DESIGN + T5 Auto',
'transmission': 'automatic',
'trim': 'R-DESIGN + T5 Auto',
'vin': '7JRZS25UDLG051838',
'year': 2020}
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487110%27 HTTP/1.1" 200 None
2026-03-29 20:03:27 [motorway.uk] INFO: Saving data for 20487110: {'created_time': 1774814607.390922, 'last_price_update_time': 1774814607.390932, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487110') HTTP/1.1" 204 0
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 20484917
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 18872105
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 19791860
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719791860%27 HTTP/1.1" 200 None
2026-03-29 20:03:27 [motorway.uk] INFO: Scrape type for 19791860: 1
2026-03-29 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6723/11716723/docs_service_history-1774714055623.jpg?ixlib=js-3.8.0&auto=format&s=a76c66161de689138d8324467f54331d> (referer: None)
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 18667851
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 9844685
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279844685%27 HTTP/1.1" 200 None
2026-03-29 20:03:27 [motorway.uk] INFO: Scrape type for 9844685: 1
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 16823030
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 20408961
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 20296127
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 20222166
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720222166%27 HTTP/1.1" 200 None
2026-03-29 20:03:27 [motorway.uk] INFO: Scrape type for 20222166: 1
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 20474874
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720474874%27 HTTP/1.1" 200 None
2026-03-29 20:03:27 [motorway.uk] INFO: Scrape type for 20474874: 1
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 12127571
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 20483047
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 17857405
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 17585425
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 20401950
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 15315241
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715315241%27 HTTP/1.1" 200 None
2026-03-29 20:03:27 [motorway.uk] INFO: Scrape type for 15315241: 1
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 20394022
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 20239538
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720239538%27 HTTP/1.1" 200 None
2026-03-29 20:03:27 [motorway.uk] INFO: Scrape type for 20239538: 1
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 20066529
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 2726366
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 20047376
2026-03-29 20:03:27 [motorway.uk] INFO: Found listing with ID: 19669988
2026-03-29 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9498/20439498/exterior_rear_driver-1774543898438.jpg> (referer: None)
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8511c50>
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6721187a-38d1-523b-896c-7540b6ce2c3e/6721187a-38d1-523b-896c-7540b6ce2c3e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6723%252F11716723%252Fdocs_service_history-1774714055623.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da76c66161de689138d8324467f54331d') HTTP/1.1" 204 0
2026-03-29 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6723/11716723/docs_service_history-1774714055623.jpg?ixlib=js-3.8.0&auto=format&s=a76c66161de689138d8324467f54331d saved to cache
2026-03-29 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6721187a-38d1-523b-896c-7540b6ce2c3e
2026-03-29 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9190/20429190/docs_service_history-1774710628055.jpg?ixlib=js-3.8.0&auto=format&s=929a756df0df5b627c7c1559c048cc02> (referer: None)
2026-03-29 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7443/19687443/docs_service_history-1774720935859.jpg?ixlib=js-3.8.0&auto=format&s=2db68d1e8ec438c343f3881958d93d69> (referer: None)
2026-03-29 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5844/10385844/interior_dashboard-1774710557289.jpg> (referer: None)
2026-03-29 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3571/20463571/interior_boot-1774598737486.jpg> (referer: None)
2026-03-29 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6082/20416082/damage_scratches-1774698171762.jpg> (referer: None)
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca0850>
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b303a091-c659-5473-a3a1-47c536778e8b/b303a091-c659-5473-a3a1-47c536778e8b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9498%252F20439498%252Fexterior_rear_driver-1774543898438.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9498/20439498/exterior_rear_driver-1774543898438.jpg saved to cache
2026-03-29 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b303a091-c659-5473-a3a1-47c536778e8b
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8aced90>
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9235b29a-de54-5ffb-8eef-fd6f5016e862/9235b29a-de54-5ffb-8eef-fd6f5016e862_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9190%252F20429190%252Fdocs_service_history-1774710628055.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D929a756df0df5b627c7c1559c048cc02') HTTP/1.1" 204 0
2026-03-29 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9190/20429190/docs_service_history-1774710628055.jpg?ixlib=js-3.8.0&auto=format&s=929a756df0df5b627c7c1559c048cc02 saved to cache
2026-03-29 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9235b29a-de54-5ffb-8eef-fd6f5016e862
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8aa2890>
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ff29d4b-c906-5bff-9cea-f61df202f62a/1ff29d4b-c906-5bff-9cea-f61df202f62a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7443%252F19687443%252Fdocs_service_history-1774720935859.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2db68d1e8ec438c343f3881958d93d69') HTTP/1.1" 204 0
2026-03-29 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7443/19687443/docs_service_history-1774720935859.jpg?ixlib=js-3.8.0&auto=format&s=2db68d1e8ec438c343f3881958d93d69 saved to cache
2026-03-29 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ff29d4b-c906-5bff-9cea-f61df202f62a
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e42c50>
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096ca068-7357-51fc-bb6a-11c1336972d0/096ca068-7357-51fc-bb6a-11c1336972d0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5844%252F10385844%252Finterior_dashboard-1774710557289.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5844/10385844/interior_dashboard-1774710557289.jpg saved to cache
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 096ca068-7357-51fc-bb6a-11c1336972d0
2026-03-29 20:03:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f881a590>
2026-03-29 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_340cbf69-778f-51ac-bb3e-6b60dfbcd528/340cbf69-778f-51ac-bb3e-6b60dfbcd528_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3571%252F20463571%252Finterior_boot-1774598737486.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3571/20463571/interior_boot-1774598737486.jpg saved to cache
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 340cbf69-778f-51ac-bb3e-6b60dfbcd528
2026-03-29 20:03:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0c9fd0>
2026-03-29 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a44e57ef-48b7-5d1e-973e-c4154fa23ad0/a44e57ef-48b7-5d1e-973e-c4154fa23ad0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6082%252F20416082%252Fdamage_scratches-1774698171762.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6082/20416082/damage_scratches-1774698171762.jpg saved to cache
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a44e57ef-48b7-5d1e-973e-c4154fa23ad0
2026-03-29 20:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20471533.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19867021.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7346aec-88c5-51e4-a8cd-59b6be69944e with identifier: 20471533
2026-03-29 20:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7346aec-88c5-51e4-a8cd-59b6be69944e with scrape type 1
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7346aec-88c5-51e4-a8cd-59b6be69944e
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1533%252F20471533%252Fexterior_front_driver-1774635334013.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1533/20471533/exterior_front_driver-1774635334013.jpg not downloaded yet
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1533%252F20471533%252Fexterior_rear_driver-1774635351977.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1533/20471533/exterior_rear_driver-1774635351977.jpg not downloaded yet
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1533%252F20471533%252Fexterior_front_passenger-1774635373555.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1533/20471533/exterior_front_passenger-1774635373555.jpg not downloaded yet
2026-03-29 20:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 711eb300-b975-59c7-a68b-3fb9f7c0be74 with identifier: 19867021
2026-03-29 20:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 711eb300-b975-59c7-a68b-3fb9f7c0be74 with scrape type 1
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 711eb300-b975-59c7-a68b-3fb9f7c0be74
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7021%252F19867021%252Fexterior_front_driver-1773924783957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7021/19867021/exterior_front_driver-1773924783957.jpg already downloaded
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7021%252F19867021%252Fexterior_rear_driver-1773924797242.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7021/19867021/exterior_rear_driver-1773924797242.jpg already downloaded
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7021%252F19867021%252Fexterior_front_passenger-1773924864299.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7021/19867021/exterior_front_passenger-1773924864299.jpg already downloaded
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7021%252F19867021%252Fexterior_rear_passenger-1773924823579.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7021/19867021/exterior_rear_passenger-1773924823579.jpg already downloaded
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7021%252F19867021%252Finterior_front_seats-1773927955968.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7021/19867021/interior_front_seats-1773927955968.jpg already downloaded
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7021%252F19867021%252Finterior_rear_seats-1773928222988.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7021/19867021/interior_rear_seats-1773928222988.jpg already downloaded
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7021%252F19867021%252Finterior_dashboard-1773928017402.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7021/19867021/interior_dashboard-1773928017402.jpg already downloaded
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7021%252F19867021%252Finstrument_cluster-1773927974637.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7021/19867021/instrument_cluster-1773927974637.jpg already downloaded
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7021%252F19867021%252Finterior_boot-1773928026777.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7021/19867021/interior_boot-1773928026777.jpg already downloaded
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7021%252F19867021%252Fdocs_service_history-1773927508291.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dead71b398c56372fce8bbfa31a624fe0%27 HTTP/1.1" 200 None
2026-03-29 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7021/19867021/docs_service_history-1773927508291.jpg?ixlib=js-3.8.0&auto=format&s=ead71b398c56372fce8bbfa31a624fe0 already downloaded
2026-03-29 20:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 711eb300-b975-59c7-a68b-3fb9f7c0be74, identifier: 19867021
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1533%252F20471533%252Fexterior_rear_passenger-1774635358669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1533/20471533/exterior_rear_passenger-1774635358669.jpg not downloaded yet
2026-03-29 20:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 711eb300-b975-59c7-a68b-3fb9f7c0be74 with identifier: 19867021
2026-03-29 20:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 711eb300-b975-59c7-a68b-3fb9f7c0be74 with identifier: 19867021
2026-03-29 20:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 711eb300-b975-59c7-a68b-3fb9f7c0be74 with identifier: 19867021 to the API
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19867021.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '711eb300-b975-59c7-a68b-3fb9f7c0be74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EJ70 XPM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19867021',
'listing': 'auction',
'location': 'Kent Ashford',
'make': 'Volkswagen',
'model': 'Up!',
'odometer': 25378,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/7021/19867021/exterior_front_driver-1773924783957.jpg',
'https://motorway-photos-redacted.imgix.net/7021/19867021/exterior_rear_driver-1773924797242.jpg',
'https://motorway-photos-redacted.imgix.net/7021/19867021/exterior_front_passenger-1773924864299.jpg',
'https://motorway-photos-redacted.imgix.net/7021/19867021/exterior_rear_passenger-1773924823579.jpg',
'https://motorway-photos-modified.imgix.net/7021/19867021/interior_front_seats-1773927955968.jpg',
'https://motorway-photos-modified.imgix.net/7021/19867021/interior_rear_seats-1773928222988.jpg',
'https://motorway-photos-modified.imgix.net/7021/19867021/interior_dashboard-1773928017402.jpg',
'https://motorway-photos-modified.imgix.net/7021/19867021/instrument_cluster-1773927974637.jpg',
'https://motorway-photos-modified.imgix.net/7021/19867021/interior_boot-1773928026777.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/7021/19867021/docs_service_history-1773927508291.jpg?ixlib=js-3.8.0&auto=format&s=ead71b398c56372fce8bbfa31a624fe0'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b111c0e0-b2f5-5193-9eb3-823b66b685cc/b111c0e0-b2f5-5193-9eb3-823b66b685cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1299638,
'Height': 1968,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7021/19867021/exterior_front_driver-1773924783957.jpg',
'Width': 2624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b111c0e0-b2f5-5193-9eb3-823b66b685cc/b111c0e0-b2f5-5193-9eb3-823b66b685cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 851534,
'Height': 1949,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7021/19867021/exterior_rear_driver-1773924797242.jpg',
'Width': 2599},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b111c0e0-b2f5-5193-9eb3-823b66b685cc/b111c0e0-b2f5-5193-9eb3-823b66b685cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1659525,
'Height': 1936,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7021/19867021/exterior_front_passenger-1773924864299.jpg',
'Width': 2581},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b111c0e0-b2f5-5193-9eb3-823b66b685cc/b111c0e0-b2f5-5193-9eb3-823b66b685cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1511983,
'Height': 1888,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7021/19867021/exterior_rear_passenger-1773924823579.jpg',
'Width': 2517},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b111c0e0-b2f5-5193-9eb3-823b66b685cc/b111c0e0-b2f5-5193-9eb3-823b66b685cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1593502,
'Height': 2018,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7021/19867021/interior_front_seats-1773927955968.jpg',
'Width': 2691},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b111c0e0-b2f5-5193-9eb3-823b66b685cc/b111c0e0-b2f5-5193-9eb3-823b66b685cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1352103,
'Height': 2100,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7021/19867021/interior_rear_seats-1773928222988.jpg',
'Width': 2800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b111c0e0-b2f5-5193-9eb3-823b66b685cc/b111c0e0-b2f5-5193-9eb3-823b66b685cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1761111,
'Height': 2231,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7021/19867021/interior_dashboard-1773928017402.jpg',
'Width': 2974},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b111c0e0-b2f5-5193-9eb3-823b66b685cc/b111c0e0-b2f5-5193-9eb3-823b66b685cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 735989,
'Height': 1480,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7021/19867021/instrument_cluster-1773927974637.jpg',
'Width': 1974},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b111c0e0-b2f5-5193-9eb3-823b66b685cc/b111c0e0-b2f5-5193-9eb3-823b66b685cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1260565,
'Height': 1631,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7021/19867021/interior_boot-1773928026777.jpg',
'Width': 2174},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b111c0e0-b2f5-5193-9eb3-823b66b685cc/b111c0e0-b2f5-5193-9eb3-823b66b685cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5043242,
'Height': 3060,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7021/19867021/docs_service_history-1773927508291.jpg?ixlib=js-3.8.0&auto=format&s=ead71b398c56372fce8bbfa31a624fe0',
'Width': 4080}],
'price': 11553,
'price_includes_vat': False,
'registration_date': '2021-01-25',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen up! GTI',
'transmission': 'manual',
'trim': 'up! GTI',
'vin': 'WVWZZZAAZMD009998',
'year': 2021}
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719867021%27 HTTP/1.1" 200 None
2026-03-29 20:03:29 [motorway.uk] INFO: Saving data for 19867021: {'created_time': 1774814609.639249, 'last_price_update_time': 1774814609.639261, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19867021') HTTP/1.1" 204 0
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1533%252F20471533%252Finterior_front_seats-1774705506313.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1533/20471533/interior_front_seats-1774705506313.jpg not downloaded yet
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1533%252F20471533%252Finterior_rear_seats-1774705635096.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1533/20471533/interior_rear_seats-1774705635096.jpg not downloaded yet
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1533%252F20471533%252Finterior_dashboard-1774705568100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1533/20471533/interior_dashboard-1774705568100.jpg not downloaded yet
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1533%252F20471533%252Finstrument_cluster-1774705599201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1533/20471533/instrument_cluster-1774705599201.jpg not downloaded yet
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1533%252F20471533%252Finterior_boot-1774705564355.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1533/20471533/interior_boot-1774705564355.jpg not downloaded yet
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1533%252F20471533%252Fdocs_service_history-1774706283876.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd00672a586d01b5a55c00127632e88ed%27 HTTP/1.1" 200 None
2026-03-29 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1533/20471533/docs_service_history-1774706283876.jpg?ixlib=js-3.8.0&auto=format&s=d00672a586d01b5a55c00127632e88ed not downloaded yet
2026-03-29 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487775.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19734644.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/5611886.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20277040.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20386196.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19950167.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6581f84b-0073-541f-b9c1-cfb9e29b1326 with identifier: 20487775
2026-03-29 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6581f84b-0073-541f-b9c1-cfb9e29b1326 with scrape type 1
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6581f84b-0073-541f-b9c1-cfb9e29b1326
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7775%252F20487775%252Fexterior_front_driver-1774711796712.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7775/20487775/exterior_front_driver-1774711796712.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7775%252F20487775%252Fexterior_rear_driver-1774711816853.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7775/20487775/exterior_rear_driver-1774711816853.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7775%252F20487775%252Fexterior_front_passenger-1774711851270.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7775/20487775/exterior_front_passenger-1774711851270.jpg not downloaded yet
2026-03-29 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c25dbd33-8723-5ccb-8d0b-9a227430a84f with identifier: 19734644
2026-03-29 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c25dbd33-8723-5ccb-8d0b-9a227430a84f with scrape type 1
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c25dbd33-8723-5ccb-8d0b-9a227430a84f
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4644%252F19734644%252F19734644-exterior_front_driver-default-1774690247525.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4644/19734644/19734644-exterior_front_driver-default-1774690247525.jpg not downloaded yet
2026-03-29 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04b180c8-b29a-5d36-aa6a-3fc7d969e532 with identifier: 5611886
2026-03-29 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04b180c8-b29a-5d36-aa6a-3fc7d969e532 with scrape type 1
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04b180c8-b29a-5d36-aa6a-3fc7d969e532
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F5611886%252Fexterior_front_driver-1774690944697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/5611886/exterior_front_driver-1774690944697.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7775%252F20487775%252Fexterior_rear_passenger-1774711834190.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7775/20487775/exterior_rear_passenger-1774711834190.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4644%252F19734644%252F19734644-exterior_rear_driver-default-1774690242698.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4644/19734644/19734644-exterior_rear_driver-default-1774690242698.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F5611886%252Fexterior_rear_driver-1774690961828.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/5611886/exterior_rear_driver-1774690961828.jpg not downloaded yet
2026-03-29 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fedbeebf-7cb0-555e-9941-3396c22a7245 with identifier: 20277040
2026-03-29 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fedbeebf-7cb0-555e-9941-3396c22a7245 with scrape type 1
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fedbeebf-7cb0-555e-9941-3396c22a7245
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7040%252F20277040%252Fexterior_front_driver-1774784254577.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7040/20277040/exterior_front_driver-1774784254577.jpg not downloaded yet
2026-03-29 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 379fc8d0-371b-56b5-b1f3-cb45d663086f with identifier: 20386196
2026-03-29 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 379fc8d0-371b-56b5-b1f3-cb45d663086f with scrape type 1
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 379fc8d0-371b-56b5-b1f3-cb45d663086f
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20386196%252Fexterior_front_driver-1774718629286.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20386196/exterior_front_driver-1774718629286.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7775%252F20487775%252Finterior_front_seats-1774712295444.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7775/20487775/interior_front_seats-1774712295444.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4644%252F19734644%252F19734644-exterior_front_passenger-default-1774690238070.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4644/19734644/19734644-exterior_front_passenger-default-1774690238070.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F5611886%252Fexterior_front_passenger-1774690989322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/5611886/exterior_front_passenger-1774690989322.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7040%252F20277040%252Fexterior_rear_driver-1774784319980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7040/20277040/exterior_rear_driver-1774784319980.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20386196%252Fexterior_rear_driver-1774718654992.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20386196/exterior_rear_driver-1774718654992.jpg not downloaded yet
2026-03-29 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 150be165-5410-507b-8452-264acda1ac8c with identifier: 19950167
2026-03-29 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 150be165-5410-507b-8452-264acda1ac8c with scrape type 1
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 150be165-5410-507b-8452-264acda1ac8c
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0167%252F19950167%252Fexterior_front_driver-1774722576507.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0167/19950167/exterior_front_driver-1774722576507.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7775%252F20487775%252Finterior_rear_seats-1774712312166.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7775/20487775/interior_rear_seats-1774712312166.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4644%252F19734644%252F19734644-exterior_rear_passenger-default-1774690240231.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4644/19734644/19734644-exterior_rear_passenger-default-1774690240231.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F5611886%252Fexterior_rear_passenger-1774690973144.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/5611886/exterior_rear_passenger-1774690973144.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7040%252F20277040%252Fexterior_front_passenger-1774784330989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7040/20277040/exterior_front_passenger-1774784330989.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20386196%252Fexterior_front_passenger-1774718682832.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20386196/exterior_front_passenger-1774718682832.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0167%252F19950167%252Fexterior_rear_driver-1774722603173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0167/19950167/exterior_rear_driver-1774722603173.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7775%252F20487775%252Finterior_dashboard-1774712433683.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7775/20487775/interior_dashboard-1774712433683.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4644%252F19734644%252F19734644-interior_front_seats-default-1774690245998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4644/19734644/19734644-interior_front_seats-default-1774690245998.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1886%252F5611886%252Finterior_front_seats-1774691480913.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1886/5611886/interior_front_seats-1774691480913.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7040%252F20277040%252Fexterior_rear_passenger-1774784338470.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7040/20277040/exterior_rear_passenger-1774784338470.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20386196%252Fexterior_rear_passenger-1774718668980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20386196/exterior_rear_passenger-1774718668980.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0167%252F19950167%252Fexterior_front_passenger-1774722636213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0167/19950167/exterior_front_passenger-1774722636213.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7775%252F20487775%252Finstrument_cluster-1774712383650.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7775/20487775/instrument_cluster-1774712383650.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4644%252F19734644%252F19734644-interior_rear_seats-default-1774690244413.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4644/19734644/19734644-interior_rear_seats-default-1774690244413.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1886%252F5611886%252Finterior_rear_seats-1774691432653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1886/5611886/interior_rear_seats-1774691432653.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7040%252F20277040%252Finterior_front_seats-1774784806406.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7040/20277040/interior_front_seats-1774784806406.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6196%252F20386196%252Finterior_front_seats-1774720059652.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6196/20386196/interior_front_seats-1774720059652.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0167%252F19950167%252Fexterior_rear_passenger-1774722617213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0167/19950167/exterior_rear_passenger-1774722617213.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7775%252F20487775%252Finterior_boot-1774712362669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7775/20487775/interior_boot-1774712362669.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4644%252F19734644%252F19734644-interior_dashboard-default-1774693351051.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4644/19734644/19734644-interior_dashboard-default-1774693351051.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F5611886%252Finterior_dashboard-1774691392908.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/5611886/interior_dashboard-1774691392908.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7040%252F20277040%252Finterior_rear_seats-1774784824137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7040/20277040/interior_rear_seats-1774784824137.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6196%252F20386196%252Finterior_rear_seats-1774720274725.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6196/20386196/interior_rear_seats-1774720274725.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0167%252F19950167%252Finterior_front_seats-1774722925863.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0167/19950167/interior_front_seats-1774722925863.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7775%252F20487775%252Fwheels_front_driver-1774711893979.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7775/20487775/wheels_front_driver-1774711893979.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4644%252F19734644%252F19734644-instrument_cluster-default-1774690393227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4644/19734644/19734644-instrument_cluster-default-1774690393227.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1886%252F5611886%252Finstrument_cluster-1774691637376.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1886/5611886/instrument_cluster-1774691637376.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7040%252F20277040%252Finterior_dashboard-1774784857850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7040/20277040/interior_dashboard-1774784857850.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20386196%252Finterior_dashboard-1774720130302.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20386196/interior_dashboard-1774720130302.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0167%252F19950167%252Finterior_rear_seats-1774722947267.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0167/19950167/interior_rear_seats-1774722947267.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4644%252F19734644%252F19734644-interior_boot-default-1774693340269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4644/19734644/19734644-interior_boot-default-1774693340269.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1886%252F5611886%252Finterior_boot-1774691355301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1886/5611886/interior_boot-1774691355301.jpg not downloaded yet
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7040%252F20277040%252Finstrument_cluster-1774784914307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7040/20277040/instrument_cluster-1774784914307.jpg not downloaded yet
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20386196%252Finstrument_cluster-1774720159279.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20386196/instrument_cluster-1774720159279.jpg not downloaded yet
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0167%252F19950167%252Finterior_dashboard-1774788701966.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0167/19950167/interior_dashboard-1774788701966.jpg not downloaded yet
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F4644%252F19734644%252Fdocs_service_history-1771525386114.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df7656384415997cac46d3f7cffe619d3%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/4644/19734644/docs_service_history-1771525386114.jpeg?ixlib=js-3.8.0&auto=format&s=f7656384415997cac46d3f7cffe619d3 already downloaded
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1886%252F5611886%252Fdocs_service_history-1774691719394.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D881bba8e7c514e93d8808356e9780dad%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1886/5611886/docs_service_history-1774691719394.jpg?ixlib=js-3.8.0&auto=format&s=881bba8e7c514e93d8808356e9780dad not downloaded yet
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7040%252F20277040%252Finterior_boot-1774784878165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7040/20277040/interior_boot-1774784878165.jpg not downloaded yet
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6196%252F20386196%252Finterior_boot-1774720157808.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6196/20386196/interior_boot-1774720157808.jpg not downloaded yet
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0167%252F19950167%252Finstrument_cluster-1774723030997.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0167/19950167/instrument_cluster-1774723030997.jpg not downloaded yet
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7040%252F20277040%252Fdamage_scratches-1773589872378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7040/20277040/damage_scratches-1773589872378.jpg not downloaded yet
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6196%252F20386196%252Fdocs_service_history-1774720440546.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3b26453b0529873a98e5aacb44fed1af%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6196/20386196/docs_service_history-1774720440546.jpg?ixlib=js-3.8.0&auto=format&s=3b26453b0529873a98e5aacb44fed1af not downloaded yet
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0167%252F19950167%252Finterior_boot-1774723000945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0167/19950167/interior_boot-1774723000945.jpg not downloaded yet
2026-03-29 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=576&page=16&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0167%252F19950167%252Fdamage_scratches-1774788608021.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0167/19950167/damage_scratches-1774788608021.jpg not downloaded yet
2026-03-29 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1533/20471533/docs_service_history-1774706283876.jpg?ixlib=js-3.8.0&auto=format&s=d00672a586d01b5a55c00127632e88ed> (referer: None)
2026-03-29 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1533/20471533/instrument_cluster-1774705599201.jpg> (referer: None)
2026-03-29 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1533/20471533/interior_dashboard-1774705568100.jpg> (referer: None)
2026-03-29 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1533/20471533/interior_boot-1774705564355.jpg> (referer: None)
2026-03-29 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1533/20471533/interior_rear_seats-1774705635096.jpg> (referer: None)
2026-03-29 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1533/20471533/interior_front_seats-1774705506313.jpg> (referer: None)
2026-03-29 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18730909.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 19821442
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 14648195
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714648195%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [motorway.uk] INFO: Scrape type for 14648195: 1
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 20442579
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 19708166
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 20460964
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 20264228
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 15594477
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715594477%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [motorway.uk] INFO: Scrape type for 15594477: 1
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 20307515
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 20481960
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 15910710
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 19313899
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719313899%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [motorway.uk] INFO: Scrape type for 19313899: 2
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93b69d0>
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7346aec-88c5-51e4-a8cd-59b6be69944e/e7346aec-88c5-51e4-a8cd-59b6be69944e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1533%252F20471533%252Fdocs_service_history-1774706283876.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd00672a586d01b5a55c00127632e88ed') HTTP/1.1" 204 0
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1533/20471533/docs_service_history-1774706283876.jpg?ixlib=js-3.8.0&auto=format&s=d00672a586d01b5a55c00127632e88ed saved to cache
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7346aec-88c5-51e4-a8cd-59b6be69944e
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 20338223
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 18332731
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 20355749
2026-03-29 20:03:31 [motorway.uk] INFO: Found listing with ID: 10308764
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710308764%27 HTTP/1.1" 200 None
2026-03-29 20:03:31 [motorway.uk] INFO: Scrape type for 10308764: 1
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa155a50>
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7346aec-88c5-51e4-a8cd-59b6be69944e/e7346aec-88c5-51e4-a8cd-59b6be69944e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1533%252F20471533%252Finstrument_cluster-1774705599201.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1533/20471533/instrument_cluster-1774705599201.jpg saved to cache
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7346aec-88c5-51e4-a8cd-59b6be69944e
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9075dd0>
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7346aec-88c5-51e4-a8cd-59b6be69944e/e7346aec-88c5-51e4-a8cd-59b6be69944e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1533%252F20471533%252Finterior_dashboard-1774705568100.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1533/20471533/interior_dashboard-1774705568100.jpg saved to cache
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7346aec-88c5-51e4-a8cd-59b6be69944e
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f960c850>
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7346aec-88c5-51e4-a8cd-59b6be69944e/e7346aec-88c5-51e4-a8cd-59b6be69944e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1533%252F20471533%252Finterior_boot-1774705564355.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1533/20471533/interior_boot-1774705564355.jpg saved to cache
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7346aec-88c5-51e4-a8cd-59b6be69944e
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81cd110>
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7346aec-88c5-51e4-a8cd-59b6be69944e/e7346aec-88c5-51e4-a8cd-59b6be69944e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1533%252F20471533%252Finterior_rear_seats-1774705635096.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1533/20471533/interior_rear_seats-1774705635096.jpg saved to cache
2026-03-29 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7346aec-88c5-51e4-a8cd-59b6be69944e
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d2b50>
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7346aec-88c5-51e4-a8cd-59b6be69944e/e7346aec-88c5-51e4-a8cd-59b6be69944e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1533%252F20471533%252Finterior_front_seats-1774705506313.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1533/20471533/interior_front_seats-1774705506313.jpg saved to cache
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7346aec-88c5-51e4-a8cd-59b6be69944e
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 20467839
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 17807552
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717807552%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [motorway.uk] INFO: Scrape type for 17807552: 1
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 20191585
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720191585%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [motorway.uk] INFO: Scrape type for 20191585: 1
2026-03-29 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19791860.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a08be9f3-0cbb-5cb1-823c-d195ebdb2728 with identifier: 18730909
2026-03-29 20:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728 with scrape type 1
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0909%252F18730909%252Fexterior_front_driver-1774692839507.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0909/18730909/exterior_front_driver-1774692839507.jpg not downloaded yet
2026-03-29 20:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 20484266
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 18989112
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 20444774
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 13523395
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 18011097
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 5866923
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275866923%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [motorway.uk] INFO: Scrape type for 5866923: 1
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0909%252F18730909%252Fexterior_rear_driver-1774787225532.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0909/18730909/exterior_rear_driver-1774787225532.jpg not downloaded yet
2026-03-29 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6196/20386196/docs_service_history-1774720440546.jpg?ixlib=js-3.8.0&auto=format&s=3b26453b0529873a98e5aacb44fed1af> (referer: None)
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 20468575
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 11768479
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 14717398
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 20455953
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 20240624
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720240624%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [motorway.uk] INFO: Scrape type for 20240624: 1
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0909%252F18730909%252Fexterior_front_passenger-1774692991214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0909/18730909/exterior_front_passenger-1774692991214.jpg not downloaded yet
2026-03-29 20:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae529704-a64c-54a1-af67-f9d028d3c0a0 with identifier: 19791860
2026-03-29 20:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae529704-a64c-54a1-af67-f9d028d3c0a0 with scrape type 1
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae529704-a64c-54a1-af67-f9d028d3c0a0
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1860%252F19791860%252Fexterior_front_driver-1774783279022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_front_driver-1774783279022.jpg not downloaded yet
2026-03-29 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0167/19950167/damage_scratches-1774788608021.jpg> (referer: None)
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 18507220
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718507220%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [motorway.uk] INFO: Scrape type for 18507220: 1
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0909%252F18730909%252Fexterior_rear_passenger-1774692978909.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0909/18730909/exterior_rear_passenger-1774692978909.jpg not downloaded yet
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1860%252F19791860%252Fexterior_rear_driver-1774783274326.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_rear_driver-1774783274326.jpg not downloaded yet
2026-03-29 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15315241.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20222166.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 17656743
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 20131585
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720131585%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [motorway.uk] INFO: Scrape type for 20131585: 1
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0909%252F18730909%252Finterior_front_seats-1774694313270.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0909/18730909/interior_front_seats-1774694313270.jpg not downloaded yet
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1860%252F19791860%252Fexterior_front_passenger-1774783280293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_front_passenger-1774783280293.jpg not downloaded yet
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 20444590
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 20396560
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720396560%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [motorway.uk] INFO: Scrape type for 20396560: 1
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0909%252F18730909%252Finterior_rear_seats-1774694038325.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0909/18730909/interior_rear_seats-1774694038325.jpg not downloaded yet
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1860%252F19791860%252Fexterior_rear_passenger-1774783281377.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_rear_passenger-1774783281377.jpg not downloaded yet
2026-03-29 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93b6190>
2026-03-29 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_379fc8d0-371b-56b5-b1f3-cb45d663086f/379fc8d0-371b-56b5-b1f3-cb45d663086f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6196%252F20386196%252Fdocs_service_history-1774720440546.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3b26453b0529873a98e5aacb44fed1af') HTTP/1.1" 204 0
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6196/20386196/docs_service_history-1774720440546.jpg?ixlib=js-3.8.0&auto=format&s=3b26453b0529873a98e5aacb44fed1af saved to cache
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 379fc8d0-371b-56b5-b1f3-cb45d663086f
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 20484632
2026-03-29 20:03:32 [motorway.uk] INFO: Found listing with ID: 2939803
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0909%252F18730909%252Finterior_dashboard-1774787243624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0909/18730909/interior_dashboard-1774787243624.jpg not downloaded yet
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1860%252F19791860%252Finterior_front_seats-1774783858635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1860/19791860/interior_front_seats-1774783858635.jpg not downloaded yet
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0909%252F18730909%252Finstrument_cluster-1774694046874.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0909/18730909/instrument_cluster-1774694046874.jpg not downloaded yet
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1860%252F19791860%252Finterior_rear_seats-1774783861953.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1860/19791860/interior_rear_seats-1774783861953.jpg not downloaded yet
2026-03-29 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9844685.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8217410>
2026-03-29 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150be165-5410-507b-8452-264acda1ac8c/150be165-5410-507b-8452-264acda1ac8c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0167%252F19950167%252Fdamage_scratches-1774788608021.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0167/19950167/damage_scratches-1774788608021.jpg saved to cache
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 150be165-5410-507b-8452-264acda1ac8c
2026-03-29 20:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d28d8a5-0141-5a1a-bce1-c414602484a4 with identifier: 15315241
2026-03-29 20:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d28d8a5-0141-5a1a-bce1-c414602484a4 with scrape type 1
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d28d8a5-0141-5a1a-bce1-c414602484a4
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5241%252F15315241%252Fexterior_front_driver-1774007210989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_front_driver-1774007210989.jpg not downloaded yet
2026-03-29 20:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2823e5c5-2f56-54a2-90ee-00b13f8b1707 with identifier: 20222166
2026-03-29 20:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707 with scrape type 1
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F20222166%252Fexterior_front_driver-1774711446816.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_front_driver-1774711446816.jpg not downloaded yet
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0909%252F18730909%252Finterior_boot-1774694153761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0909/18730909/interior_boot-1774694153761.jpg not downloaded yet
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1860%252F19791860%252Finterior_dashboard-1774783863983.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1860/19791860/interior_dashboard-1774783863983.jpg not downloaded yet
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5241%252F15315241%252Fexterior_rear_driver-1774007227082.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_rear_driver-1774007227082.jpg not downloaded yet
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F20222166%252Fexterior_rear_driver-1774711435336.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_rear_driver-1774711435336.jpg not downloaded yet
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0909%252F18730909%252Fdocs_service_history-1774782593670.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dff0a708f95dbb9923058f867a4849849%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0909/18730909/docs_service_history-1774782593670.jpg?ixlib=js-3.8.0&auto=format&s=ff0a708f95dbb9923058f867a4849849 not downloaded yet
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1860%252F19791860%252Finstrument_cluster-1774786181311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1860/19791860/instrument_cluster-1774786181311.jpg not downloaded yet
2026-03-29 20:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d02be44-e090-54c1-a195-bcc99f9d935d with identifier: 9844685
2026-03-29 20:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d02be44-e090-54c1-a195-bcc99f9d935d with scrape type 1
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d02be44-e090-54c1-a195-bcc99f9d935d
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4685%252F9844685%252F9844685-exterior_front_driver-default-1774702829820.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_front_driver-default-1774702829820.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5241%252F15315241%252Fexterior_front_passenger-1774007253510.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_front_passenger-1774007253510.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F20222166%252Fexterior_front_passenger-1774711393340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_front_passenger-1774711393340.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1860%252F19791860%252Finterior_boot-1774783856040.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1860/19791860/interior_boot-1774783856040.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4685%252F9844685%252F9844685-exterior_rear_driver-default-1774702870562.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_rear_driver-default-1774702870562.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5241%252F15315241%252Fexterior_rear_passenger-1774007237403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_rear_passenger-1774007237403.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F20222166%252Fexterior_rear_passenger-1774711413919.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_rear_passenger-1774711413919.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1860%252F19791860%252Fdocs_service_history-1774784442630.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1f654dedfec30f1b11816c06cca608d7%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1860/19791860/docs_service_history-1774784442630.jpg?ixlib=js-3.8.0&auto=format&s=1f654dedfec30f1b11816c06cca608d7 not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4685%252F9844685%252F9844685-exterior_front_passenger-default-1774702838452.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_front_passenger-default-1774702838452.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5241%252F15315241%252Finterior_front_seats-1774007561431.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5241/15315241/interior_front_seats-1774007561431.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2166%252F20222166%252Finterior_front_seats-1774712284163.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2166/20222166/interior_front_seats-1774712284163.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4685%252F9844685%252F9844685-exterior_rear_passenger-default-1774702836345.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_rear_passenger-default-1774702836345.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5241%252F15315241%252Finterior_rear_seats-1774007576833.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5241/15315241/interior_rear_seats-1774007576833.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2166%252F20222166%252Finterior_rear_seats-1774712322424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2166/20222166/interior_rear_seats-1774712322424.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4685%252F9844685%252F9844685-interior_front_seats-default-1774265155955.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4685/9844685/9844685-interior_front_seats-default-1774265155955.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5241%252F15315241%252Finterior_dashboard-1774007614906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5241/15315241/interior_dashboard-1774007614906.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F20222166%252Finterior_dashboard-1774712360937.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/20222166/interior_dashboard-1774712360937.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4685%252F9844685%252F9844685-interior_rear_seats-default-1774265173801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4685/9844685/9844685-interior_rear_seats-default-1774265173801.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5241%252F15315241%252Finstrument_cluster-1774007661598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5241/15315241/instrument_cluster-1774007661598.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F20222166%252Finstrument_cluster-1774712338574.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/20222166/instrument_cluster-1774712338574.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4685%252F9844685%252F9844685-interior_dashboard-default-1774265195251.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-interior_dashboard-default-1774265195251.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5241%252F15315241%252Finterior_boot-1774705006431.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5241/15315241/interior_boot-1774705006431.jpg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2166%252F20222166%252Finterior_boot-1774712365152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2166/20222166/interior_boot-1774712365152.jpg not downloaded yet
2026-03-29 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_front_driver-1774783279022.jpg> (referer: None)
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4685%252F9844685%252F9844685-interior_boot-modified-1774436651633.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4685/9844685/9844685-interior_boot-modified-1774436651633.jpeg not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5241%252F15315241%252Fdocs_service_history-1774008164603.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc01c98a8cc3dfa10d4221a43bfb9c6a2%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5241/15315241/docs_service_history-1774008164603.jpg?ixlib=js-3.8.0&auto=format&s=c01c98a8cc3dfa10d4221a43bfb9c6a2 not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2166%252F20222166%252Fdocs_service_history-1774712765702.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D73950ba8027ef9cd29e9228ae5c21105%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2166/20222166/docs_service_history-1774712765702.jpg?ixlib=js-3.8.0&auto=format&s=73950ba8027ef9cd29e9228ae5c21105 not downloaded yet
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4685%252F9844685%252F9844685-docs_service_history-modified-1761061396849.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da29473d878352f835435cd2cbc5cca0e%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4685/9844685/9844685-docs_service_history-modified-1761061396849.jpeg?ixlib=js-3.8.0&auto=format&s=a29473d878352f835435cd2cbc5cca0e not downloaded yet
2026-03-29 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0909/18730909/exterior_front_passenger-1774692991214.jpg> (referer: None)
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4685%252F9844685%252F9844685-docs_service_history-default-1774373090182.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3f0d5794719abebf47965d5c1c6deecc%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4685/9844685/9844685-docs_service_history-default-1774373090182.jpeg?ixlib=js-3.8.0&auto=format&s=3f0d5794719abebf47965d5c1c6deecc not downloaded yet
2026-03-29 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0167/19950167/interior_boot-1774723000945.jpg> (referer: None)
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadc2ad0>
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1860%252F19791860%252Fexterior_front_driver-1774783279022.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_front_driver-1774783279022.jpg saved to cache
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae529704-a64c-54a1-af67-f9d028d3c0a0
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0184d0>
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0909%252F18730909%252Fexterior_front_passenger-1774692991214.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0909/18730909/exterior_front_passenger-1774692991214.jpg saved to cache
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728
2026-03-29 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20398514.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0909/18730909/exterior_rear_driver-1774787225532.jpg> (referer: None)
2026-03-29 20:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8151650>
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150be165-5410-507b-8452-264acda1ac8c/150be165-5410-507b-8452-264acda1ac8c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0167%252F19950167%252Finterior_boot-1774723000945.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0167/19950167/interior_boot-1774723000945.jpg saved to cache
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 150be165-5410-507b-8452-264acda1ac8c
2026-03-29 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7040/20277040/damage_scratches-1773589872378.jpg> (referer: None)
2026-03-29 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1860/19791860/interior_front_seats-1774783858635.jpg> (referer: None)
2026-03-29 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19897967.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0 with identifier: 20398514
2026-03-29 20:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0 with scrape type 1
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8514%252F20398514%252Fexterior_front_driver-1774708309861.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_front_driver-1774708309861.jpg not downloaded yet
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a3f8d0>
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0909%252F18730909%252Fexterior_rear_driver-1774787225532.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0909/18730909/exterior_rear_driver-1774787225532.jpg saved to cache
2026-03-29 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8514%252F20398514%252Fexterior_rear_driver-1774710479004.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_rear_driver-1774710479004.jpg not downloaded yet
2026-03-29 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4685/9844685/9844685-docs_service_history-modified-1761061396849.jpeg?ixlib=js-3.8.0&auto=format&s=a29473d878352f835435cd2cbc5cca0e> (referer: None)
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8514%252F20398514%252Fexterior_front_passenger-1774708373901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_front_passenger-1774708373901.jpg not downloaded yet
2026-03-29 20:03:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae9cc90>
2026-03-29 20:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fedbeebf-7cb0-555e-9941-3396c22a7245/fedbeebf-7cb0-555e-9941-3396c22a7245_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7040%252F20277040%252Fdamage_scratches-1773589872378.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7040/20277040/damage_scratches-1773589872378.jpg saved to cache
2026-03-29 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fedbeebf-7cb0-555e-9941-3396c22a7245
2026-03-29 20:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa2e790>
2026-03-29 20:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1860%252F19791860%252Finterior_front_seats-1774783858635.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1860/19791860/interior_front_seats-1774783858635.jpg saved to cache
2026-03-29 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae529704-a64c-54a1-af67-f9d028d3c0a0
2026-03-29 20:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97717bca-7f70-5659-9ee1-3939b4cb6a23 with identifier: 19897967
2026-03-29 20:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97717bca-7f70-5659-9ee1-3939b4cb6a23 with scrape type 2
2026-03-29 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97717bca-7f70-5659-9ee1-3939b4cb6a23 with scrape type 2
2026-03-29 20:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 97717bca-7f70-5659-9ee1-3939b4cb6a23, identifier: 19897967
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8514%252F20398514%252Fexterior_rear_passenger-1774708356181.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_rear_passenger-1774708356181.jpg not downloaded yet
2026-03-29 20:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 97717bca-7f70-5659-9ee1-3939b4cb6a23 with identifier: 19897967
2026-03-29 20:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 97717bca-7f70-5659-9ee1-3939b4cb6a23 with identifier: 19897967
2026-03-29 20:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 97717bca-7f70-5659-9ee1-3939b4cb6a23 with identifier: 19897967 to the API
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19897967.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '97717bca-7f70-5659-9ee1-3939b4cb6a23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HO03 EMH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19897967',
'listing': 'auction',
'location': 'Warwickshire Warwick',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 63169,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 14100,
'price_includes_vat': False,
'registration_date': '2019-09-24',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 220 AMG Line Premium + Auto',
'transmission': 'automatic',
'trim': 'A 220 AMG Line Premium + Auto',
'vin': 'WDD1770442J129575',
'year': 2019}
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719897967%27 HTTP/1.1" 200 None
2026-03-29 20:03:35 [motorway.uk] INFO: Saving data for 19897967: {'auction_closing_time': 1774884600.0, 'created_time': 1774468918.724453, 'last_price_update_time': 1774814615.058249}
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19897967') HTTP/1.1" 204 0
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8514%252F20398514%252Finterior_front_seats-1774708940780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8514/20398514/interior_front_seats-1774708940780.jpg not downloaded yet
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa162810>
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4685%252F9844685%252F9844685-docs_service_history-modified-1761061396849.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da29473d878352f835435cd2cbc5cca0e') HTTP/1.1" 204 0
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4685/9844685/9844685-docs_service_history-modified-1761061396849.jpeg?ixlib=js-3.8.0&auto=format&s=a29473d878352f835435cd2cbc5cca0e saved to cache
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d02be44-e090-54c1-a195-bcc99f9d935d
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8514%252F20398514%252Finterior_rear_seats-1774708954457.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8514/20398514/interior_rear_seats-1774708954457.jpg not downloaded yet
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8514%252F20398514%252Finterior_dashboard-1774710585209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8514/20398514/interior_dashboard-1774710585209.jpg not downloaded yet
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8514%252F20398514%252Finterior_boot-1774709113407.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8514/20398514/interior_boot-1774709113407.jpg not downloaded yet
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8514%252F20398514%252Fdamage_missing_trims-1774710238539.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8514/20398514/damage_missing_trims-1774710238539.jpg not downloaded yet
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8514%252F20398514%252Fwheels_front_driver-1774708497622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8514/20398514/wheels_front_driver-1774708497622.jpg not downloaded yet
2026-03-29 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4685/9844685/9844685-docs_service_history-default-1774373090182.jpeg?ixlib=js-3.8.0&auto=format&s=3f0d5794719abebf47965d5c1c6deecc> (referer: None)
2026-03-29 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_front_driver-1774708309861.jpg> (referer: None)
2026-03-29 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2166/20222166/interior_boot-1774712365152.jpg> (referer: None)
2026-03-29 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20474874.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2166/20222166/docs_service_history-1774712765702.jpg?ixlib=js-3.8.0&auto=format&s=73950ba8027ef9cd29e9228ae5c21105> (referer: None)
2026-03-29 20:03:35 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:03:35 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:03:35 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x001\xa1\x88\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\n\x0b\xa0\x001~\x93\x00\x00\x00\x00'
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94aaf90>
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4685%252F9844685%252F9844685-docs_service_history-default-1774373090182.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3f0d5794719abebf47965d5c1c6deecc') HTTP/1.1" 204 0
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4685/9844685/9844685-docs_service_history-default-1774373090182.jpeg?ixlib=js-3.8.0&auto=format&s=3f0d5794719abebf47965d5c1c6deecc saved to cache
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d02be44-e090-54c1-a195-bcc99f9d935d
2026-03-29 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17807552.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15594477.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94aa290>
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8514%252F20398514%252Fexterior_front_driver-1774708309861.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_front_driver-1774708309861.jpg saved to cache
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0
2026-03-29 20:03:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabd0bd0>
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2166%252F20222166%252Finterior_boot-1774712365152.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2166/20222166/interior_boot-1774712365152.jpg saved to cache
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707
2026-03-29 20:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d9da3f2-8a63-5151-bbc4-931eff213516 with identifier: 20474874
2026-03-29 20:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d9da3f2-8a63-5151-bbc4-931eff213516 with scrape type 1
2026-03-29 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d9da3f2-8a63-5151-bbc4-931eff213516
2026-03-29 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4874%252F20474874%252Fexterior_front_driver-1774709346026.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_front_driver-1774709346026.jpg not downloaded yet
2026-03-29 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac87a50>
2026-03-29 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2166%252F20222166%252Fdocs_service_history-1774712765702.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D73950ba8027ef9cd29e9228ae5c21105') HTTP/1.1" 204 0
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2166/20222166/docs_service_history-1774712765702.jpg?ixlib=js-3.8.0&auto=format&s=73950ba8027ef9cd29e9228ae5c21105 saved to cache
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707
2026-03-29 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5241/15315241/docs_service_history-1774008164603.jpg?ixlib=js-3.8.0&auto=format&s=c01c98a8cc3dfa10d4221a43bfb9c6a2> (referer: None)
2026-03-29 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8514/20398514/damage_missing_trims-1774710238539.jpg> (referer: None)
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4874%252F20474874%252Fexterior_rear_driver-1774709163322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_rear_driver-1774709163322.jpg not downloaded yet
2026-03-29 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19313899.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4874%252F20474874%252Fexterior_front_passenger-1774709195740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_front_passenger-1774709195740.jpg not downloaded yet
2026-03-29 20:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e06208a4-e7d9-52b1-8557-894c14a7a6e9 with identifier: 17807552
2026-03-29 20:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e06208a4-e7d9-52b1-8557-894c14a7a6e9 with scrape type 1
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e06208a4-e7d9-52b1-8557-894c14a7a6e9
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7552%252F17807552%252Fexterior_front_driver-1774534389365.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_front_driver-1774534389365.jpg not downloaded yet
2026-03-29 20:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79e0f293-bfd1-5609-afff-d811d01d8883 with identifier: 15594477
2026-03-29 20:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79e0f293-bfd1-5609-afff-d811d01d8883 with scrape type 1
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79e0f293-bfd1-5609-afff-d811d01d8883
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4477%252F15594477%252Fexterior_front_driver-1774689999384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_front_driver-1774689999384.jpg not downloaded yet
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4874%252F20474874%252Fexterior_rear_passenger-1774709180400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_rear_passenger-1774709180400.jpg not downloaded yet
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7552%252F17807552%252Fexterior_rear_driver-1774534412637.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_rear_driver-1774534412637.jpg not downloaded yet
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4477%252F15594477%252Fexterior_rear_driver-1774690180061.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_rear_driver-1774690180061.jpg not downloaded yet
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4874%252F20474874%252Finterior_front_seats-1774714038480.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4874/20474874/interior_front_seats-1774714038480.jpg not downloaded yet
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7552%252F17807552%252Fexterior_front_passenger-1774534441422.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_front_passenger-1774534441422.jpg not downloaded yet
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4477%252F15594477%252Fexterior_front_passenger-1774690063306.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_front_passenger-1774690063306.jpg not downloaded yet
2026-03-29 20:03:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae3d250>
2026-03-29 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5241%252F15315241%252Fdocs_service_history-1774008164603.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc01c98a8cc3dfa10d4221a43bfb9c6a2') HTTP/1.1" 204 0
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5241/15315241/docs_service_history-1774008164603.jpg?ixlib=js-3.8.0&auto=format&s=c01c98a8cc3dfa10d4221a43bfb9c6a2 saved to cache
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d28d8a5-0141-5a1a-bce1-c414602484a4
2026-03-29 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82377d0>
2026-03-29 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8514%252F20398514%252Fdamage_missing_trims-1774710238539.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8514/20398514/damage_missing_trims-1774710238539.jpg saved to cache
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0
2026-03-29 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8514/20398514/wheels_front_driver-1774708497622.jpg> (referer: None)
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4874%252F20474874%252Finterior_rear_seats-1774710223852.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4874/20474874/interior_rear_seats-1774710223852.jpg not downloaded yet
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7552%252F17807552%252Fexterior_rear_passenger-1774534424391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_rear_passenger-1774534424391.jpg not downloaded yet
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4477%252F15594477%252Fexterior_rear_passenger-1774690118471.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_rear_passenger-1774690118471.jpg not downloaded yet
2026-03-29 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10308764.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59dcc8e9-234b-5b67-b30f-dff38acbac63 with identifier: 19313899
2026-03-29 20:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59dcc8e9-234b-5b67-b30f-dff38acbac63 with scrape type 2
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59dcc8e9-234b-5b67-b30f-dff38acbac63 with scrape type 2
2026-03-29 20:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 59dcc8e9-234b-5b67-b30f-dff38acbac63, identifier: 19313899
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4874%252F20474874%252Finterior_dashboard-1774710449371.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4874/20474874/interior_dashboard-1774710449371.jpg not downloaded yet
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7552%252F17807552%252Finterior_front_seats-1774535076604.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7552/17807552/interior_front_seats-1774535076604.jpg not downloaded yet
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4477%252F15594477%252Finterior_front_seats-1774690261650.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4477/15594477/interior_front_seats-1774690261650.jpg not downloaded yet
2026-03-29 20:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 59dcc8e9-234b-5b67-b30f-dff38acbac63 with identifier: 19313899
2026-03-29 20:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 59dcc8e9-234b-5b67-b30f-dff38acbac63 with identifier: 19313899
2026-03-29 20:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 59dcc8e9-234b-5b67-b30f-dff38acbac63 with identifier: 19313899 to the API
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19313899.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '59dcc8e9-234b-5b67-b30f-dff38acbac63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CY16 GBE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19313899',
'listing': 'auction',
'location': 'West Midlands Solihull',
'make': 'Audi',
'model': 'A1',
'odometer': 71011,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 5100,
'price_includes_vat': False,
'registration_date': '2016-06-08',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 Sport TDI',
'transmission': 'manual',
'trim': 'Sport TDI',
'vin': 'WAUZZZ8X3GB087648',
'year': 2016}
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719313899%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [motorway.uk] INFO: Saving data for 19313899: {'auction_closing_time': 1774884600.0, 'created_time': 1774641894.610984, 'last_price_update_time': 1774814617.067695}
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19313899') HTTP/1.1" 204 0
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4874%252F20474874%252Finterior_boot-1774710151703.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4874/20474874/interior_boot-1774710151703.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7552%252F17807552%252Finterior_dashboard-1774694926098.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7552/17807552/interior_dashboard-1774694926098.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4477%252F15594477%252Finterior_dashboard-1774690375368.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4477/15594477/interior_dashboard-1774690375368.jpg not downloaded yet
2026-03-29 20:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8458d50>
2026-03-29 20:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8514%252F20398514%252Fwheels_front_driver-1774708497622.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8514/20398514/wheels_front_driver-1774708497622.jpg saved to cache
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0
2026-03-29 20:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 938c589c-d74c-5c72-a454-f043b49e835a with identifier: 10308764
2026-03-29 20:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 938c589c-d74c-5c72-a454-f043b49e835a with scrape type 1
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 938c589c-d74c-5c72-a454-f043b49e835a
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8764%252F10308764%252Fexterior_front_driver-1774697707597.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_front_driver-1774697707597.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4874%252F20474874%252Fdamage_scratches-1774709421849.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4874/20474874/damage_scratches-1774709421849.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7552%252F17807552%252Finterior_boot-1774694944868.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7552/17807552/interior_boot-1774694944868.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4477%252F15594477%252Finterior_boot-1774690368398.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4477/15594477/interior_boot-1774690368398.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8764%252F10308764%252Fexterior_rear_driver-1774697764606.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_rear_driver-1774697764606.jpg not downloaded yet
2026-03-29 20:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20240624.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4874%252F20474874%252Fdamage_scratches-1774709509786.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4874/20474874/damage_scratches-1774709509786.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7552%252F17807552%252Fdocs_service_history-1774603654005.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D67a1f407491242a55f96191534190375%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7552/17807552/docs_service_history-1774603654005.jpg?ixlib=js-3.8.0&auto=format&s=67a1f407491242a55f96191534190375 not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4477%252F15594477%252Fdamage_scratches-1774690864857.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4477/15594477/damage_scratches-1774690864857.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8764%252F10308764%252Fexterior_front_passenger-1774697720316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_front_passenger-1774697720316.jpg not downloaded yet
2026-03-29 20:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14648195.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4685/9844685/9844685-interior_boot-modified-1774436651633.jpeg> (referer: None)
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7552%252F17807552%252Fdocs_service_history-1774603723204.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D748b53edad1378615414280256077836%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7552/17807552/docs_service_history-1774603723204.jpg?ixlib=js-3.8.0&auto=format&s=748b53edad1378615414280256077836 not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4477%252F15594477%252Fdamage_scratches-1774690942253.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4477/15594477/damage_scratches-1774690942253.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8764%252F10308764%252Fexterior_rear_passenger-1774697740181.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_rear_passenger-1774697740181.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7552%252F17807552%252Fdocs_service_history-1774603808927.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8adfbe885ec4e0f50887d83c44b08122%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7552/17807552/docs_service_history-1774603808927.jpg?ixlib=js-3.8.0&auto=format&s=8adfbe885ec4e0f50887d83c44b08122 not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4477%252F15594477%252Fdamage_scratches-1774690992678.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4477/15594477/damage_scratches-1774690992678.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8764%252F10308764%252Finterior_front_seats-1774697819525.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8764/10308764/interior_front_seats-1774697819525.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8764%252F10308764%252Finterior_rear_seats-1774698050654.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8764/10308764/interior_rear_seats-1774698050654.jpg not downloaded yet
2026-03-29 20:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eff66749-e035-525f-a1bb-751c51e56a88 with identifier: 20240624
2026-03-29 20:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eff66749-e035-525f-a1bb-751c51e56a88 with scrape type 1
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eff66749-e035-525f-a1bb-751c51e56a88
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0624%252F20240624%252Fexterior_front_driver-1774711255281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0624/20240624/exterior_front_driver-1774711255281.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8764%252F10308764%252Finterior_dashboard-1774698097612.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8764/10308764/interior_dashboard-1774698097612.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0624%252F20240624%252Fexterior_rear_driver-1774711296315.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0624/20240624/exterior_rear_driver-1774711296315.jpg not downloaded yet
2026-03-29 20:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb50701d-6973-5fed-abfd-fc55722f17f6 with identifier: 14648195
2026-03-29 20:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb50701d-6973-5fed-abfd-fc55722f17f6 with scrape type 1
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb50701d-6973-5fed-abfd-fc55722f17f6
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8195%252F14648195%252Fexterior_front_driver-1774606556902.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8195/14648195/exterior_front_driver-1774606556902.jpeg not downloaded yet
2026-03-29 20:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa169790>
2026-03-29 20:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4685%252F9844685%252F9844685-interior_boot-modified-1774436651633.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4685/9844685/9844685-interior_boot-modified-1774436651633.jpeg saved to cache
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d02be44-e090-54c1-a195-bcc99f9d935d
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8764%252F10308764%252Finstrument_cluster-1774697978153.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8764/10308764/instrument_cluster-1774697978153.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0624%252F20240624%252Fexterior_front_passenger-1773491013160.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0624/20240624/exterior_front_passenger-1773491013160.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8195%252F14648195%252F14648195-exterior_rear_driver-modified-1774777676990.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8195/14648195/14648195-exterior_rear_driver-modified-1774777676990.jpeg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8764%252F10308764%252Finterior_boot-1774697905352.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8764/10308764/interior_boot-1774697905352.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0624%252F20240624%252Fexterior_rear_passenger-1773490994124.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0624/20240624/exterior_rear_passenger-1773490994124.jpg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8195%252F14648195%252Fexterior_front_passenger-1774606565142.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8195/14648195/exterior_front_passenger-1774606565142.jpeg not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8764%252F10308764%252F10308764-docs_service_history-modified-1774701077751.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1ab563ec0a349fb815c0480ddfebd94c%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8764/10308764/10308764-docs_service_history-modified-1774701077751.jpeg?ixlib=js-3.8.0&auto=format&s=1ab563ec0a349fb815c0480ddfebd94c not downloaded yet
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0624%252F20240624%252Finterior_front_seats-1773491414916.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0624/20240624/interior_front_seats-1773491414916.jpg not downloaded yet
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8195%252F14648195%252F14648195-exterior_rear_passenger-modified-1774777720710.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8195/14648195/14648195-exterior_rear_passenger-modified-1774777720710.jpeg not downloaded yet
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0624%252F20240624%252Finterior_rear_seats-1773491432892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0624/20240624/interior_rear_seats-1773491432892.jpg not downloaded yet
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8195%252F14648195%252Finterior_front_seats-1774606481119.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8195/14648195/interior_front_seats-1774606481119.jpeg not downloaded yet
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_rear_passenger-1774708356181.jpg> (referer: None)
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0624%252F20240624%252Finterior_dashboard-1773491467222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0624/20240624/interior_dashboard-1773491467222.jpg not downloaded yet
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8195%252F14648195%252Finterior_rear_seats-1774606367243.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8195/14648195/interior_rear_seats-1774606367243.jpeg not downloaded yet
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_front_passenger-1774708373901.jpg> (referer: None)
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0624%252F20240624%252Finterior_boot-1773491475516.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0624/20240624/interior_boot-1773491475516.jpg not downloaded yet
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8195%252F14648195%252Finterior_dashboard-1774606423974.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8195/14648195/interior_dashboard-1774606423974.jpeg not downloaded yet
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0624%252F20240624%252Fdamage_scratches-1773491100565.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0624/20240624/damage_scratches-1773491100565.jpg not downloaded yet
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8195%252F14648195%252Finstrument_cluster-1774606434448.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8195/14648195/instrument_cluster-1774606434448.jpeg not downloaded yet
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_front_passenger-1774690063306.jpg> (referer: None)
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0624%252F20240624%252Fdamage_missing_trims-1774711096793.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0624/20240624/damage_missing_trims-1774711096793.jpg not downloaded yet
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_front_driver-1774709346026.jpg> (referer: None)
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8195%252F14648195%252Finterior_boot-1774606447186.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8195/14648195/interior_boot-1774606447186.jpeg not downloaded yet
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_rear_driver-1774697764606.jpg> (referer: None)
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8195%252F14648195%252Fdocs_service_history-1774608630728.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D11b3483a6005187f5f289a8e705ecd41%27 HTTP/1.1" 200 None
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8195/14648195/docs_service_history-1774608630728.jpeg?ixlib=js-3.8.0&auto=format&s=11b3483a6005187f5f289a8e705ecd41 not downloaded yet
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95d7210>
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8514%252F20398514%252Fexterior_rear_passenger-1774708356181.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_rear_passenger-1774708356181.jpg saved to cache
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8445f10>
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8514%252F20398514%252Fexterior_front_passenger-1774708373901.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_front_passenger-1774708373901.jpg saved to cache
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_front_passenger-1774534441422.jpg> (referer: None)
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_rear_driver-1774710479004.jpg> (referer: None)
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4477/15594477/interior_boot-1774690368398.jpg> (referer: None)
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadbcf50>
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4477%252F15594477%252Fexterior_front_passenger-1774690063306.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_front_passenger-1774690063306.jpg saved to cache
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79e0f293-bfd1-5609-afff-d811d01d8883
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f931fe50>
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4874%252F20474874%252Fexterior_front_driver-1774709346026.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_front_driver-1774709346026.jpg saved to cache
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d9da3f2-8a63-5151-bbc4-931eff213516
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8446a10>
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8764%252F10308764%252Fexterior_rear_driver-1774697764606.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_rear_driver-1774697764606.jpg saved to cache
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 938c589c-d74c-5c72-a454-f043b49e835a
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95d7390>
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7552%252F17807552%252Fexterior_front_passenger-1774534441422.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_front_passenger-1774534441422.jpg saved to cache
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e06208a4-e7d9-52b1-8557-894c14a7a6e9
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8451f50>
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8514%252F20398514%252Fexterior_rear_driver-1774710479004.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_rear_driver-1774710479004.jpg saved to cache
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadbc590>
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4477%252F15594477%252Finterior_boot-1774690368398.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4477/15594477/interior_boot-1774690368398.jpg saved to cache
2026-03-29 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79e0f293-bfd1-5609-afff-d811d01d8883
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5241/15315241/interior_boot-1774705006431.jpg> (referer: None)
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8514/20398514/interior_dashboard-1774710585209.jpg> (referer: None)
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7552/17807552/interior_boot-1774694944868.jpg> (referer: None)
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8514/20398514/interior_front_seats-1774708940780.jpg> (referer: None)
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8514/20398514/interior_rear_seats-1774708954457.jpg> (referer: None)
2026-03-29 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8514/20398514/interior_boot-1774709113407.jpg> (referer: None)
2026-03-29 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0624/20240624/interior_rear_seats-1773491432892.jpg> (referer: None)
2026-03-29 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-interior_dashboard-default-1774265195251.jpg> (referer: None)
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8466a10>
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5241%252F15315241%252Finterior_boot-1774705006431.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5241/15315241/interior_boot-1774705006431.jpg saved to cache
2026-03-29 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d28d8a5-0141-5a1a-bce1-c414602484a4
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95f8350>
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8514%252F20398514%252Finterior_dashboard-1774710585209.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8514/20398514/interior_dashboard-1774710585209.jpg saved to cache
2026-03-29 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1181d0>
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7552%252F17807552%252Finterior_boot-1774694944868.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7552/17807552/interior_boot-1774694944868.jpg saved to cache
2026-03-29 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e06208a4-e7d9-52b1-8557-894c14a7a6e9
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab9d150>
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8514%252F20398514%252Finterior_front_seats-1774708940780.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8514/20398514/interior_front_seats-1774708940780.jpg saved to cache
2026-03-29 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f3b3d0>
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8514%252F20398514%252Finterior_rear_seats-1774708954457.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8514/20398514/interior_rear_seats-1774708954457.jpg saved to cache
2026-03-29 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab9e450>
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8514%252F20398514%252Finterior_boot-1774709113407.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8514/20398514/interior_boot-1774709113407.jpg saved to cache
2026-03-29 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0
2026-03-29 20:03:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0, skipping ID generation
2026-03-29 20:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0 with scrape type 1
2026-03-29 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0 sending to next pipeline
2026-03-29 20:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0, identifier: 20398514
2026-03-29 20:03:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95f96d0>
2026-03-29 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0624%252F20240624%252Finterior_rear_seats-1773491432892.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0624/20240624/interior_rear_seats-1773491432892.jpg saved to cache
2026-03-29 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eff66749-e035-525f-a1bb-751c51e56a88
2026-03-29 20:03:40 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:03:40 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:03:40 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00J\xcc\xa0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\nj\x10\x00J\xa0\xe4\x00\x00\x00\x00'
2026-03-29 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8446d10>
2026-03-29 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4685%252F9844685%252F9844685-interior_dashboard-default-1774265195251.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-interior_dashboard-default-1774265195251.jpg saved to cache
2026-03-29 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d02be44-e090-54c1-a195-bcc99f9d935d
2026-03-29 20:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0 with identifier: 20398514
2026-03-29 20:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0 with identifier: 20398514
2026-03-29 20:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6c8a59c9-702d-5035-bf54-bd40f1dfa0b0 with identifier: 20398514 to the API
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8514/20398514/interior_boot-1774709113407.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6c8a59c9-702d-5035-bf54-bd40f1dfa0b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MT10 BXZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20398514',
'listing': 'auction',
'location': 'Buckinghamshire Marlow',
'make': 'MINI',
'model': 'One',
'odometer': 78458,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1651082,
'Height': 2181,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_front_driver-1774708309861.jpg',
'Width': 2908},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4318073,
'Height': 3827,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_rear_driver-1774710479004.jpg',
'Width': 5102},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2658688,
'Height': 2678,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_front_passenger-1774708373901.jpg',
'Width': 3570},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2276478,
'Height': 2585,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8514/20398514/exterior_rear_passenger-1774708356181.jpg',
'Width': 3447},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4390821,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8514/20398514/interior_front_seats-1774708940780.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4533074,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8514/20398514/interior_rear_seats-1774708954457.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3365653,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8514/20398514/interior_dashboard-1774710585209.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4749244,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8514/20398514/interior_boot-1774709113407.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125225,
'Height': 509,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8514/20398514/damage_missing_trims-1774710238539.jpg',
'Width': 678},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c8a59c9-702d-5035-bf54-bd40f1dfa0b0/6c8a59c9-702d-5035-bf54-bd40f1dfa0b0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631709,
'Height': 1558,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8514/20398514/wheels_front_driver-1774708497622.jpg',
'Width': 2077}],
'price': 1322,
'price_includes_vat': False,
'registration_date': '2010-06-22',
'seats_number': None,
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'vin': 'WMWZM32030TZ10697',
'year': 2010}
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720398514%27 HTTP/1.1" 200 None
2026-03-29 20:03:40 [motorway.uk] INFO: Saving data for 20398514: {'created_time': 1774814620.843619, 'last_price_update_time': 1774814620.84363, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20398514') HTTP/1.1" 204 0
2026-03-29 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0624/20240624/damage_missing_trims-1774711096793.jpg> (referer: None)
2026-03-29 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8195/14648195/docs_service_history-1774608630728.jpeg?ixlib=js-3.8.0&auto=format&s=11b3483a6005187f5f289a8e705ecd41> (referer: None)
2026-03-29 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8195/14648195/interior_dashboard-1774606423974.jpeg> (referer: None)
2026-03-29 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8195/14648195/instrument_cluster-1774606434448.jpeg> (referer: None)
2026-03-29 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0624/20240624/damage_scratches-1773491100565.jpg> (referer: None)
2026-03-29 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8195/14648195/interior_boot-1774606447186.jpeg> (referer: None)
2026-03-29 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0624/20240624/interior_boot-1773491475516.jpg> (referer: None)
2026-03-29 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8195/14648195/interior_rear_seats-1774606367243.jpeg> (referer: None)
2026-03-29 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8127690>
2026-03-29 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0624%252F20240624%252Fdamage_missing_trims-1774711096793.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0624/20240624/damage_missing_trims-1774711096793.jpg saved to cache
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eff66749-e035-525f-a1bb-751c51e56a88
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae2d910>
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8195%252F14648195%252Fdocs_service_history-1774608630728.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D11b3483a6005187f5f289a8e705ecd41') HTTP/1.1" 204 0
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8195/14648195/docs_service_history-1774608630728.jpeg?ixlib=js-3.8.0&auto=format&s=11b3483a6005187f5f289a8e705ecd41 saved to cache
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb50701d-6973-5fed-abfd-fc55722f17f6
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f957d910>
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8195%252F14648195%252Finterior_dashboard-1774606423974.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8195/14648195/interior_dashboard-1774606423974.jpeg saved to cache
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb50701d-6973-5fed-abfd-fc55722f17f6
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00(W\x9e\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x10\xbc\x00(MD\x00\x00\x00\x00'
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9018b10>
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8195%252F14648195%252Finstrument_cluster-1774606434448.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8195/14648195/instrument_cluster-1774606434448.jpeg saved to cache
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb50701d-6973-5fed-abfd-fc55722f17f6
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8118490>
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0624%252F20240624%252Fdamage_scratches-1773491100565.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0624/20240624/damage_scratches-1773491100565.jpg saved to cache
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eff66749-e035-525f-a1bb-751c51e56a88
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003\xe5\xcb\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x19H\x003\xdbq\x00\x00\x00\x00'
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90ba690>
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8195%252F14648195%252Finterior_boot-1774606447186.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8195/14648195/interior_boot-1774606447186.jpeg saved to cache
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb50701d-6973-5fed-abfd-fc55722f17f6
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f957de90>
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0624%252F20240624%252Finterior_boot-1773491475516.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0624/20240624/interior_boot-1773491475516.jpg saved to cache
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eff66749-e035-525f-a1bb-751c51e56a88
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:03:41 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00Ef\xfc\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02R\x85\x00E\\\xa2\x00\x00\x00\x00'
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf48e90>
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8195%252F14648195%252Finterior_rear_seats-1774606367243.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8195/14648195/interior_rear_seats-1774606367243.jpeg saved to cache
2026-03-29 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb50701d-6973-5fed-abfd-fc55722f17f6
2026-03-29 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8764/10308764/interior_boot-1774697905352.jpg> (referer: None)
2026-03-29 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0624/20240624/exterior_front_passenger-1773491013160.jpg> (referer: None)
2026-03-29 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0624/20240624/exterior_rear_passenger-1773490994124.jpg> (referer: None)
2026-03-29 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8195/14648195/exterior_front_passenger-1774606565142.jpeg> (referer: None)
2026-03-29 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8195/14648195/14648195-exterior_rear_passenger-modified-1774777720710.jpeg> (referer: None)
2026-03-29 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8195/14648195/14648195-exterior_rear_driver-modified-1774777676990.jpeg> (referer: None)
2026-03-29 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8764/10308764/10308764-docs_service_history-modified-1774701077751.jpeg?ixlib=js-3.8.0&auto=format&s=1ab563ec0a349fb815c0480ddfebd94c> (referer: None)
2026-03-29 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0624/20240624/interior_front_seats-1773491414916.jpg> (referer: None)
2026-03-29 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0624/20240624/interior_dashboard-1773491467222.jpg> (referer: None)
2026-03-29 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8195/14648195/interior_front_seats-1774606481119.jpeg> (referer: None)
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8985610>
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8764%252F10308764%252Finterior_boot-1774697905352.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8764/10308764/interior_boot-1774697905352.jpg saved to cache
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 938c589c-d74c-5c72-a454-f043b49e835a
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0a7810>
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0624%252F20240624%252Fexterior_front_passenger-1773491013160.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0624/20240624/exterior_front_passenger-1773491013160.jpg saved to cache
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eff66749-e035-525f-a1bb-751c51e56a88
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c03010>
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0624%252F20240624%252Fexterior_rear_passenger-1773490994124.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0624/20240624/exterior_rear_passenger-1773490994124.jpg saved to cache
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eff66749-e035-525f-a1bb-751c51e56a88
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfb6490>
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8195%252F14648195%252Fexterior_front_passenger-1774606565142.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8195/14648195/exterior_front_passenger-1774606565142.jpeg saved to cache
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb50701d-6973-5fed-abfd-fc55722f17f6
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae71e10>
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8195%252F14648195%252F14648195-exterior_rear_passenger-modified-1774777720710.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8195/14648195/14648195-exterior_rear_passenger-modified-1774777720710.jpeg saved to cache
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb50701d-6973-5fed-abfd-fc55722f17f6
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fd6c50>
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8195%252F14648195%252F14648195-exterior_rear_driver-modified-1774777676990.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8195/14648195/14648195-exterior_rear_driver-modified-1774777676990.jpeg saved to cache
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb50701d-6973-5fed-abfd-fc55722f17f6
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c01c90>
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8764%252F10308764%252F10308764-docs_service_history-modified-1774701077751.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1ab563ec0a349fb815c0480ddfebd94c') HTTP/1.1" 204 0
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8764/10308764/10308764-docs_service_history-modified-1774701077751.jpeg?ixlib=js-3.8.0&auto=format&s=1ab563ec0a349fb815c0480ddfebd94c saved to cache
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 938c589c-d74c-5c72-a454-f043b49e835a
2026-03-29 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafd6d90>
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0624%252F20240624%252Finterior_front_seats-1773491414916.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0624/20240624/interior_front_seats-1773491414916.jpg saved to cache
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eff66749-e035-525f-a1bb-751c51e56a88
2026-03-29 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae72a10>
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0624%252F20240624%252Finterior_dashboard-1773491467222.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0624/20240624/interior_dashboard-1773491467222.jpg saved to cache
2026-03-29 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eff66749-e035-525f-a1bb-751c51e56a88
2026-03-29 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:03:42 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00?Q\xd0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02"!\x00?G\xbe\x00\x00\x00\x00'
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafd4310>
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8195%252F14648195%252Finterior_front_seats-1774606481119.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8195/14648195/interior_front_seats-1774606481119.jpeg saved to cache
2026-03-29 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb50701d-6973-5fed-abfd-fc55722f17f6
2026-03-29 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0624/20240624/exterior_front_driver-1774711255281.jpg> (referer: None)
2026-03-29 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8764/10308764/instrument_cluster-1774697978153.jpg> (referer: None)
2026-03-29 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8764/10308764/interior_dashboard-1774698097612.jpg> (referer: None)
2026-03-29 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8195/14648195/exterior_front_driver-1774606556902.jpeg> (referer: None)
2026-03-29 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0624/20240624/exterior_rear_driver-1774711296315.jpg> (referer: None)
2026-03-29 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4477/15594477/damage_scratches-1774690992678.jpg> (referer: None)
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfdd1d0>
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0624%252F20240624%252Fexterior_front_driver-1774711255281.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0624/20240624/exterior_front_driver-1774711255281.jpg saved to cache
2026-03-29 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eff66749-e035-525f-a1bb-751c51e56a88
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9181450>
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8764%252F10308764%252Finstrument_cluster-1774697978153.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8764/10308764/instrument_cluster-1774697978153.jpg saved to cache
2026-03-29 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 938c589c-d74c-5c72-a454-f043b49e835a
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadd1990>
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8764%252F10308764%252Finterior_dashboard-1774698097612.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8764/10308764/interior_dashboard-1774698097612.jpg saved to cache
2026-03-29 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 938c589c-d74c-5c72-a454-f043b49e835a
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96704d0>
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8195%252F14648195%252Fexterior_front_driver-1774606556902.jpeg') HTTP/1.1" 204 0
2026-03-29 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8195/14648195/exterior_front_driver-1774606556902.jpeg saved to cache
2026-03-29 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb50701d-6973-5fed-abfd-fc55722f17f6
2026-03-29 20:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb50701d-6973-5fed-abfd-fc55722f17f6, skipping ID generation
2026-03-29 20:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb50701d-6973-5fed-abfd-fc55722f17f6 with scrape type 1
2026-03-29 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb50701d-6973-5fed-abfd-fc55722f17f6 sending to next pipeline
2026-03-29 20:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: eb50701d-6973-5fed-abfd-fc55722f17f6, identifier: 14648195
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8125f50>
2026-03-29 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0624%252F20240624%252Fexterior_rear_driver-1774711296315.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0624/20240624/exterior_rear_driver-1774711296315.jpg saved to cache
2026-03-29 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eff66749-e035-525f-a1bb-751c51e56a88
2026-03-29 20:03:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eff66749-e035-525f-a1bb-751c51e56a88, skipping ID generation
2026-03-29 20:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eff66749-e035-525f-a1bb-751c51e56a88 with scrape type 1
2026-03-29 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eff66749-e035-525f-a1bb-751c51e56a88 sending to next pipeline
2026-03-29 20:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: eff66749-e035-525f-a1bb-751c51e56a88, identifier: 20240624
2026-03-29 20:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90ba050>
2026-03-29 20:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4477%252F15594477%252Fdamage_scratches-1774690992678.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4477/15594477/damage_scratches-1774690992678.jpg saved to cache
2026-03-29 20:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79e0f293-bfd1-5609-afff-d811d01d8883
2026-03-29 20:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: eb50701d-6973-5fed-abfd-fc55722f17f6 with identifier: 14648195
2026-03-29 20:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: eb50701d-6973-5fed-abfd-fc55722f17f6 with identifier: 14648195
2026-03-29 20:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: eb50701d-6973-5fed-abfd-fc55722f17f6 with identifier: 14648195 to the API
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8195/14648195/exterior_front_driver-1774606556902.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'eb50701d-6973-5fed-abfd-fc55722f17f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AM60 ZOE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14648195',
'listing': 'auction',
'location': 'Hertfordshire Hertford',
'make': 'Audi',
'model': 'A3',
'odometer': 85727,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2038080,
'Height': 2852,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8195/14648195/exterior_front_driver-1774606556902.jpeg',
'Width': 3802},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2122757,
'Height': 2660,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8195/14648195/14648195-exterior_rear_driver-modified-1774777676990.jpeg',
'Width': 3547},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1834783,
'Height': 2869,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8195/14648195/exterior_front_passenger-1774606565142.jpeg',
'Width': 3825},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2142511,
'Height': 2717,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8195/14648195/14648195-exterior_rear_passenger-modified-1774777720710.jpeg',
'Width': 3623},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4289521,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8195/14648195/interior_front_seats-1774606481119.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4700545,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8195/14648195/interior_rear_seats-1774606367243.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2195981,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8195/14648195/interior_dashboard-1774606423974.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2779226,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8195/14648195/instrument_cluster-1774606434448.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3538707,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8195/14648195/interior_boot-1774606447186.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb50701d-6973-5fed-abfd-fc55722f17f6/eb50701d-6973-5fed-abfd-fc55722f17f6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1504930,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8195/14648195/docs_service_history-1774608630728.jpeg?ixlib=js-3.8.0&auto=format&s=11b3483a6005187f5f289a8e705ecd41',
'Width': 3024}],
'price': 10155,
'price_includes_vat': False,
'registration_date': '2018-01-26',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 S Line Black ED TFSI SA',
'transmission': 'automatic',
'trim': 'S Line Black ED TFSI SA',
'vin': 'WAUZZZ8V0JA075694',
'year': 2018}
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714648195%27 HTTP/1.1" 200 None
2026-03-29 20:03:44 [motorway.uk] INFO: Saving data for 14648195: {'created_time': 1774814624.74335, 'last_price_update_time': 1774814624.743361, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14648195') HTTP/1.1" 204 0
2026-03-29 20:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: eff66749-e035-525f-a1bb-751c51e56a88 with identifier: 20240624
2026-03-29 20:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: eff66749-e035-525f-a1bb-751c51e56a88 with identifier: 20240624
2026-03-29 20:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: eff66749-e035-525f-a1bb-751c51e56a88 with identifier: 20240624 to the API
2026-03-29 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0624/20240624/exterior_rear_driver-1774711296315.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'eff66749-e035-525f-a1bb-751c51e56a88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KN72 CWU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20240624',
'listing': 'auction',
'location': 'Leicestershire Leicester',
'make': 'Mercedes',
'model': 'C Class',
'odometer': 15114,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2024201,
'Height': 2585,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0624/20240624/exterior_front_driver-1774711255281.jpg',
'Width': 3447},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2444878,
'Height': 2667,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0624/20240624/exterior_rear_driver-1774711296315.jpg',
'Width': 3556},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2118894,
'Height': 2555,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0624/20240624/exterior_front_passenger-1773491013160.jpg',
'Width': 3406},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1631682,
'Height': 2490,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0624/20240624/exterior_rear_passenger-1773490994124.jpg',
'Width': 3320},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3359486,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0624/20240624/interior_front_seats-1773491414916.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2984845,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0624/20240624/interior_rear_seats-1773491432892.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2832330,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0624/20240624/interior_dashboard-1773491467222.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4464757,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0624/20240624/interior_boot-1773491475516.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2904238,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0624/20240624/damage_scratches-1773491100565.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eff66749-e035-525f-a1bb-751c51e56a88/eff66749-e035-525f-a1bb-751c51e56a88_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293305,
'Height': 939,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0624/20240624/damage_missing_trims-1774711096793.jpg',
'Width': 1252}],
'price': 25297,
'price_includes_vat': False,
'registration_date': '2022-10-24',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes C 220 AMG Line Prem D MHEV A',
'transmission': 'automatic',
'trim': 'C 220 AMG Line Prem D MHEV A',
'vin': 'W1KAF0EB0PR069411',
'year': 2022}
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720240624%27 HTTP/1.1" 200 None
2026-03-29 20:03:45 [motorway.uk] INFO: Saving data for 20240624: {'created_time': 1774814625.141886, 'last_price_update_time': 1774814625.141895, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20240624') HTTP/1.1" 204 0
2026-03-29 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4477/15594477/damage_scratches-1774690864857.jpg> (referer: None)
2026-03-29 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4477/15594477/damage_scratches-1774690942253.jpg> (referer: None)
2026-03-29 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7552/17807552/docs_service_history-1774603808927.jpg?ixlib=js-3.8.0&auto=format&s=8adfbe885ec4e0f50887d83c44b08122> (referer: None)
2026-03-29 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7552/17807552/docs_service_history-1774603654005.jpg?ixlib=js-3.8.0&auto=format&s=67a1f407491242a55f96191534190375> (referer: None)
2026-03-29 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8764/10308764/interior_rear_seats-1774698050654.jpg> (referer: None)
2026-03-29 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_front_passenger-1774697720316.jpg> (referer: None)
2026-03-29 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8764/10308764/interior_front_seats-1774697819525.jpg> (referer: None)
2026-03-29 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_rear_passenger-1774697740181.jpg> (referer: None)
2026-03-29 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7552/17807552/docs_service_history-1774603723204.jpg?ixlib=js-3.8.0&auto=format&s=748b53edad1378615414280256077836> (referer: None)
2026-03-29 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4874/20474874/damage_scratches-1774709421849.jpg> (referer: None)
2026-03-29 20:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4874/20474874/damage_scratches-1774709509786.jpg> (referer: None)
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf7da10>
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4477%252F15594477%252Fdamage_scratches-1774690864857.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4477/15594477/damage_scratches-1774690864857.jpg saved to cache
2026-03-29 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79e0f293-bfd1-5609-afff-d811d01d8883
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81f04d0>
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4477%252F15594477%252Fdamage_scratches-1774690942253.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4477/15594477/damage_scratches-1774690942253.jpg saved to cache
2026-03-29 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79e0f293-bfd1-5609-afff-d811d01d8883
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fade8550>
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7552%252F17807552%252Fdocs_service_history-1774603808927.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8adfbe885ec4e0f50887d83c44b08122') HTTP/1.1" 204 0
2026-03-29 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7552/17807552/docs_service_history-1774603808927.jpg?ixlib=js-3.8.0&auto=format&s=8adfbe885ec4e0f50887d83c44b08122 saved to cache
2026-03-29 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e06208a4-e7d9-52b1-8557-894c14a7a6e9
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facc0cd0>
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7552%252F17807552%252Fdocs_service_history-1774603654005.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D67a1f407491242a55f96191534190375') HTTP/1.1" 204 0
2026-03-29 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7552/17807552/docs_service_history-1774603654005.jpg?ixlib=js-3.8.0&auto=format&s=67a1f407491242a55f96191534190375 saved to cache
2026-03-29 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e06208a4-e7d9-52b1-8557-894c14a7a6e9
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fade8b90>
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8764%252F10308764%252Finterior_rear_seats-1774698050654.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8764/10308764/interior_rear_seats-1774698050654.jpg saved to cache
2026-03-29 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 938c589c-d74c-5c72-a454-f043b49e835a
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafeb010>
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8764%252F10308764%252Fexterior_front_passenger-1774697720316.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_front_passenger-1774697720316.jpg saved to cache
2026-03-29 20:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 938c589c-d74c-5c72-a454-f043b49e835a
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9495910>
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8764%252F10308764%252Finterior_front_seats-1774697819525.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8764/10308764/interior_front_seats-1774697819525.jpg saved to cache
2026-03-29 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 938c589c-d74c-5c72-a454-f043b49e835a
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9497d90>
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8764%252F10308764%252Fexterior_rear_passenger-1774697740181.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_rear_passenger-1774697740181.jpg saved to cache
2026-03-29 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 938c589c-d74c-5c72-a454-f043b49e835a
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf926d0>
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7552%252F17807552%252Fdocs_service_history-1774603723204.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D748b53edad1378615414280256077836') HTTP/1.1" 204 0
2026-03-29 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7552/17807552/docs_service_history-1774603723204.jpg?ixlib=js-3.8.0&auto=format&s=748b53edad1378615414280256077836 saved to cache
2026-03-29 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e06208a4-e7d9-52b1-8557-894c14a7a6e9
2026-03-29 20:03:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:03:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf14850>
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4874%252F20474874%252Fdamage_scratches-1774709421849.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4874/20474874/damage_scratches-1774709421849.jpg saved to cache
2026-03-29 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d9da3f2-8a63-5151-bbc4-931eff213516
2026-03-29 20:03:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:03:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae727d0>
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4874%252F20474874%252Fdamage_scratches-1774709509786.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4874/20474874/damage_scratches-1774709509786.jpg saved to cache
2026-03-29 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d9da3f2-8a63-5151-bbc4-931eff213516
2026-03-29 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_front_driver-1774697707597.jpg> (referer: None)
2026-03-29 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7552/17807552/interior_dashboard-1774694926098.jpg> (referer: None)
2026-03-29 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4477/15594477/interior_front_seats-1774690261650.jpg> (referer: None)
2026-03-29 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_rear_passenger-1774690118471.jpg> (referer: None)
2026-03-29 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4477/15594477/interior_dashboard-1774690375368.jpg> (referer: None)
2026-03-29 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7552/17807552/interior_front_seats-1774535076604.jpg> (referer: None)
2026-03-29 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4874/20474874/interior_dashboard-1774710449371.jpg> (referer: None)
2026-03-29 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4874/20474874/interior_boot-1774710151703.jpg> (referer: None)
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafe8310>
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8764%252F10308764%252Fexterior_front_driver-1774697707597.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_front_driver-1774697707597.jpg saved to cache
2026-03-29 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 938c589c-d74c-5c72-a454-f043b49e835a
2026-03-29 20:03:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 938c589c-d74c-5c72-a454-f043b49e835a, skipping ID generation
2026-03-29 20:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 938c589c-d74c-5c72-a454-f043b49e835a with scrape type 1
2026-03-29 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 938c589c-d74c-5c72-a454-f043b49e835a sending to next pipeline
2026-03-29 20:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 938c589c-d74c-5c72-a454-f043b49e835a, identifier: 10308764
2026-03-29 20:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 938c589c-d74c-5c72-a454-f043b49e835a with identifier: 10308764
2026-03-29 20:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 938c589c-d74c-5c72-a454-f043b49e835a with identifier: 10308764
2026-03-29 20:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 938c589c-d74c-5c72-a454-f043b49e835a with identifier: 10308764 to the API
2026-03-29 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_front_driver-1774697707597.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '5.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '938c589c-d74c-5c72-a454-f043b49e835a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'V66 MAF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10308764',
'listing': 'auction',
'location': 'Hertfordshire St Albans',
'make': 'Aston Martin',
'model': 'DB9',
'odometer': 53000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1031313,
'Height': 2064,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_front_driver-1774697707597.jpg',
'Width': 2752},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1087589,
'Height': 2129,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_rear_driver-1774697764606.jpg',
'Width': 2838},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 938066,
'Height': 2187,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_front_passenger-1774697720316.jpg',
'Width': 2916},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1338930,
'Height': 2348,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8764/10308764/exterior_rear_passenger-1774697740181.jpg',
'Width': 3130},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1991124,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8764/10308764/interior_front_seats-1774697819525.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1627809,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8764/10308764/interior_rear_seats-1774698050654.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1959835,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8764/10308764/interior_dashboard-1774698097612.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1793283,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8764/10308764/instrument_cluster-1774697978153.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2185660,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8764/10308764/interior_boot-1774697905352.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938c589c-d74c-5c72-a454-f043b49e835a/938c589c-d74c-5c72-a454-f043b49e835a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2229081,
'Height': 2953,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8764/10308764/10308764-docs_service_history-modified-1774701077751.jpeg?ixlib=js-3.8.0&auto=format&s=1ab563ec0a349fb815c0480ddfebd94c',
'Width': 3937}],
'price': 22482,
'price_includes_vat': False,
'registration_date': '2008-03-10',
'seats_number': None,
'seller_name': None,
'title': 'Aston Martin DB9 Volante Auto',
'transmission': 'automatic',
'trim': 'Volante Auto',
'vin': 'SCFAC02A98GB09405',
'year': 2008}
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710308764%27 HTTP/1.1" 200 None
2026-03-29 20:03:47 [motorway.uk] INFO: Saving data for 10308764: {'created_time': 1774814627.241223, 'last_price_update_time': 1774814627.241233, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10308764') HTTP/1.1" 204 0
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfb5350>
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7552%252F17807552%252Finterior_dashboard-1774694926098.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7552/17807552/interior_dashboard-1774694926098.jpg saved to cache
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e06208a4-e7d9-52b1-8557-894c14a7a6e9
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabb7250>
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4477%252F15594477%252Finterior_front_seats-1774690261650.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4477/15594477/interior_front_seats-1774690261650.jpg saved to cache
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79e0f293-bfd1-5609-afff-d811d01d8883
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9476c50>
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4477%252F15594477%252Fexterior_rear_passenger-1774690118471.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_rear_passenger-1774690118471.jpg saved to cache
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79e0f293-bfd1-5609-afff-d811d01d8883
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabb5d50>
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4477%252F15594477%252Finterior_dashboard-1774690375368.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4477/15594477/interior_dashboard-1774690375368.jpg saved to cache
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79e0f293-bfd1-5609-afff-d811d01d8883
2026-03-29 20:03:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabb5e10>
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7552%252F17807552%252Finterior_front_seats-1774535076604.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7552/17807552/interior_front_seats-1774535076604.jpg saved to cache
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e06208a4-e7d9-52b1-8557-894c14a7a6e9
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad80c90>
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4874%252F20474874%252Finterior_dashboard-1774710449371.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4874/20474874/interior_dashboard-1774710449371.jpg saved to cache
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d9da3f2-8a63-5151-bbc4-931eff213516
2026-03-29 20:03:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:03:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae98850>
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4874%252F20474874%252Finterior_boot-1774710151703.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4874/20474874/interior_boot-1774710151703.jpg saved to cache
2026-03-29 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d9da3f2-8a63-5151-bbc4-931eff213516
2026-03-29 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_rear_driver-1774534412637.jpg> (referer: None)
2026-03-29 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_rear_driver-1774690180061.jpg> (referer: None)
2026-03-29 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_front_driver-1774689999384.jpg> (referer: None)
2026-03-29 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_front_driver-1774534389365.jpg> (referer: None)
2026-03-29 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_rear_passenger-1774709180400.jpg> (referer: None)
2026-03-29 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_rear_passenger-1774534424391.jpg> (referer: None)
2026-03-29 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4874/20474874/interior_front_seats-1774714038480.jpg> (referer: None)
2026-03-29 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_front_passenger-1774709195740.jpg> (referer: None)
2026-03-29 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4874/20474874/interior_rear_seats-1774710223852.jpg> (referer: None)
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab9c090>
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7552%252F17807552%252Fexterior_rear_driver-1774534412637.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_rear_driver-1774534412637.jpg saved to cache
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e06208a4-e7d9-52b1-8557-894c14a7a6e9
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f932c7d0>
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4477%252F15594477%252Fexterior_rear_driver-1774690180061.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_rear_driver-1774690180061.jpg saved to cache
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79e0f293-bfd1-5609-afff-d811d01d8883
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa31810>
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4477%252F15594477%252Fexterior_front_driver-1774689999384.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_front_driver-1774689999384.jpg saved to cache
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79e0f293-bfd1-5609-afff-d811d01d8883
2026-03-29 20:03:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79e0f293-bfd1-5609-afff-d811d01d8883, skipping ID generation
2026-03-29 20:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79e0f293-bfd1-5609-afff-d811d01d8883 with scrape type 1
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79e0f293-bfd1-5609-afff-d811d01d8883 sending to next pipeline
2026-03-29 20:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 79e0f293-bfd1-5609-afff-d811d01d8883, identifier: 15594477
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafea910>
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7552%252F17807552%252Fexterior_front_driver-1774534389365.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_front_driver-1774534389365.jpg saved to cache
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e06208a4-e7d9-52b1-8557-894c14a7a6e9
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ca4f90>
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4874%252F20474874%252Fexterior_rear_passenger-1774709180400.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_rear_passenger-1774709180400.jpg saved to cache
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d9da3f2-8a63-5151-bbc4-931eff213516
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f932fc10>
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7552%252F17807552%252Fexterior_rear_passenger-1774534424391.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_rear_passenger-1774534424391.jpg saved to cache
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e06208a4-e7d9-52b1-8557-894c14a7a6e9
2026-03-29 20:03:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e06208a4-e7d9-52b1-8557-894c14a7a6e9, skipping ID generation
2026-03-29 20:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e06208a4-e7d9-52b1-8557-894c14a7a6e9 with scrape type 1
2026-03-29 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e06208a4-e7d9-52b1-8557-894c14a7a6e9 sending to next pipeline
2026-03-29 20:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e06208a4-e7d9-52b1-8557-894c14a7a6e9, identifier: 17807552
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa11fcd0>
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4874%252F20474874%252Finterior_front_seats-1774714038480.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4874/20474874/interior_front_seats-1774714038480.jpg saved to cache
2026-03-29 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d9da3f2-8a63-5151-bbc4-931eff213516
2026-03-29 20:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfdfb50>
2026-03-29 20:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4874%252F20474874%252Fexterior_front_passenger-1774709195740.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_front_passenger-1774709195740.jpg saved to cache
2026-03-29 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d9da3f2-8a63-5151-bbc4-931eff213516
2026-03-29 20:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa31dd0>
2026-03-29 20:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4874%252F20474874%252Finterior_rear_seats-1774710223852.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4874/20474874/interior_rear_seats-1774710223852.jpg saved to cache
2026-03-29 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d9da3f2-8a63-5151-bbc4-931eff213516
2026-03-29 20:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 79e0f293-bfd1-5609-afff-d811d01d8883 with identifier: 15594477
2026-03-29 20:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 79e0f293-bfd1-5609-afff-d811d01d8883 with identifier: 15594477
2026-03-29 20:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 79e0f293-bfd1-5609-afff-d811d01d8883 with identifier: 15594477 to the API
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_front_driver-1774689999384.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '79e0f293-bfd1-5609-afff-d811d01d8883',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'NV16 SHJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15594477',
'listing': 'auction',
'location': 'Bristol City Bristol',
'make': 'Mercedes',
'model': 'SLC',
'odometer': 105000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1692005,
'Height': 2374,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_front_driver-1774689999384.jpg',
'Width': 3165},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1475364,
'Height': 2406,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_rear_driver-1774690180061.jpg',
'Width': 3208},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1628629,
'Height': 2381,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_front_passenger-1774690063306.jpg',
'Width': 3174},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1775235,
'Height': 2419,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4477/15594477/exterior_rear_passenger-1774690118471.jpg',
'Width': 3225},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2367766,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/4477/15594477/interior_front_seats-1774690261650.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1745978,
'Height': 2448,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4477/15594477/interior_dashboard-1774690375368.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1663681,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/4477/15594477/interior_boot-1774690368398.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 699456,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/4477/15594477/damage_scratches-1774690864857.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755455,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/4477/15594477/damage_scratches-1774690942253.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e0f293-bfd1-5609-afff-d811d01d8883/79e0f293-bfd1-5609-afff-d811d01d8883_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 610179,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/4477/15594477/damage_scratches-1774690992678.jpg',
'Width': 3264}],
'price': 8151,
'price_includes_vat': False,
'registration_date': '2016-07-07',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes SLC 250 D AMG Line Auto',
'transmission': 'automatic',
'trim': '250 D AMG Line Auto',
'vin': 'WDD1724042F130666',
'year': 2016}
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715594477%27 HTTP/1.1" 200 None
2026-03-29 20:03:49 [motorway.uk] INFO: Saving data for 15594477: {'created_time': 1774814629.639328, 'last_price_update_time': 1774814629.639342, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15594477') HTTP/1.1" 204 0
2026-03-29 20:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e06208a4-e7d9-52b1-8557-894c14a7a6e9 with identifier: 17807552
2026-03-29 20:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e06208a4-e7d9-52b1-8557-894c14a7a6e9 with identifier: 17807552
2026-03-29 20:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e06208a4-e7d9-52b1-8557-894c14a7a6e9 with identifier: 17807552 to the API
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_rear_passenger-1774534424391.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e06208a4-e7d9-52b1-8557-894c14a7a6e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RE61 ODG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17807552',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Porsche',
'model': 'Cayman',
'odometer': 51675,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1854594,
'Height': 2681,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_front_driver-1774534389365.jpg',
'Width': 3574},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1838957,
'Height': 2923,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_rear_driver-1774534412637.jpg',
'Width': 3897},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2195821,
'Height': 2771,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_front_passenger-1774534441422.jpg',
'Width': 3694},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2285738,
'Height': 2853,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7552/17807552/exterior_rear_passenger-1774534424391.jpg',
'Width': 3804},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2484993,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7552/17807552/interior_front_seats-1774535076604.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2243665,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7552/17807552/interior_dashboard-1774694926098.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2741441,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7552/17807552/interior_boot-1774694944868.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1193844,
'Height': 4025,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7552/17807552/docs_service_history-1774603654005.jpg?ixlib=js-3.8.0&auto=format&s=67a1f407491242a55f96191534190375',
'Width': 3018},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1720228,
'Height': 4204,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7552/17807552/docs_service_history-1774603723204.jpg?ixlib=js-3.8.0&auto=format&s=748b53edad1378615414280256077836',
'Width': 3153},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e06208a4-e7d9-52b1-8557-894c14a7a6e9/e06208a4-e7d9-52b1-8557-894c14a7a6e9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1534086,
'Height': 4091,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7552/17807552/docs_service_history-1774603808927.jpg?ixlib=js-3.8.0&auto=format&s=8adfbe885ec4e0f50887d83c44b08122',
'Width': 3068}],
'price': 16471,
'price_includes_vat': False,
'registration_date': '2011-12-01',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Cayman S-A',
'transmission': 'automatic',
'trim': 'S-A',
'vin': 'WP0ZZZ98ZCS750788',
'year': 2011}
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717807552%27 HTTP/1.1" 200 None
2026-03-29 20:03:50 [motorway.uk] INFO: Saving data for 17807552: {'created_time': 1774814630.046166, 'last_price_update_time': 1774814630.046175, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17807552') HTTP/1.1" 204 0
2026-03-29 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2166/20222166/interior_dashboard-1774712360937.jpg> (referer: None)
2026-03-29 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5241/15315241/interior_dashboard-1774007614906.jpg> (referer: None)
2026-03-29 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_rear_driver-1774709163322.jpg> (referer: None)
2026-03-29 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5241/15315241/instrument_cluster-1774007661598.jpg> (referer: None)
2026-03-29 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2166/20222166/instrument_cluster-1774712338574.jpg> (referer: None)
2026-03-29 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2166/20222166/interior_rear_seats-1774712322424.jpg> (referer: None)
2026-03-29 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4685/9844685/9844685-interior_rear_seats-default-1774265173801.jpg> (referer: None)
2026-03-29 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4685/9844685/9844685-interior_front_seats-default-1774265155955.jpg> (referer: None)
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93126d0>
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F20222166%252Finterior_dashboard-1774712360937.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/20222166/interior_dashboard-1774712360937.jpg saved to cache
2026-03-29 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9312ad0>
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5241%252F15315241%252Finterior_dashboard-1774007614906.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5241/15315241/interior_dashboard-1774007614906.jpg saved to cache
2026-03-29 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d28d8a5-0141-5a1a-bce1-c414602484a4
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9322610>
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4874%252F20474874%252Fexterior_rear_driver-1774709163322.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_rear_driver-1774709163322.jpg saved to cache
2026-03-29 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d9da3f2-8a63-5151-bbc4-931eff213516
2026-03-29 20:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d9da3f2-8a63-5151-bbc4-931eff213516, skipping ID generation
2026-03-29 20:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d9da3f2-8a63-5151-bbc4-931eff213516 with scrape type 1
2026-03-29 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d9da3f2-8a63-5151-bbc4-931eff213516 sending to next pipeline
2026-03-29 20:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1d9da3f2-8a63-5151-bbc4-931eff213516, identifier: 20474874
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabb5810>
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5241%252F15315241%252Finstrument_cluster-1774007661598.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5241/15315241/instrument_cluster-1774007661598.jpg saved to cache
2026-03-29 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d28d8a5-0141-5a1a-bce1-c414602484a4
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f931f8d0>
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F20222166%252Finstrument_cluster-1774712338574.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/20222166/instrument_cluster-1774712338574.jpg saved to cache
2026-03-29 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabb4fd0>
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2166%252F20222166%252Finterior_rear_seats-1774712322424.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2166/20222166/interior_rear_seats-1774712322424.jpg saved to cache
2026-03-29 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707
2026-03-29 20:03:51 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:03:51 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:03:51 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00H\xb3\xe5\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xb1\xe8\x00H\x89"\x00\x00\x00\x00'
2026-03-29 20:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9661b50>
2026-03-29 20:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4685%252F9844685%252F9844685-interior_rear_seats-default-1774265173801.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4685/9844685/9844685-interior_rear_seats-default-1774265173801.jpg saved to cache
2026-03-29 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d02be44-e090-54c1-a195-bcc99f9d935d
2026-03-29 20:03:51 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:03:51 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:03:51 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00S\xf7\x90\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x0b"2\x00S\xc5I\x00\x00\x00\x00'
2026-03-29 20:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d28d0>
2026-03-29 20:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4685%252F9844685%252F9844685-interior_front_seats-default-1774265155955.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4685/9844685/9844685-interior_front_seats-default-1774265155955.jpg saved to cache
2026-03-29 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d02be44-e090-54c1-a195-bcc99f9d935d
2026-03-29 20:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1860/19791860/docs_service_history-1774784442630.jpg?ixlib=js-3.8.0&auto=format&s=1f654dedfec30f1b11816c06cca608d7> (referer: None)
2026-03-29 20:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1d9da3f2-8a63-5151-bbc4-931eff213516 with identifier: 20474874
2026-03-29 20:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1d9da3f2-8a63-5151-bbc4-931eff213516 with identifier: 20474874
2026-03-29 20:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1d9da3f2-8a63-5151-bbc4-931eff213516 with identifier: 20474874 to the API
2026-03-29 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_rear_driver-1774709163322.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '1d9da3f2-8a63-5151-bbc4-931eff213516',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WIL 8445',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20474874',
'listing': 'auction',
'location': 'Denbighshire Denbigh',
'make': 'Nissan',
'model': 'Other Nissan',
'odometer': 10008,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2235177,
'Height': 2804,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_front_driver-1774709346026.jpg',
'Width': 3739},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1912777,
'Height': 2582,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_rear_driver-1774709163322.jpg',
'Width': 3443},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2467562,
'Height': 2783,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_front_passenger-1774709195740.jpg',
'Width': 3711},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1949319,
'Height': 2652,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4874/20474874/exterior_rear_passenger-1774709180400.jpg',
'Width': 3536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2648192,
'Height': 2905,
'OriginUrl': 'https://motorway-photos.imgix.net/4874/20474874/interior_front_seats-1774714038480.jpg',
'Width': 3874},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3553365,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4874/20474874/interior_rear_seats-1774710223852.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2008917,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4874/20474874/interior_dashboard-1774710449371.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4286876,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4874/20474874/interior_boot-1774710151703.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3469688,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4874/20474874/damage_scratches-1774709421849.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d9da3f2-8a63-5151-bbc4-931eff213516/1d9da3f2-8a63-5151-bbc4-931eff213516_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3908976,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4874/20474874/damage_scratches-1774709509786.jpg',
'Width': 4032}],
'price': 15206,
'price_includes_vat': False,
'registration_date': '2016-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Nissan NP300 Navara Tekna DCI Auto',
'transmission': 'automatic',
'trim': 'NP300 Navara Tekna DCI Auto',
'vin': 'VSKCTND23U0021694',
'year': 2016}
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720474874%27 HTTP/1.1" 200 None
2026-03-29 20:03:52 [motorway.uk] INFO: Saving data for 20474874: {'created_time': 1774814632.648838, 'last_price_update_time': 1774814632.64885, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20474874') HTTP/1.1" 204 0
2026-03-29 20:03:52 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x048'
2026-03-29 20:03:52 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\t$'
2026-03-29 20:03:52 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 46 - Data Location: 74 - value: <table: 41 bytes>
2026-03-29 20:03:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00s'
2026-03-29 20:03:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a6a3d0>
2026-03-29 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1860%252F19791860%252Fdocs_service_history-1774784442630.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1f654dedfec30f1b11816c06cca608d7') HTTP/1.1" 204 0
2026-03-29 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1860/19791860/docs_service_history-1774784442630.jpg?ixlib=js-3.8.0&auto=format&s=1f654dedfec30f1b11816c06cca608d7 saved to cache
2026-03-29 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae529704-a64c-54a1-af67-f9d028d3c0a0
2026-03-29 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_front_passenger-default-1774702838452.jpg> (referer: None)
2026-03-29 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_rear_passenger-1774007237403.jpg> (referer: None)
2026-03-29 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_rear_passenger-default-1774702836345.jpg> (referer: None)
2026-03-29 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_rear_passenger-1774711413919.jpg> (referer: None)
2026-03-29 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_rear_driver-default-1774702870562.jpg> (referer: None)
2026-03-29 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5241/15315241/interior_rear_seats-1774007576833.jpg> (referer: None)
2026-03-29 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2166/20222166/interior_front_seats-1774712284163.jpg> (referer: None)
2026-03-29 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5241/15315241/interior_front_seats-1774007561431.jpg> (referer: None)
2026-03-29 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8124810>
2026-03-29 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4685%252F9844685%252F9844685-exterior_front_passenger-default-1774702838452.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_front_passenger-default-1774702838452.jpg saved to cache
2026-03-29 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d02be44-e090-54c1-a195-bcc99f9d935d
2026-03-29 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ea4090>
2026-03-29 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5241%252F15315241%252Fexterior_rear_passenger-1774007237403.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_rear_passenger-1774007237403.jpg saved to cache
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d28d8a5-0141-5a1a-bce1-c414602484a4
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f897c150>
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4685%252F9844685%252F9844685-exterior_rear_passenger-default-1774702836345.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_rear_passenger-default-1774702836345.jpg saved to cache
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d02be44-e090-54c1-a195-bcc99f9d935d
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8df1410>
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F20222166%252Fexterior_rear_passenger-1774711413919.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_rear_passenger-1774711413919.jpg saved to cache
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f897d210>
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4685%252F9844685%252F9844685-exterior_rear_driver-default-1774702870562.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_rear_driver-default-1774702870562.jpg saved to cache
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d02be44-e090-54c1-a195-bcc99f9d935d
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9474350>
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5241%252F15315241%252Finterior_rear_seats-1774007576833.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5241/15315241/interior_rear_seats-1774007576833.jpg saved to cache
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d28d8a5-0141-5a1a-bce1-c414602484a4
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f897f7d0>
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2166%252F20222166%252Finterior_front_seats-1774712284163.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2166/20222166/interior_front_seats-1774712284163.jpg saved to cache
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f947a750>
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5241%252F15315241%252Finterior_front_seats-1774007561431.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5241/15315241/interior_front_seats-1774007561431.jpg saved to cache
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d28d8a5-0141-5a1a-bce1-c414602484a4
2026-03-29 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_front_driver-default-1774702829820.jpg> (referer: None)
2026-03-29 20:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0909/18730909/docs_service_history-1774782593670.jpg?ixlib=js-3.8.0&auto=format&s=ff0a708f95dbb9923058f867a4849849> (referer: None)
2026-03-29 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1860/19791860/instrument_cluster-1774786181311.jpg> (referer: None)
2026-03-29 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_front_passenger-1774007253510.jpg> (referer: None)
2026-03-29 20:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_rear_driver-1774007227082.jpg> (referer: None)
2026-03-29 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1860/19791860/interior_dashboard-1774783863983.jpg> (referer: None)
2026-03-29 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_front_passenger-1774711393340.jpg> (referer: None)
2026-03-29 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1860/19791860/interior_boot-1774783856040.jpg> (referer: None)
2026-03-29 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_rear_driver-1774711435336.jpg> (referer: None)
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faccf850>
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4685%252F9844685%252F9844685-exterior_front_driver-default-1774702829820.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_front_driver-default-1774702829820.jpg saved to cache
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d02be44-e090-54c1-a195-bcc99f9d935d
2026-03-29 20:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d02be44-e090-54c1-a195-bcc99f9d935d, skipping ID generation
2026-03-29 20:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d02be44-e090-54c1-a195-bcc99f9d935d with scrape type 1
2026-03-29 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d02be44-e090-54c1-a195-bcc99f9d935d sending to next pipeline
2026-03-29 20:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6d02be44-e090-54c1-a195-bcc99f9d935d, identifier: 9844685
2026-03-29 20:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6d02be44-e090-54c1-a195-bcc99f9d935d with identifier: 9844685
2026-03-29 20:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6d02be44-e090-54c1-a195-bcc99f9d935d with identifier: 9844685
2026-03-29 20:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6d02be44-e090-54c1-a195-bcc99f9d935d with identifier: 9844685 to the API
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_front_driver-default-1774702829820.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '6d02be44-e090-54c1-a195-bcc99f9d935d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KF17 DZL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/9844685',
'listing': 'auction',
'location': 'Greater London Bromley',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 76000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2288848,
'Height': 2659,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_front_driver-default-1774702829820.jpg',
'Width': 3545},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2346599,
'Height': 2897,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_rear_driver-default-1774702870562.jpg',
'Width': 3863},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2259304,
'Height': 2774,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_front_passenger-default-1774702838452.jpg',
'Width': 3699},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1858593,
'Height': 2538,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-exterior_rear_passenger-default-1774702836345.jpg',
'Width': 3384},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 6232514,
'Height': 4284,
'OriginUrl': 'https://motorway-photos.imgix.net/4685/9844685/9844685-interior_front_seats-default-1774265155955.jpg',
'Width': 5712},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 5334477,
'Height': 4284,
'OriginUrl': 'https://motorway-photos.imgix.net/4685/9844685/9844685-interior_rear_seats-default-1774265173801.jpg',
'Width': 5712},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 5584560,
'Height': 4284,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4685/9844685/9844685-interior_dashboard-default-1774265195251.jpg',
'Width': 5712},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 598626,
'Height': 1824,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4685/9844685/9844685-interior_boot-modified-1774436651633.jpeg',
'Width': 2432},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 892328,
'Height': 2161,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4685/9844685/9844685-docs_service_history-modified-1761061396849.jpeg?ixlib=js-3.8.0&auto=format&s=a29473d878352f835435cd2cbc5cca0e',
'Width': 2881},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d02be44-e090-54c1-a195-bcc99f9d935d/6d02be44-e090-54c1-a195-bcc99f9d935d_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3269556,
'Height': 4284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4685/9844685/9844685-docs_service_history-default-1774373090182.jpeg?ixlib=js-3.8.0&auto=format&s=3f0d5794719abebf47965d5c1c6deecc',
'Width': 5712}],
'price': 9624,
'price_includes_vat': False,
'registration_date': '2017-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 200 D AMG Line Premium + A',
'transmission': 'automatic',
'trim': 'A 200 D AMG Line Premium + A',
'vin': 'WDD1760082V191074',
'year': 2017}
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279844685%27 HTTP/1.1" 200 None
2026-03-29 20:03:54 [motorway.uk] INFO: Saving data for 9844685: {'created_time': 1774814634.446696, 'last_price_update_time': 1774814634.446707, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='9844685') HTTP/1.1" 204 0
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facce4d0>
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0909%252F18730909%252Fdocs_service_history-1774782593670.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dff0a708f95dbb9923058f867a4849849') HTTP/1.1" 204 0
2026-03-29 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0909/18730909/docs_service_history-1774782593670.jpg?ixlib=js-3.8.0&auto=format&s=ff0a708f95dbb9923058f867a4849849 saved to cache
2026-03-29 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9673150>
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1860%252F19791860%252Finstrument_cluster-1774786181311.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1860/19791860/instrument_cluster-1774786181311.jpg saved to cache
2026-03-29 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae529704-a64c-54a1-af67-f9d028d3c0a0
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa153c50>
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5241%252F15315241%252Fexterior_front_passenger-1774007253510.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_front_passenger-1774007253510.jpg saved to cache
2026-03-29 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d28d8a5-0141-5a1a-bce1-c414602484a4
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a92210>
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5241%252F15315241%252Fexterior_rear_driver-1774007227082.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_rear_driver-1774007227082.jpg saved to cache
2026-03-29 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d28d8a5-0141-5a1a-bce1-c414602484a4
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8132150>
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1860%252F19791860%252Finterior_dashboard-1774783863983.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1860/19791860/interior_dashboard-1774783863983.jpg saved to cache
2026-03-29 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae529704-a64c-54a1-af67-f9d028d3c0a0
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81329d0>
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F20222166%252Fexterior_front_passenger-1774711393340.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_front_passenger-1774711393340.jpg saved to cache
2026-03-29 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9673490>
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1860%252F19791860%252Finterior_boot-1774783856040.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1860/19791860/interior_boot-1774783856040.jpg saved to cache
2026-03-29 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae529704-a64c-54a1-af67-f9d028d3c0a0
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d2d50>
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F20222166%252Fexterior_rear_driver-1774711435336.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_rear_driver-1774711435336.jpg saved to cache
2026-03-29 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707
2026-03-29 20:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_front_driver-1774711446816.jpg> (referer: None)
2026-03-29 20:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_rear_passenger-1774783281377.jpg> (referer: None)
2026-03-29 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_front_driver-1774007210989.jpg> (referer: None)
2026-03-29 20:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0909/18730909/instrument_cluster-1774694046874.jpg> (referer: None)
2026-03-29 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0909/18730909/interior_dashboard-1774787243624.jpg> (referer: None)
2026-03-29 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1860/19791860/interior_rear_seats-1774783861953.jpg> (referer: None)
2026-03-29 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0909/18730909/interior_boot-1774694153761.jpg> (referer: None)
2026-03-29 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0909/18730909/interior_rear_seats-1774694038325.jpg> (referer: None)
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f907d790>
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2166%252F20222166%252Fexterior_front_driver-1774711446816.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_front_driver-1774711446816.jpg saved to cache
2026-03-29 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707
2026-03-29 20:03:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2823e5c5-2f56-54a2-90ee-00b13f8b1707, skipping ID generation
2026-03-29 20:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707 with scrape type 1
2026-03-29 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2823e5c5-2f56-54a2-90ee-00b13f8b1707 sending to next pipeline
2026-03-29 20:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2823e5c5-2f56-54a2-90ee-00b13f8b1707, identifier: 20222166
2026-03-29 20:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2823e5c5-2f56-54a2-90ee-00b13f8b1707 with identifier: 20222166
2026-03-29 20:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2823e5c5-2f56-54a2-90ee-00b13f8b1707 with identifier: 20222166
2026-03-29 20:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2823e5c5-2f56-54a2-90ee-00b13f8b1707 with identifier: 20222166 to the API
2026-03-29 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_front_driver-1774711446816.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2823e5c5-2f56-54a2-90ee-00b13f8b1707',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ET68 JOH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20222166',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Audi',
'model': 'A3',
'odometer': 21000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1363228,
'Height': 2540,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_front_driver-1774711446816.jpg',
'Width': 3386},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2056683,
'Height': 2686,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_rear_driver-1774711435336.jpg',
'Width': 3581},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1980815,
'Height': 2513,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_front_passenger-1774711393340.jpg',
'Width': 3351},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2004104,
'Height': 2656,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2166/20222166/exterior_rear_passenger-1774711413919.jpg',
'Width': 3541},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3941253,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2166/20222166/interior_front_seats-1774712284163.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3709258,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2166/20222166/interior_rear_seats-1774712322424.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1760975,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2166/20222166/interior_dashboard-1774712360937.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2893406,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2166/20222166/instrument_cluster-1774712338574.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3866734,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2166/20222166/interior_boot-1774712365152.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2823e5c5-2f56-54a2-90ee-00b13f8b1707/2823e5c5-2f56-54a2-90ee-00b13f8b1707_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 826945,
'Height': 1980,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2166/20222166/docs_service_history-1774712765702.jpg?ixlib=js-3.8.0&auto=format&s=73950ba8027ef9cd29e9228ae5c21105',
'Width': 2810}],
'price': 14790,
'price_includes_vat': False,
'registration_date': '2019-01-17',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 S Line 35 TFSI',
'transmission': 'manual',
'trim': 'S Line 35 TFSI',
'vin': 'WAUZZZ8V6K1008485',
'year': 2019}
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720222166%27 HTTP/1.1" 200 None
2026-03-29 20:03:56 [motorway.uk] INFO: Saving data for 20222166: {'created_time': 1774814636.443151, 'last_price_update_time': 1774814636.443162, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20222166') HTTP/1.1" 204 0
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ea4f90>
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1860%252F19791860%252Fexterior_rear_passenger-1774783281377.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_rear_passenger-1774783281377.jpg saved to cache
2026-03-29 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae529704-a64c-54a1-af67-f9d028d3c0a0
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae9bad0>
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5241%252F15315241%252Fexterior_front_driver-1774007210989.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_front_driver-1774007210989.jpg saved to cache
2026-03-29 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d28d8a5-0141-5a1a-bce1-c414602484a4
2026-03-29 20:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d28d8a5-0141-5a1a-bce1-c414602484a4, skipping ID generation
2026-03-29 20:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d28d8a5-0141-5a1a-bce1-c414602484a4 with scrape type 1
2026-03-29 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d28d8a5-0141-5a1a-bce1-c414602484a4 sending to next pipeline
2026-03-29 20:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7d28d8a5-0141-5a1a-bce1-c414602484a4, identifier: 15315241
2026-03-29 20:03:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf4d0d0>
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0909%252F18730909%252Finstrument_cluster-1774694046874.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0909/18730909/instrument_cluster-1774694046874.jpg saved to cache
2026-03-29 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae9b650>
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0909%252F18730909%252Finterior_dashboard-1774787243624.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0909/18730909/interior_dashboard-1774787243624.jpg saved to cache
2026-03-29 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f939fa10>
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1860%252F19791860%252Finterior_rear_seats-1774783861953.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1860/19791860/interior_rear_seats-1774783861953.jpg saved to cache
2026-03-29 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae529704-a64c-54a1-af67-f9d028d3c0a0
2026-03-29 20:03:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae2ffd0>
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0909%252F18730909%252Finterior_boot-1774694153761.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0909/18730909/interior_boot-1774694153761.jpg saved to cache
2026-03-29 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728
2026-03-29 20:03:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ed0cd0>
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0909%252F18730909%252Finterior_rear_seats-1774694038325.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0909/18730909/interior_rear_seats-1774694038325.jpg saved to cache
2026-03-29 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728
2026-03-29 20:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7d28d8a5-0141-5a1a-bce1-c414602484a4 with identifier: 15315241
2026-03-29 20:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7d28d8a5-0141-5a1a-bce1-c414602484a4 with identifier: 15315241
2026-03-29 20:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7d28d8a5-0141-5a1a-bce1-c414602484a4 with identifier: 15315241 to the API
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_front_driver-1774007210989.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7d28d8a5-0141-5a1a-bce1-c414602484a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HW20 LKY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15315241',
'listing': 'auction',
'location': 'Conwy Principal Area Rhyl',
'make': 'Jaguar',
'model': 'E-PACE',
'odometer': 33869,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1395979,
'Height': 2246,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_front_driver-1774007210989.jpg',
'Width': 2995},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1200886,
'Height': 1997,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_rear_driver-1774007227082.jpg',
'Width': 2662},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1053034,
'Height': 1951,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_front_passenger-1774007253510.jpg',
'Width': 2601},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1482590,
'Height': 2338,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5241/15315241/exterior_rear_passenger-1774007237403.jpg',
'Width': 3117},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4069464,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5241/15315241/interior_front_seats-1774007561431.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3926881,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5241/15315241/interior_rear_seats-1774007576833.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1730167,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5241/15315241/interior_dashboard-1774007614906.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2534599,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5241/15315241/instrument_cluster-1774007661598.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3541579,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5241/15315241/interior_boot-1774705006431.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d28d8a5-0141-5a1a-bce1-c414602484a4/7d28d8a5-0141-5a1a-bce1-c414602484a4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684701,
'Height': 2556,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5241/15315241/docs_service_history-1774008164603.jpg?ixlib=js-3.8.0&auto=format&s=c01c98a8cc3dfa10d4221a43bfb9c6a2',
'Width': 1179}],
'price': 17118,
'price_includes_vat': False,
'registration_date': '2020-05-30',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar E-PACE R-DYNAMIC SE AWD Auto',
'transmission': 'automatic',
'trim': 'R-DYNAMIC SE AWD Auto',
'vin': 'SADFA2AX6L1000621',
'year': 2020}
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715315241%27 HTTP/1.1" 200 None
2026-03-29 20:03:57 [motorway.uk] INFO: Saving data for 15315241: {'created_time': 1774814637.778352, 'last_price_update_time': 1774814637.778361, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15315241') HTTP/1.1" 204 0
2026-03-29 20:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=612&page=17&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0909/18730909/exterior_front_driver-1774692839507.jpg> (referer: None)
2026-03-29 20:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_rear_driver-1774783274326.jpg> (referer: None)
2026-03-29 20:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_front_passenger-1774783280293.jpg> (referer: None)
2026-03-29 20:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0909/18730909/exterior_rear_passenger-1774692978909.jpg> (referer: None)
2026-03-29 20:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0909/18730909/interior_front_seats-1774694313270.jpg> (referer: None)
2026-03-29 20:03:57 [motorway.uk] INFO: Found listing with ID: 20176261
2026-03-29 20:03:57 [motorway.uk] INFO: Found listing with ID: 17331668
2026-03-29 20:03:57 [motorway.uk] INFO: Found listing with ID: 20454066
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720454066%27 HTTP/1.1" 200 None
2026-03-29 20:03:57 [motorway.uk] INFO: Scrape type for 20454066: 1
2026-03-29 20:03:57 [motorway.uk] INFO: Found listing with ID: 18631801
2026-03-29 20:03:57 [motorway.uk] INFO: Found listing with ID: 3620067
2026-03-29 20:03:57 [motorway.uk] INFO: Found listing with ID: 20010331
2026-03-29 20:03:57 [motorway.uk] INFO: Found listing with ID: 6110693
2026-03-29 20:03:57 [motorway.uk] INFO: Found listing with ID: 20212993
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720212993%27 HTTP/1.1" 200 None
2026-03-29 20:03:57 [motorway.uk] INFO: Scrape type for 20212993: 1
2026-03-29 20:03:57 [motorway.uk] INFO: Found listing with ID: 18599819
2026-03-29 20:03:57 [motorway.uk] INFO: Found listing with ID: 20478024
2026-03-29 20:03:57 [motorway.uk] INFO: Found listing with ID: 20476322
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476322%27 HTTP/1.1" 200 None
2026-03-29 20:03:57 [motorway.uk] INFO: Scrape type for 20476322: 1
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa112590>
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0909%252F18730909%252Fexterior_front_driver-1774692839507.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0909/18730909/exterior_front_driver-1774692839507.jpg saved to cache
2026-03-29 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8118f10>
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1860%252F19791860%252Fexterior_rear_driver-1774783274326.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_rear_driver-1774783274326.jpg saved to cache
2026-03-29 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae529704-a64c-54a1-af67-f9d028d3c0a0
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f96ed0>
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1860%252F19791860%252Fexterior_front_passenger-1774783280293.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_front_passenger-1774783280293.jpg saved to cache
2026-03-29 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae529704-a64c-54a1-af67-f9d028d3c0a0
2026-03-29 20:03:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae529704-a64c-54a1-af67-f9d028d3c0a0, skipping ID generation
2026-03-29 20:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae529704-a64c-54a1-af67-f9d028d3c0a0 with scrape type 1
2026-03-29 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae529704-a64c-54a1-af67-f9d028d3c0a0 sending to next pipeline
2026-03-29 20:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ae529704-a64c-54a1-af67-f9d028d3c0a0, identifier: 19791860
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f938ef90>
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0909%252F18730909%252Fexterior_rear_passenger-1774692978909.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0909/18730909/exterior_rear_passenger-1774692978909.jpg saved to cache
2026-03-29 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728
2026-03-29 20:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ae529704-a64c-54a1-af67-f9d028d3c0a0 with identifier: 19791860
2026-03-29 20:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ae529704-a64c-54a1-af67-f9d028d3c0a0 with identifier: 19791860
2026-03-29 20:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ae529704-a64c-54a1-af67-f9d028d3c0a0 with identifier: 19791860 to the API
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_front_passenger-1774783280293.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ae529704-a64c-54a1-af67-f9d028d3c0a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VF21 URR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19791860',
'listing': 'auction',
'location': 'Northamptonshire Northampton',
'make': 'Audi',
'model': 'A5',
'odometer': 60000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1313433,
'Height': 2828,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_front_driver-1774783279022.jpg',
'Width': 3771},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1369642,
'Height': 2580,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_rear_driver-1774783274326.jpg',
'Width': 3440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1490980,
'Height': 2712,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_front_passenger-1774783280293.jpg',
'Width': 3616},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1326271,
'Height': 2681,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1860/19791860/exterior_rear_passenger-1774783281377.jpg',
'Width': 3575},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1997645,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1860/19791860/interior_front_seats-1774783858635.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2492701,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1860/19791860/interior_rear_seats-1774783861953.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1672755,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1860/19791860/interior_dashboard-1774783863983.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 994894,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1860/19791860/instrument_cluster-1774786181311.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2041614,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1860/19791860/interior_boot-1774783856040.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae529704-a64c-54a1-af67-f9d028d3c0a0/ae529704-a64c-54a1-af67-f9d028d3c0a0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238580,
'Height': 2340,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1860/19791860/docs_service_history-1774784442630.jpg?ixlib=js-3.8.0&auto=format&s=1f654dedfec30f1b11816c06cca608d7',
'Width': 1080}],
'price': 18582,
'price_includes_vat': False,
'registration_date': '2021-08-25',
'seats_number': None,
'seller_name': None,
'title': 'Audi A5 S Line 35 TDI MHEV S-A',
'transmission': 'automatic',
'trim': 'S Line 35 TDI MHEV S-A',
'vin': 'WAUZZZF59NA001019',
'year': 2021}
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719791860%27 HTTP/1.1" 200 None
2026-03-29 20:03:58 [motorway.uk] INFO: Saving data for 19791860: {'created_time': 1774814638.789313, 'last_price_update_time': 1774814638.789325, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19791860') HTTP/1.1" 204 0
2026-03-29 20:03:58 [motorway.uk] INFO: Found listing with ID: 19989124
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719989124%27 HTTP/1.1" 200 None
2026-03-29 20:03:58 [motorway.uk] INFO: Scrape type for 19989124: 1
2026-03-29 20:03:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:03:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93006d0>
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0909%252F18730909%252Finterior_front_seats-1774694313270.jpg') HTTP/1.1" 204 0
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0909/18730909/interior_front_seats-1774694313270.jpg saved to cache
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728
2026-03-29 20:03:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a08be9f3-0cbb-5cb1-823c-d195ebdb2728, skipping ID generation
2026-03-29 20:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728 with scrape type 1
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a08be9f3-0cbb-5cb1-823c-d195ebdb2728 sending to next pipeline
2026-03-29 20:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a08be9f3-0cbb-5cb1-823c-d195ebdb2728, identifier: 18730909
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 20485342
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485342%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [motorway.uk] INFO: Scrape type for 20485342: 1
2026-03-29 20:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a08be9f3-0cbb-5cb1-823c-d195ebdb2728 with identifier: 18730909
2026-03-29 20:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a08be9f3-0cbb-5cb1-823c-d195ebdb2728 with identifier: 18730909
2026-03-29 20:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a08be9f3-0cbb-5cb1-823c-d195ebdb2728 with identifier: 18730909 to the API
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0909/18730909/interior_front_seats-1774694313270.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a08be9f3-0cbb-5cb1-823c-d195ebdb2728',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DY70 NWE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18730909',
'listing': 'auction',
'location': 'None None',
'make': 'Volvo',
'model': 'XC40',
'odometer': 36700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1721172,
'Height': 2635,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0909/18730909/exterior_front_driver-1774692839507.jpg',
'Width': 3513},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2552863,
'Height': 2835,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0909/18730909/exterior_rear_driver-1774787225532.jpg',
'Width': 3780},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1609839,
'Height': 2662,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0909/18730909/exterior_front_passenger-1774692991214.jpg',
'Width': 3549},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1535575,
'Height': 2498,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0909/18730909/exterior_rear_passenger-1774692978909.jpg',
'Width': 3330},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3508929,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0909/18730909/interior_front_seats-1774694313270.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3482358,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0909/18730909/interior_rear_seats-1774694038325.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2379889,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0909/18730909/interior_dashboard-1774787243624.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3328015,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0909/18730909/instrument_cluster-1774694046874.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3229483,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0909/18730909/interior_boot-1774694153761.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08be9f3-0cbb-5cb1-823c-d195ebdb2728/a08be9f3-0cbb-5cb1-823c-d195ebdb2728_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324864,
'Height': 1732,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0909/18730909/docs_service_history-1774782593670.jpg?ixlib=js-3.8.0&auto=format&s=ff0a708f95dbb9923058f867a4849849',
'Width': 2778}],
'price': 18483,
'price_includes_vat': False,
'registration_date': '2020-12-30',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC40 Inscription PRO T3 Auto',
'transmission': 'automatic',
'trim': 'Inscription PRO T3 Auto',
'vin': 'YV1XZ15VDM2491971',
'year': 2020}
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718730909%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [motorway.uk] INFO: Saving data for 18730909: {'created_time': 1774814639.51409, 'last_price_update_time': 1774814639.514103, 'auction_closing_time': 1774884600.0}
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18730909') HTTP/1.1" 204 0
2026-03-29 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20131585.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 19346587
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 18465053
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 17446512
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717446512%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [motorway.uk] INFO: Scrape type for 17446512: 1
2026-03-29 20:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 19535676
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719535676%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [motorway.uk] INFO: Scrape type for 19535676: 1
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 20106291
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 18846555
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 19650847
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719650847%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [motorway.uk] INFO: Scrape type for 19650847: 1
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 16887046
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716887046%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [motorway.uk] INFO: Scrape type for 16887046: 1
2026-03-29 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1886/5611886/docs_service_history-1774691719394.jpg?ixlib=js-3.8.0&auto=format&s=881bba8e7c514e93d8808356e9780dad> (referer: None)
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 18297776
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 19443439
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 20249715
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 18285367
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 18824482
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 19548326
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 19976408
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719976408%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [motorway.uk] INFO: Scrape type for 19976408: 2
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 17967491
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717967491%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [motorway.uk] INFO: Scrape type for 17967491: 1
2026-03-29 20:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 416d60c4-97ce-55d8-af77-91eeff24665d with identifier: 20131585
2026-03-29 20:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 416d60c4-97ce-55d8-af77-91eeff24665d with scrape type 1
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 416d60c4-97ce-55d8-af77-91eeff24665d
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1585%252F20131585%252Fexterior_front_driver-1774689062262.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1585/20131585/exterior_front_driver-1774689062262.jpg not downloaded yet
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 8192755
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 20357594
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 20469292
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 20467785
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 20488132
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 20001461
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720001461%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [motorway.uk] INFO: Scrape type for 20001461: 1
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1585%252F20131585%252Fexterior_rear_driver-1773331182296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1585/20131585/exterior_rear_driver-1773331182296.jpg already downloaded
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1585%252F20131585%252Fexterior_front_passenger-1773331261760.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1585/20131585/exterior_front_passenger-1773331261760.jpg already downloaded
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1585%252F20131585%252Fexterior_rear_passenger-1773331188711.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1585/20131585/exterior_rear_passenger-1773331188711.jpg already downloaded
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1585%252F20131585%252Finterior_front_seats-1773331485949.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1585/20131585/interior_front_seats-1773331485949.jpg already downloaded
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1585%252F20131585%252Finterior_rear_seats-1773331503866.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1585/20131585/interior_rear_seats-1773331503866.jpg already downloaded
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1585%252F20131585%252Finterior_dashboard-1774688072690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1585/20131585/interior_dashboard-1774688072690.jpg not downloaded yet
2026-03-29 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0167/19950167/interior_dashboard-1774788701966.jpg> (referer: None)
2026-03-29 20:03:59 [motorway.uk] INFO: Found listing with ID: 19942570
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719942570%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [motorway.uk] INFO: Scrape type for 19942570: 1
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1585%252F20131585%252Finterior_boot-1773331543880.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1585/20131585/interior_boot-1773331543880.jpg already downloaded
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1585%252F20131585%252Fdocs_service_history-1773331695790.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5c95c5467c1b911ebfe7d5c5ec25f6c7%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1585/20131585/docs_service_history-1773331695790.jpg?ixlib=js-3.8.0&auto=format&s=5c95c5467c1b911ebfe7d5c5ec25f6c7 already downloaded
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1585%252F20131585%252Fdocs_service_history-1773331704127.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dacf9f746c648262e566b0c41490c5a23%27 HTTP/1.1" 200 None
2026-03-29 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1585/20131585/docs_service_history-1773331704127.jpg?ixlib=js-3.8.0&auto=format&s=acf9f746c648262e566b0c41490c5a23 not downloaded yet
2026-03-29 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90b9f90>
2026-03-29 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04b180c8-b29a-5d36-aa6a-3fc7d969e532/04b180c8-b29a-5d36-aa6a-3fc7d969e532_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1886%252F5611886%252Fdocs_service_history-1774691719394.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D881bba8e7c514e93d8808356e9780dad') HTTP/1.1" 204 0
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1886/5611886/docs_service_history-1774691719394.jpg?ixlib=js-3.8.0&auto=format&s=881bba8e7c514e93d8808356e9780dad saved to cache
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04b180c8-b29a-5d36-aa6a-3fc7d969e532
2026-03-29 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18507220.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a7fe10>
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150be165-5410-507b-8452-264acda1ac8c/150be165-5410-507b-8452-264acda1ac8c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0167%252F19950167%252Finterior_dashboard-1774788701966.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0167/19950167/interior_dashboard-1774788701966.jpg saved to cache
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 150be165-5410-507b-8452-264acda1ac8c
2026-03-29 20:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4052d588-31d6-55df-a2b0-993082d1263b with identifier: 18507220
2026-03-29 20:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4052d588-31d6-55df-a2b0-993082d1263b with scrape type 1
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4052d588-31d6-55df-a2b0-993082d1263b
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7220%252F18507220%252Fexterior_front_driver-1762950188123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7220/18507220/exterior_front_driver-1762950188123.jpg not downloaded yet
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7220%252F18507220%252Fexterior_rear_driver-1762950244899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7220/18507220/exterior_rear_driver-1762950244899.jpg not downloaded yet
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7220%252F18507220%252Fexterior_front_passenger-1762950213800.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7220/18507220/exterior_front_passenger-1762950213800.jpg not downloaded yet
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7220%252F18507220%252Fexterior_rear_passenger-1762950234420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7220/18507220/exterior_rear_passenger-1762950234420.jpg not downloaded yet
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7220%252F18507220%252Finterior_front_seats-1762950255615.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7220/18507220/interior_front_seats-1762950255615.jpg not downloaded yet
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7220%252F18507220%252Finterior_rear_seats-1762950322390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7220/18507220/interior_rear_seats-1762950322390.jpg not downloaded yet
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7220%252F18507220%252Finterior_dashboard-1762950359961.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7220/18507220/interior_dashboard-1762950359961.jpg not downloaded yet
2026-03-29 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6196/20386196/instrument_cluster-1774720159279.jpg> (referer: None)
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7220%252F18507220%252Finstrument_cluster-1774710837227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7220/18507220/instrument_cluster-1774710837227.jpg not downloaded yet
2026-03-29 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/5866923.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0167/19950167/instrument_cluster-1774723030997.jpg> (referer: None)
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7220%252F18507220%252Finterior_boot-1762950383571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7220/18507220/interior_boot-1762950383571.jpg not downloaded yet
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7220%252F18507220%252F18507220-docs_service_history-default-1774772529762.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59735ad9ddcc869b3d6bd4dff21ac357%27 HTTP/1.1" 200 None
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7220/18507220/18507220-docs_service_history-default-1774772529762.png?ixlib=js-3.8.0&auto=format&s=59735ad9ddcc869b3d6bd4dff21ac357 not downloaded yet
2026-03-29 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7040/20277040/instrument_cluster-1774784914307.jpg> (referer: None)
2026-03-29 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1886/5611886/interior_boot-1774691355301.jpg> (referer: None)
2026-03-29 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6196/20386196/interior_boot-1774720157808.jpg> (referer: None)
2026-03-29 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7040/20277040/interior_boot-1774784878165.jpg> (referer: None)
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d0810>
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_379fc8d0-371b-56b5-b1f3-cb45d663086f/379fc8d0-371b-56b5-b1f3-cb45d663086f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6196%252F20386196%252Finstrument_cluster-1774720159279.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6196/20386196/instrument_cluster-1774720159279.jpg saved to cache
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 379fc8d0-371b-56b5-b1f3-cb45d663086f
2026-03-29 20:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a6981cd-b242-5452-8198-c71d1a7f90df with identifier: 5866923
2026-03-29 20:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a6981cd-b242-5452-8198-c71d1a7f90df with scrape type 1
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a6981cd-b242-5452-8198-c71d1a7f90df
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6923%252F5866923%252Fexterior_front_driver-1774106097733.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6923/5866923/exterior_front_driver-1774106097733.jpg not downloaded yet
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f820d950>
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150be165-5410-507b-8452-264acda1ac8c/150be165-5410-507b-8452-264acda1ac8c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0167%252F19950167%252Finstrument_cluster-1774723030997.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0167/19950167/instrument_cluster-1774723030997.jpg saved to cache
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 150be165-5410-507b-8452-264acda1ac8c
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f881b450>
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fedbeebf-7cb0-555e-9941-3396c22a7245/fedbeebf-7cb0-555e-9941-3396c22a7245_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7040%252F20277040%252Finstrument_cluster-1774784914307.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7040/20277040/instrument_cluster-1774784914307.jpg saved to cache
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fedbeebf-7cb0-555e-9941-3396c22a7245
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9308bd0>
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04b180c8-b29a-5d36-aa6a-3fc7d969e532/04b180c8-b29a-5d36-aa6a-3fc7d969e532_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1886%252F5611886%252Finterior_boot-1774691355301.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1886/5611886/interior_boot-1774691355301.jpg saved to cache
2026-03-29 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04b180c8-b29a-5d36-aa6a-3fc7d969e532
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f930a190>
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_379fc8d0-371b-56b5-b1f3-cb45d663086f/379fc8d0-371b-56b5-b1f3-cb45d663086f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6196%252F20386196%252Finterior_boot-1774720157808.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6196/20386196/interior_boot-1774720157808.jpg saved to cache
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 379fc8d0-371b-56b5-b1f3-cb45d663086f
2026-03-29 20:04:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e6c5d0>
2026-03-29 20:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fedbeebf-7cb0-555e-9941-3396c22a7245/fedbeebf-7cb0-555e-9941-3396c22a7245_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7040%252F20277040%252Finterior_boot-1774784878165.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7040/20277040/interior_boot-1774784878165.jpg saved to cache
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fedbeebf-7cb0-555e-9941-3396c22a7245
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6923%252F5866923%252Fexterior_rear_driver-1774106016120.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6923/5866923/exterior_rear_driver-1774106016120.jpg not downloaded yet
2026-03-29 20:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20396560.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6923%252F5866923%252Fexterior_front_passenger-1774106052956.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6923/5866923/exterior_front_passenger-1774106052956.jpg not downloaded yet
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6923%252F5866923%252Fexterior_rear_passenger-1774106035108.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6923/5866923/exterior_rear_passenger-1774106035108.jpg not downloaded yet
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6923%252F5866923%252Finterior_front_seats-1774106577697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6923/5866923/interior_front_seats-1774106577697.jpg not downloaded yet
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6923%252F5866923%252Finterior_rear_seats-1774106651177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6923/5866923/interior_rear_seats-1774106651177.jpg not downloaded yet
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6923%252F5866923%252Finterior_dashboard-1774106726665.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6923/5866923/interior_dashboard-1774106726665.jpg not downloaded yet
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6923%252F5866923%252Finstrument_cluster-1774106651557.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6923/5866923/instrument_cluster-1774106651557.jpg not downloaded yet
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6923%252F5866923%252Finterior_boot-1774106744184.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6923/5866923/interior_boot-1774106744184.jpg not downloaded yet
2026-03-29 20:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e83713ab-6a6b-5504-a9bf-bb9181e874cf with identifier: 20396560
2026-03-29 20:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e83713ab-6a6b-5504-a9bf-bb9181e874cf with scrape type 1
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e83713ab-6a6b-5504-a9bf-bb9181e874cf
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6560%252F20396560%252Fexterior_front_driver-1774696126192.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_front_driver-1774696126192.jpg not downloaded yet
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6923%252F5866923%252Fwheels_front_driver-1774106201689.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6923/5866923/wheels_front_driver-1774106201689.jpg not downloaded yet
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6560%252F20396560%252Fexterior_rear_driver-1774695938213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_rear_driver-1774695938213.jpg not downloaded yet
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6560%252F20396560%252Fexterior_front_passenger-1774696017473.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_front_passenger-1774696017473.jpg not downloaded yet
2026-03-29 20:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20191585.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1585/20131585/interior_dashboard-1774688072690.jpg> (referer: None)
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6560%252F20396560%252Fexterior_rear_passenger-1774696010697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_rear_passenger-1774696010697.jpg not downloaded yet
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6560%252F20396560%252Finterior_front_seats-1774696972430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6560/20396560/interior_front_seats-1774696972430.jpg not downloaded yet
2026-03-29 20:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7220/18507220/18507220-docs_service_history-default-1774772529762.png?ixlib=js-3.8.0&auto=format&s=59735ad9ddcc869b3d6bd4dff21ac357> (referer: None)
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6560%252F20396560%252Finterior_rear_seats-1774696996010.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6560/20396560/interior_rear_seats-1774696996010.jpg not downloaded yet
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6560%252F20396560%252Finterior_dashboard-1774697035931.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6560/20396560/interior_dashboard-1774697035931.jpg not downloaded yet
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6560%252F20396560%252Finterior_boot-1774697037064.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6560/20396560/interior_boot-1774697037064.jpg not downloaded yet
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6560%252F20396560%252Fdocs_service_history-1774698919895.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc233cb8084503c56a9e5c7745a44b0a9%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6560/20396560/docs_service_history-1774698919895.jpg?ixlib=js-3.8.0&auto=format&s=c233cb8084503c56a9e5c7745a44b0a9 not downloaded yet
2026-03-29 20:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f3e7921-0cc4-5cfe-a87d-53dd23940d3e with identifier: 20191585
2026-03-29 20:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f3e7921-0cc4-5cfe-a87d-53dd23940d3e with scrape type 1
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f3e7921-0cc4-5cfe-a87d-53dd23940d3e
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1585%252F20191585%252Fexterior_front_driver-1773231380403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1585/20191585/exterior_front_driver-1773231380403.jpg already downloaded
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1585%252F20191585%252Fexterior_rear_driver-1773231369223.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1585/20191585/exterior_rear_driver-1773231369223.jpg already downloaded
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1585%252F20191585%252Fexterior_front_passenger-1773231622289.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1585/20191585/exterior_front_passenger-1773231622289.jpg already downloaded
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1585%252F20191585%252Fexterior_rear_passenger-1773223471014.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1585/20191585/exterior_rear_passenger-1773223471014.jpg already downloaded
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1585%252F20191585%252Finterior_front_seats-1773231663434.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1585/20191585/interior_front_seats-1773231663434.jpg already downloaded
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1585%252F20191585%252Finterior_rear_seats-1773231305952.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1585/20191585/interior_rear_seats-1773231305952.jpg already downloaded
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1585%252F20191585%252Finterior_dashboard-1773231289811.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1585/20191585/interior_dashboard-1773231289811.jpg already downloaded
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1585%252F20191585%252Finterior_boot-1773223888678.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1585/20191585/interior_boot-1773223888678.jpg already downloaded
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1585%252F20191585%252Fdocs_service_history-1773224452811.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbdbfcf8ca89ae265b6ef90028b11cab5%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1585/20191585/docs_service_history-1773224452811.jpg?ixlib=js-3.8.0&auto=format&s=bdbfcf8ca89ae265b6ef90028b11cab5 already downloaded
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1585%252F20191585%252Fdocs_service_history-1773224457012.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D73ac3b66920be37ef7fa6332265074d1%27 HTTP/1.1" 200 None
2026-03-29 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1585/20191585/docs_service_history-1773224457012.jpg?ixlib=js-3.8.0&auto=format&s=73ac3b66920be37ef7fa6332265074d1 already downloaded
2026-03-29 20:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8f3e7921-0cc4-5cfe-a87d-53dd23940d3e, identifier: 20191585
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9049610>
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_416d60c4-97ce-55d8-af77-91eeff24665d/416d60c4-97ce-55d8-af77-91eeff24665d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1585%252F20131585%252Finterior_dashboard-1774688072690.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1585/20131585/interior_dashboard-1774688072690.jpg saved to cache
2026-03-29 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 416d60c4-97ce-55d8-af77-91eeff24665d
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6560%252F20396560%252Fdocs_service_history-1774707724447.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D006b2ffac7b884be7ec25bbc4afe87c2%27 HTTP/1.1" 200 None
2026-03-29 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6560/20396560/docs_service_history-1774707724447.jpg?ixlib=js-3.8.0&auto=format&s=006b2ffac7b884be7ec25bbc4afe87c2 not downloaded yet
2026-03-29 20:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8f3e7921-0cc4-5cfe-a87d-53dd23940d3e with identifier: 20191585
2026-03-29 20:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8f3e7921-0cc4-5cfe-a87d-53dd23940d3e with identifier: 20191585
2026-03-29 20:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8f3e7921-0cc4-5cfe-a87d-53dd23940d3e with identifier: 20191585 to the API
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20191585.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '8f3e7921-0cc4-5cfe-a87d-53dd23940d3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WV22 WBM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20191585',
'listing': 'auction',
'location': 'Hertfordshire Welwyn Garden City',
'make': 'Toyota',
'model': 'Corolla',
'odometer': 22848,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-modified.imgix.net/1585/20191585/exterior_front_driver-1773231380403.jpg',
'https://motorway-photos-modified.imgix.net/1585/20191585/exterior_rear_driver-1773231369223.jpg',
'https://motorway-photos-modified.imgix.net/1585/20191585/exterior_front_passenger-1773231622289.jpg',
'https://motorway-photos-redacted.imgix.net/1585/20191585/exterior_rear_passenger-1773223471014.jpg',
'https://motorway-photos-modified.imgix.net/1585/20191585/interior_front_seats-1773231663434.jpg',
'https://motorway-photos-modified.imgix.net/1585/20191585/interior_rear_seats-1773231305952.jpg',
'https://motorway-photos-modified.imgix.net/1585/20191585/interior_dashboard-1773231289811.jpg',
'https://motorway-photos.imgix.net/1585/20191585/interior_boot-1773223888678.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/1585/20191585/docs_service_history-1773224452811.jpg?ixlib=js-3.8.0&auto=format&s=bdbfcf8ca89ae265b6ef90028b11cab5',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/1585/20191585/docs_service_history-1773224457012.jpg?ixlib=js-3.8.0&auto=format&s=73ac3b66920be37ef7fa6332265074d1'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e7921-0cc4-5cfe-a87d-53dd23940d3e/8f3e7921-0cc4-5cfe-a87d-53dd23940d3e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1472358,
'Height': 2062,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1585/20191585/exterior_front_driver-1773231380403.jpg',
'Width': 2749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e7921-0cc4-5cfe-a87d-53dd23940d3e/8f3e7921-0cc4-5cfe-a87d-53dd23940d3e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1920361,
'Height': 2541,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1585/20191585/exterior_rear_driver-1773231369223.jpg',
'Width': 3388},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e7921-0cc4-5cfe-a87d-53dd23940d3e/8f3e7921-0cc4-5cfe-a87d-53dd23940d3e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1607782,
'Height': 2201,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1585/20191585/exterior_front_passenger-1773231622289.jpg',
'Width': 2935},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e7921-0cc4-5cfe-a87d-53dd23940d3e/8f3e7921-0cc4-5cfe-a87d-53dd23940d3e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1844643,
'Height': 2743,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1585/20191585/exterior_rear_passenger-1773223471014.jpg',
'Width': 3657},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e7921-0cc4-5cfe-a87d-53dd23940d3e/8f3e7921-0cc4-5cfe-a87d-53dd23940d3e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2922722,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1585/20191585/interior_front_seats-1773231663434.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e7921-0cc4-5cfe-a87d-53dd23940d3e/8f3e7921-0cc4-5cfe-a87d-53dd23940d3e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3127560,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1585/20191585/interior_rear_seats-1773231305952.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e7921-0cc4-5cfe-a87d-53dd23940d3e/8f3e7921-0cc4-5cfe-a87d-53dd23940d3e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2599063,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1585/20191585/interior_dashboard-1773231289811.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e7921-0cc4-5cfe-a87d-53dd23940d3e/8f3e7921-0cc4-5cfe-a87d-53dd23940d3e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3348813,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1585/20191585/interior_boot-1773223888678.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e7921-0cc4-5cfe-a87d-53dd23940d3e/8f3e7921-0cc4-5cfe-a87d-53dd23940d3e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510498,
'Height': 2556,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1585/20191585/docs_service_history-1773224452811.jpg?ixlib=js-3.8.0&auto=format&s=bdbfcf8ca89ae265b6ef90028b11cab5',
'Width': 1179},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3e7921-0cc4-5cfe-a87d-53dd23940d3e/8f3e7921-0cc4-5cfe-a87d-53dd23940d3e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 545497,
'Height': 2556,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1585/20191585/docs_service_history-1773224457012.jpg?ixlib=js-3.8.0&auto=format&s=73ac3b66920be37ef7fa6332265074d1',
'Width': 1179}],
'price': 15150,
'price_includes_vat': False,
'registration_date': '2022-05-20',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Corolla Icon Tech HEV CVT',
'transmission': 'automatic',
'trim': 'Icon Tech HEV CVT',
'vin': 'SB1K93BE80E300417',
'year': 2022}
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720191585%27 HTTP/1.1" 200 None
2026-03-29 20:04:02 [motorway.uk] INFO: Saving data for 20191585: {'created_time': 1774814642.601262, 'last_price_update_time': 1774814642.601273, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20191585') HTTP/1.1" 204 0
2026-03-29 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6923/5866923/exterior_rear_driver-1774106016120.jpg> (referer: None)
2026-03-29 20:04:02 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:04:02 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 65445
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfb6dd0>
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4052d588-31d6-55df-a2b0-993082d1263b/4052d588-31d6-55df-a2b0-993082d1263b_image_9.png HTTP/1.1" 201 0
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7220%252F18507220%252F18507220-docs_service_history-default-1774772529762.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59735ad9ddcc869b3d6bd4dff21ac357') HTTP/1.1" 204 0
2026-03-29 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7220/18507220/18507220-docs_service_history-default-1774772529762.png?ixlib=js-3.8.0&auto=format&s=59735ad9ddcc869b3d6bd4dff21ac357 saved to cache
2026-03-29 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4052d588-31d6-55df-a2b0-993082d1263b
2026-03-29 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6923/5866923/exterior_front_driver-1774106097733.jpg> (referer: None)
2026-03-29 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7220/18507220/interior_rear_seats-1762950322390.jpg> (referer: None)
2026-03-29 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_front_passenger-1774696017473.jpg> (referer: None)
2026-03-29 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_rear_driver-1774695938213.jpg> (referer: None)
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faceb850>
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a6981cd-b242-5452-8198-c71d1a7f90df/3a6981cd-b242-5452-8198-c71d1a7f90df_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6923%252F5866923%252Fexterior_rear_driver-1774106016120.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6923/5866923/exterior_rear_driver-1774106016120.jpg saved to cache
2026-03-29 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a6981cd-b242-5452-8198-c71d1a7f90df
2026-03-29 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=648&page=18&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9077250>
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a6981cd-b242-5452-8198-c71d1a7f90df/3a6981cd-b242-5452-8198-c71d1a7f90df_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6923%252F5866923%252Fexterior_front_driver-1774106097733.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6923/5866923/exterior_front_driver-1774106097733.jpg saved to cache
2026-03-29 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a6981cd-b242-5452-8198-c71d1a7f90df
2026-03-29 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2025:11:12 12:25:19\x00'
2026-03-29 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S921B\x00'
2026-03-29 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S921BXXSACYJ7\x00'
2026-03-29 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9217f50>
2026-03-29 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4052d588-31d6-55df-a2b0-993082d1263b/4052d588-31d6-55df-a2b0-993082d1263b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7220%252F18507220%252Finterior_rear_seats-1762950322390.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7220/18507220/interior_rear_seats-1762950322390.jpg saved to cache
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4052d588-31d6-55df-a2b0-993082d1263b
2026-03-29 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20476322.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19989124.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a10350>
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6560%252F20396560%252Fexterior_front_passenger-1774696017473.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_front_passenger-1774696017473.jpg saved to cache
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e83713ab-6a6b-5504-a9bf-bb9181e874cf
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa0a650>
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6560%252F20396560%252Fexterior_rear_driver-1774695938213.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_rear_driver-1774695938213.jpg saved to cache
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e83713ab-6a6b-5504-a9bf-bb9181e874cf
2026-03-29 20:04:03 [motorway.uk] INFO: Found listing with ID: 18832294
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718832294%27 HTTP/1.1" 200 None
2026-03-29 20:04:03 [motorway.uk] INFO: Scrape type for 18832294: 1
2026-03-29 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6560/20396560/interior_front_seats-1774696972430.jpg> (referer: None)
2026-03-29 20:04:03 [motorway.uk] INFO: Found listing with ID: 20381843
2026-03-29 20:04:03 [motorway.uk] INFO: Found listing with ID: 20258462
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720258462%27 HTTP/1.1" 200 None
2026-03-29 20:04:03 [motorway.uk] INFO: Scrape type for 20258462: 2
2026-03-29 20:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6560/20396560/docs_service_history-1774698919895.jpg?ixlib=js-3.8.0&auto=format&s=c233cb8084503c56a9e5c7745a44b0a9> (referer: None)
2026-03-29 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7220/18507220/instrument_cluster-1774710837227.jpg> (referer: None)
2026-03-29 20:04:03 [motorway.uk] INFO: Found listing with ID: 18895198
2026-03-29 20:04:03 [motorway.uk] INFO: Found listing with ID: 20482892
2026-03-29 20:04:03 [motorway.uk] INFO: Found listing with ID: 20403490
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720403490%27 HTTP/1.1" 200 None
2026-03-29 20:04:03 [motorway.uk] INFO: Scrape type for 20403490: 1
2026-03-29 20:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e210f682-15a4-588b-ae7a-b8332ac730bf with identifier: 20476322
2026-03-29 20:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e210f682-15a4-588b-ae7a-b8332ac730bf with scrape type 1
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e210f682-15a4-588b-ae7a-b8332ac730bf
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6322%252F20476322%252Fexterior_front_driver-1774784982783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_front_driver-1774784982783.jpg not downloaded yet
2026-03-29 20:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd with identifier: 19989124
2026-03-29 20:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd with scrape type 1
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9124%252F19989124%252Fexterior_front_driver-1774705302435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9124/19989124/exterior_front_driver-1774705302435.jpg not downloaded yet
2026-03-29 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6560/20396560/docs_service_history-1774707724447.jpg?ixlib=js-3.8.0&auto=format&s=006b2ffac7b884be7ec25bbc4afe87c2> (referer: None)
2026-03-29 20:04:03 [motorway.uk] INFO: Found listing with ID: 16057618
2026-03-29 20:04:03 [motorway.uk] INFO: Found listing with ID: 17828032
2026-03-29 20:04:03 [motorway.uk] INFO: Found listing with ID: 19514884
2026-03-29 20:04:03 [motorway.uk] INFO: Found listing with ID: 20140691
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720140691%27 HTTP/1.1" 200 None
2026-03-29 20:04:03 [motorway.uk] INFO: Scrape type for 20140691: 1
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6322%252F20476322%252Fexterior_rear_driver-1774785029179.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_rear_driver-1774785029179.jpg not downloaded yet
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9124%252F19989124%252Fexterior_rear_driver-1774701563093.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9124/19989124/exterior_rear_driver-1774701563093.jpg not downloaded yet
2026-03-29 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7220/18507220/interior_dashboard-1762950359961.jpg> (referer: None)
2026-03-29 20:04:03 [motorway.uk] INFO: Found listing with ID: 20484845
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484845%27 HTTP/1.1" 200 None
2026-03-29 20:04:03 [motorway.uk] INFO: Scrape type for 20484845: 1
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6322%252F20476322%252Fexterior_front_passenger-1774785105692.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_front_passenger-1774785105692.jpg not downloaded yet
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9124%252F19989124%252Fexterior_front_passenger-1774701561174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9124/19989124/exterior_front_passenger-1774701561174.jpg not downloaded yet
2026-03-29 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485342.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20239538.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7220/18507220/interior_front_seats-1762950255615.jpg> (referer: None)
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f912e210>
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6560%252F20396560%252Finterior_front_seats-1774696972430.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6560/20396560/interior_front_seats-1774696972430.jpg saved to cache
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e83713ab-6a6b-5504-a9bf-bb9181e874cf
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8275ed0>
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6560%252F20396560%252Fdocs_service_history-1774698919895.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc233cb8084503c56a9e5c7745a44b0a9') HTTP/1.1" 204 0
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6560/20396560/docs_service_history-1774698919895.jpg?ixlib=js-3.8.0&auto=format&s=c233cb8084503c56a9e5c7745a44b0a9 saved to cache
2026-03-29 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e83713ab-6a6b-5504-a9bf-bb9181e874cf
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2026:03:28 15:11:40\x00'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S921B\x00'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S921BXXSDCZB2\x00'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:04:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89e9c90>
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4052d588-31d6-55df-a2b0-993082d1263b/4052d588-31d6-55df-a2b0-993082d1263b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7220%252F18507220%252Finstrument_cluster-1774710837227.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7220/18507220/instrument_cluster-1774710837227.jpg saved to cache
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4052d588-31d6-55df-a2b0-993082d1263b
2026-03-29 20:04:04 [motorway.uk] INFO: Found listing with ID: 20376881
2026-03-29 20:04:04 [motorway.uk] INFO: Found listing with ID: 20297983
2026-03-29 20:04:04 [motorway.uk] INFO: Found listing with ID: 20488223
2026-03-29 20:04:04 [motorway.uk] INFO: Found listing with ID: 20471931
2026-03-29 20:04:04 [motorway.uk] INFO: Found listing with ID: 20493721
2026-03-29 20:04:04 [motorway.uk] INFO: Found listing with ID: 20422784
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720422784%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [motorway.uk] INFO: Scrape type for 20422784: 1
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6322%252F20476322%252Fexterior_rear_passenger-1774785058149.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_rear_passenger-1774785058149.jpg not downloaded yet
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9124%252F19989124%252Fexterior_rear_passenger-1774701562124.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9124/19989124/exterior_rear_passenger-1774701562124.jpg not downloaded yet
2026-03-29 20:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19650847.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf056d0>
2026-03-29 20:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6560%252F20396560%252Fdocs_service_history-1774707724447.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D006b2ffac7b884be7ec25bbc4afe87c2') HTTP/1.1" 204 0
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6560/20396560/docs_service_history-1774707724447.jpg?ixlib=js-3.8.0&auto=format&s=006b2ffac7b884be7ec25bbc4afe87c2 saved to cache
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e83713ab-6a6b-5504-a9bf-bb9181e874cf
2026-03-29 20:04:04 [motorway.uk] INFO: Found listing with ID: 3287660
2026-03-29 20:04:04 [motorway.uk] INFO: Found listing with ID: 16290111
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716290111%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [motorway.uk] INFO: Scrape type for 16290111: 1
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6322%252F20476322%252Finterior_front_seats-1774786163525.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6322/20476322/interior_front_seats-1774786163525.jpg not downloaded yet
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9124%252F19989124%252Finterior_front_seats-1774702100868.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9124/19989124/interior_front_seats-1774702100868.jpg not downloaded yet
2026-03-29 20:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7220/18507220/interior_boot-1762950383571.jpg> (referer: None)
2026-03-29 20:04:04 [motorway.uk] INFO: Found listing with ID: 14508639
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714508639%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [motorway.uk] INFO: Scrape type for 14508639: 1
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6322%252F20476322%252Finterior_rear_seats-1774786184815.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6322/20476322/interior_rear_seats-1774786184815.jpg not downloaded yet
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9124%252F19989124%252Finterior_rear_seats-1774702127394.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9124/19989124/interior_rear_seats-1774702127394.jpg not downloaded yet
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2025:11:12 12:25:56\x00'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S921B\x00'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S921BXXSACYJ7\x00'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f895c710>
2026-03-29 20:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4052d588-31d6-55df-a2b0-993082d1263b/4052d588-31d6-55df-a2b0-993082d1263b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7220%252F18507220%252Finterior_dashboard-1762950359961.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7220/18507220/interior_dashboard-1762950359961.jpg saved to cache
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4052d588-31d6-55df-a2b0-993082d1263b
2026-03-29 20:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fc016cb-3abc-5eb1-9666-840a2d00fe00 with identifier: 20485342
2026-03-29 20:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00 with scrape type 1
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5342%252F20485342%252Fexterior_front_driver-1774780445015.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_front_driver-1774780445015.jpg not downloaded yet
2026-03-29 20:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc0534ad-03e3-53a8-914c-e3e2dca2be8e with identifier: 20239538
2026-03-29 20:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e with scrape type 1
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9538%252F20239538%252Fexterior_front_driver-1774702258994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_front_driver-1774702258994.jpg not downloaded yet
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2025:11:12 12:24:12\x00'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S921B\x00'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S921BXXSACYJ7\x00'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf28a50>
2026-03-29 20:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4052d588-31d6-55df-a2b0-993082d1263b/4052d588-31d6-55df-a2b0-993082d1263b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7220%252F18507220%252Finterior_front_seats-1762950255615.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7220/18507220/interior_front_seats-1762950255615.jpg saved to cache
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4052d588-31d6-55df-a2b0-993082d1263b
2026-03-29 20:04:04 [motorway.uk] INFO: Found listing with ID: 18349158
2026-03-29 20:04:04 [motorway.uk] INFO: Found listing with ID: 5286387
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275286387%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [motorway.uk] INFO: Scrape type for 5286387: 1
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6322%252F20476322%252Finterior_dashboard-1774786292691.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6322/20476322/interior_dashboard-1774786292691.jpg not downloaded yet
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9124%252F19989124%252Finterior_dashboard-1774702953070.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9124/19989124/interior_dashboard-1774702953070.jpg not downloaded yet
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5342%252F20485342%252Fexterior_rear_driver-1774780619710.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_rear_driver-1774780619710.jpg not downloaded yet
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9538%252F20239538%252Fexterior_rear_driver-1774702337298.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_rear_driver-1774702337298.jpg not downloaded yet
2026-03-29 20:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d67996-4562-5447-92ee-1e8f1a1ac9c4 with identifier: 19650847
2026-03-29 20:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d67996-4562-5447-92ee-1e8f1a1ac9c4 with scrape type 1
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18d67996-4562-5447-92ee-1e8f1a1ac9c4
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0847%252F19650847%252Fexterior_front_driver-1772983603252.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0847/19650847/exterior_front_driver-1772983603252.jpg already downloaded
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0847%252F19650847%252Fexterior_rear_driver-1772983633882.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0847/19650847/exterior_rear_driver-1772983633882.jpg already downloaded
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0847%252F19650847%252Fexterior_front_passenger-1772983662491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0847/19650847/exterior_front_passenger-1772983662491.jpg already downloaded
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0847%252F19650847%252Fexterior_rear_passenger-1772983601919.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0847/19650847/exterior_rear_passenger-1772983601919.jpg already downloaded
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0847%252F19650847%252Finterior_front_seats-1772991333548.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0847/19650847/interior_front_seats-1772991333548.jpg already downloaded
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0847%252F19650847%252Finterior_rear_seats-1772991359907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0847/19650847/interior_rear_seats-1772991359907.jpg already downloaded
2026-03-29 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0847%252F19650847%252Finterior_dashboard-1773401149165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0847/19650847/interior_dashboard-1773401149165.jpg already downloaded
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0847%252F19650847%252Finstrument_cluster-1773401031781.png%27 HTTP/1.1" 200 None
2026-03-29 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0847/19650847/instrument_cluster-1773401031781.png already downloaded
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0847%252F19650847%252Finterior_boot-1772991450402.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0847/19650847/interior_boot-1772991450402.jpg already downloaded
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0847%252F19650847%252Fdocs_service_history-1773393822121.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3e7707ed2c6dd2780141ae8eba1eb20a%27 HTTP/1.1" 200 None
2026-03-29 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0847/19650847/docs_service_history-1773393822121.jpg?ixlib=js-3.8.0&auto=format&s=3e7707ed2c6dd2780141ae8eba1eb20a already downloaded
2026-03-29 20:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 18d67996-4562-5447-92ee-1e8f1a1ac9c4, identifier: 19650847
2026-03-29 20:04:05 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:04:05 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:04:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:05 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2025:11:12 12:26:20\x00'
2026-03-29 20:04:05 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:04:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:05 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:04:05 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S921B\x00'
2026-03-29 20:04:05 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S921BXXSACYJ7\x00'
2026-03-29 20:04:05 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:04:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fade0e10>
2026-03-29 20:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4052d588-31d6-55df-a2b0-993082d1263b/4052d588-31d6-55df-a2b0-993082d1263b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7220%252F18507220%252Finterior_boot-1762950383571.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7220/18507220/interior_boot-1762950383571.jpg saved to cache
2026-03-29 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4052d588-31d6-55df-a2b0-993082d1263b
2026-03-29 20:04:05 [scrapy.extensions.logstats] INFO: Crawled 168 pages (at 41 pages/min), scraped 95 items (at 26 items/min)
2026-03-29 20:04:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 300MiB
2026-03-29 20:04:05 [motorway.uk] INFO: Found listing with ID: 17747789
2026-03-29 20:04:05 [motorway.uk] INFO: Found listing with ID: 20215364
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720215364%27 HTTP/1.1" 200 None
2026-03-29 20:04:05 [motorway.uk] INFO: Scrape type for 20215364: 1
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6322%252F20476322%252Finstrument_cluster-1774786435600.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6322/20476322/instrument_cluster-1774786435600.jpg not downloaded yet
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9124%252F19989124%252Finstrument_cluster-1774702165033.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9124/19989124/instrument_cluster-1774702165033.jpg not downloaded yet
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5342%252F20485342%252Fexterior_front_passenger-1774780447563.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_front_passenger-1774780447563.jpg not downloaded yet
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9538%252F20239538%252Fexterior_front_passenger-1774702445347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_front_passenger-1774702445347.jpg not downloaded yet
2026-03-29 20:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 18d67996-4562-5447-92ee-1e8f1a1ac9c4 with identifier: 19650847
2026-03-29 20:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 18d67996-4562-5447-92ee-1e8f1a1ac9c4 with identifier: 19650847
2026-03-29 20:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 18d67996-4562-5447-92ee-1e8f1a1ac9c4 with identifier: 19650847 to the API
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19650847.json>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '18d67996-4562-5447-92ee-1e8f1a1ac9c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OW19 UXX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19650847',
'listing': 'auction',
'location': 'Derbyshire Glossop',
'make': 'Jaguar',
'model': 'E-PACE',
'odometer': 78850,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/0847/19650847/exterior_front_driver-1772983603252.jpg',
'https://motorway-photos-redacted.imgix.net/0847/19650847/exterior_rear_driver-1772983633882.jpg',
'https://motorway-photos-redacted.imgix.net/0847/19650847/exterior_front_passenger-1772983662491.jpg',
'https://motorway-photos-redacted.imgix.net/0847/19650847/exterior_rear_passenger-1772983601919.jpg',
'https://motorway-photos.imgix.net/0847/19650847/interior_front_seats-1772991333548.jpg',
'https://motorway-photos.imgix.net/0847/19650847/interior_rear_seats-1772991359907.jpg',
'https://motorway-photos-modified.imgix.net/0847/19650847/interior_dashboard-1773401149165.jpg',
'https://motorway-photos.imgix.net/0847/19650847/instrument_cluster-1773401031781.png',
'https://motorway-photos.imgix.net/0847/19650847/interior_boot-1772991450402.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/0847/19650847/docs_service_history-1773393822121.jpg?ixlib=js-3.8.0&auto=format&s=3e7707ed2c6dd2780141ae8eba1eb20a'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d67996-4562-5447-92ee-1e8f1a1ac9c4/18d67996-4562-5447-92ee-1e8f1a1ac9c4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2206042,
'Height': 2936,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0847/19650847/exterior_front_driver-1772983603252.jpg',
'Width': 3914},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d67996-4562-5447-92ee-1e8f1a1ac9c4/18d67996-4562-5447-92ee-1e8f1a1ac9c4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1381015,
'Height': 2500,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0847/19650847/exterior_rear_driver-1772983633882.jpg',
'Width': 3333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d67996-4562-5447-92ee-1e8f1a1ac9c4/18d67996-4562-5447-92ee-1e8f1a1ac9c4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1293026,
'Height': 2383,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0847/19650847/exterior_front_passenger-1772983662491.jpg',
'Width': 3177},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d67996-4562-5447-92ee-1e8f1a1ac9c4/18d67996-4562-5447-92ee-1e8f1a1ac9c4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1516908,
'Height': 2580,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0847/19650847/exterior_rear_passenger-1772983601919.jpg',
'Width': 3440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d67996-4562-5447-92ee-1e8f1a1ac9c4/18d67996-4562-5447-92ee-1e8f1a1ac9c4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3469063,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0847/19650847/interior_front_seats-1772991333548.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d67996-4562-5447-92ee-1e8f1a1ac9c4/18d67996-4562-5447-92ee-1e8f1a1ac9c4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3354360,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0847/19650847/interior_rear_seats-1772991359907.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d67996-4562-5447-92ee-1e8f1a1ac9c4/18d67996-4562-5447-92ee-1e8f1a1ac9c4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2891084,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0847/19650847/interior_dashboard-1773401149165.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d67996-4562-5447-92ee-1e8f1a1ac9c4/18d67996-4562-5447-92ee-1e8f1a1ac9c4_image_7.png',
'Extension': 'png',
'FileSizeInBytes': 488237,
'Height': 420,
'OriginUrl': 'https://motorway-photos.imgix.net/0847/19650847/instrument_cluster-1773401031781.png',
'Width': 761},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d67996-4562-5447-92ee-1e8f1a1ac9c4/18d67996-4562-5447-92ee-1e8f1a1ac9c4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3020675,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0847/19650847/interior_boot-1772991450402.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18d67996-4562-5447-92ee-1e8f1a1ac9c4/18d67996-4562-5447-92ee-1e8f1a1ac9c4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538476,
'Height': 1835,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0847/19650847/docs_service_history-1773393822121.jpg?ixlib=js-3.8.0&auto=format&s=3e7707ed2c6dd2780141ae8eba1eb20a',
'Width': 2637}],
'price': 10551,
'price_includes_vat': False,
'registration_date': '2019-06-17',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar E-PACE R-DYNAMIC SE D AWD',
'transmission': 'automatic',
'trim': 'R-DYNAMIC SE D AWD',
'vin': 'SADFA2AN5K1Z66990',
'year': 2019}
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719650847%27 HTTP/1.1" 200 None
2026-03-29 20:04:05 [motorway.uk] INFO: Saving data for 19650847: {'created_time': 1774814645.852082, 'last_price_update_time': 1774814645.852093, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19650847') HTTP/1.1" 204 0
2026-03-29 20:04:05 [motorway.uk] INFO: Found listing with ID: 20407647
2026-03-29 20:04:05 [motorway.uk] INFO: Found listing with ID: 20115042
2026-03-29 20:04:05 [motorway.uk] INFO: Found listing with ID: 11558331
2026-03-29 20:04:05 [motorway.uk] INFO: Found listing with ID: 18342530
2026-03-29 20:04:05 [motorway.uk] INFO: Found listing with ID: 12851017
2026-03-29 20:04:05 [motorway.uk] INFO: Found listing with ID: 20248084
2026-03-29 20:04:05 [motorway.uk] INFO: Found listing with ID: 15064019
2026-03-29 20:04:05 [motorway.uk] INFO: Found listing with ID: 16160235
2026-03-29 20:04:05 [motorway.uk] INFO: Found listing with ID: 3081875
2026-03-29 20:04:05 [motorway.uk] INFO: Found listing with ID: 20429308
2026-03-29 20:04:05 [motorway.uk] INFO: Found listing with ID: 20485771
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485771%27 HTTP/1.1" 200 None
2026-03-29 20:04:05 [motorway.uk] INFO: Scrape type for 20485771: 1
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6322%252F20476322%252Finterior_boot-1774786242113.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6322/20476322/interior_boot-1774786242113.jpg not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9124%252F19989124%252Finterior_boot-1774702076255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9124/19989124/interior_boot-1774702076255.jpg not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5342%252F20485342%252Fexterior_rear_passenger-1774780428074.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_rear_passenger-1774780428074.jpg not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9538%252F20239538%252Fexterior_rear_passenger-1774702405080.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_rear_passenger-1774702405080.jpg not downloaded yet
2026-03-29 20:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:06 [motorway.uk] INFO: Found listing with ID: 18505969
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6322%252F20476322%252Fdocs_service_history-1774786767104.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9dc7b20f53dbe38d58162c8c7aa439de%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6322/20476322/docs_service_history-1774786767104.jpg?ixlib=js-3.8.0&auto=format&s=9dc7b20f53dbe38d58162c8c7aa439de not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9124%252F19989124%252Fdocs_service_history-1774703278095.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc5b4b67d77c598ead8d3fb2c2e311f3b%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9124/19989124/docs_service_history-1774703278095.jpg?ixlib=js-3.8.0&auto=format&s=c5b4b67d77c598ead8d3fb2c2e311f3b not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5342%252F20485342%252Finterior_front_seats-1774781354688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5342/20485342/interior_front_seats-1774781354688.jpg not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9538%252F20239538%252Finterior_front_seats-1774703645542.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9538/20239538/interior_front_seats-1774703645542.jpg not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5342%252F20485342%252Finterior_rear_seats-1774781279690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5342/20485342/interior_rear_seats-1774781279690.jpg not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9538%252F20239538%252Finterior_dashboard-1774703760692.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9538/20239538/interior_dashboard-1774703760692.jpg not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5342%252F20485342%252Finterior_dashboard-1774783218396.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5342/20485342/interior_dashboard-1774783218396.jpg not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9538%252F20239538%252Finterior_boot-1774703799210.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9538/20239538/interior_boot-1774703799210.jpg not downloaded yet
2026-03-29 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6923/5866923/wheels_front_driver-1774106201689.jpg> (referer: None)
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5342%252F20485342%252Finstrument_cluster-1774781121703.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5342/20485342/instrument_cluster-1774781121703.jpg not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9538%252F20239538%252Fdocs_service_history-1774706813861.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D407b4c6460a48a92d7fdf7b717f8a76b%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9538/20239538/docs_service_history-1774706813861.jpg?ixlib=js-3.8.0&auto=format&s=407b4c6460a48a92d7fdf7b717f8a76b not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5342%252F20485342%252Finterior_boot-1774781275283.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5342/20485342/interior_boot-1774781275283.jpg not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9538%252F20239538%252Fdocs_service_history-1774706844553.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df30cfb4ed29f3c962fbe2bf2e604f765%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9538/20239538/docs_service_history-1774706844553.jpg?ixlib=js-3.8.0&auto=format&s=f30cfb4ed29f3c962fbe2bf2e604f765 not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5342%252F20485342%252Fdocs_service_history-1774781859817.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D89dd0a8ea54372a8990a9dda962d7b9a%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5342/20485342/docs_service_history-1774781859817.jpg?ixlib=js-3.8.0&auto=format&s=89dd0a8ea54372a8990a9dda962d7b9a not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9538%252F20239538%252Fwheels_front_driver-1774702998285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9538/20239538/wheels_front_driver-1774702998285.jpg not downloaded yet
2026-03-29 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18832294.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa010510>
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a6981cd-b242-5452-8198-c71d1a7f90df/3a6981cd-b242-5452-8198-c71d1a7f90df_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6923%252F5866923%252Fwheels_front_driver-1774106201689.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6923/5866923/wheels_front_driver-1774106201689.jpg saved to cache
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a6981cd-b242-5452-8198-c71d1a7f90df
2026-03-29 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_front_driver-1774696126192.jpg> (referer: None)
2026-03-29 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_rear_passenger-1774696010697.jpg> (referer: None)
2026-03-29 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_front_passenger-1774702445347.jpg> (referer: None)
2026-03-29 20:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4 with identifier: 18832294
2026-03-29 20:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4 with scrape type 1
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2294%252F18832294%252Fexterior_front_driver-1774706820434.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_front_driver-1774706820434.jpg not downloaded yet
2026-03-29 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9124/19989124/instrument_cluster-1774702165033.jpg> (referer: None)
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2294%252F18832294%252Fexterior_rear_driver-1774706854291.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_rear_driver-1774706854291.jpg not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2294%252F18832294%252Fexterior_front_passenger-1774706887392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_front_passenger-1774706887392.jpg not downloaded yet
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2294%252F18832294%252Fexterior_rear_passenger-1774706872318.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_rear_passenger-1774706872318.jpg not downloaded yet
2026-03-29 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_front_passenger-1774780447563.jpg> (referer: None)
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2294%252F18832294%252Finterior_front_seats-1774707179945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2294/18832294/interior_front_seats-1774707179945.jpg not downloaded yet
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf6b590>
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6560%252F20396560%252Fexterior_front_driver-1774696126192.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_front_driver-1774696126192.jpg saved to cache
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e83713ab-6a6b-5504-a9bf-bb9181e874cf
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8fb9b10>
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6560%252F20396560%252Fexterior_rear_passenger-1774696010697.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_rear_passenger-1774696010697.jpg saved to cache
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e83713ab-6a6b-5504-a9bf-bb9181e874cf
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f932f1d0>
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9538%252F20239538%252Fexterior_front_passenger-1774702445347.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_front_passenger-1774702445347.jpg saved to cache
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e
2026-03-29 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6923/5866923/interior_boot-1774106744184.jpg> (referer: None)
2026-03-29 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6560/20396560/interior_rear_seats-1774696996010.jpg> (referer: None)
2026-03-29 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6560/20396560/interior_dashboard-1774697035931.jpg> (referer: None)
2026-03-29 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6322/20476322/instrument_cluster-1774786435600.jpg> (referer: None)
2026-03-29 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9124/19989124/interior_dashboard-1774702953070.jpg> (referer: None)
2026-03-29 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_rear_driver-1774702337298.jpg> (referer: None)
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2294%252F18832294%252Finterior_rear_seats-1774707008670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2294/18832294/interior_rear_seats-1774707008670.jpg not downloaded yet
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2294%252F18832294%252Finterior_dashboard-1774707115438.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2294/18832294/interior_dashboard-1774707115438.jpg not downloaded yet
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2294%252F18832294%252Finstrument_cluster-1774707190422.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2294/18832294/instrument_cluster-1774707190422.jpg not downloaded yet
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8287d90>
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9124%252F19989124%252Finstrument_cluster-1774702165033.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9124/19989124/instrument_cluster-1774702165033.jpg saved to cache
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84445d0>
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5342%252F20485342%252Fexterior_front_passenger-1774780447563.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_front_passenger-1774780447563.jpg saved to cache
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2294%252F18832294%252Finterior_boot-1774706940300.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2294/18832294/interior_boot-1774706940300.jpg not downloaded yet
2026-03-29 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9538/20239538/docs_service_history-1774706844553.jpg?ixlib=js-3.8.0&auto=format&s=f30cfb4ed29f3c962fbe2bf2e604f765> (referer: None)
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F2294%252F18832294%252Fdocs_service_history-1766050367745.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4b210e909ed4c97a7eae78644e6c9e49%27 HTTP/1.1" 200 None
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/2294/18832294/docs_service_history-1766050367745.jpg?ixlib=js-3.8.0&auto=format&s=4b210e909ed4c97a7eae78644e6c9e49 not downloaded yet
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8234950>
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a6981cd-b242-5452-8198-c71d1a7f90df/3a6981cd-b242-5452-8198-c71d1a7f90df_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6923%252F5866923%252Finterior_boot-1774106744184.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6923/5866923/interior_boot-1774106744184.jpg saved to cache
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a6981cd-b242-5452-8198-c71d1a7f90df
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa153650>
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6560%252F20396560%252Finterior_rear_seats-1774696996010.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6560/20396560/interior_rear_seats-1774696996010.jpg saved to cache
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e83713ab-6a6b-5504-a9bf-bb9181e874cf
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf4ef50>
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6560%252F20396560%252Finterior_dashboard-1774697035931.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6560/20396560/interior_dashboard-1774697035931.jpg saved to cache
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e83713ab-6a6b-5504-a9bf-bb9181e874cf
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa06710>
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6322%252F20476322%252Finstrument_cluster-1774786435600.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6322/20476322/instrument_cluster-1774786435600.jpg saved to cache
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e210f682-15a4-588b-ae7a-b8332ac730bf
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf48910>
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9124%252F19989124%252Finterior_dashboard-1774702953070.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9124/19989124/interior_dashboard-1774702953070.jpg saved to cache
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9019190>
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9538%252F20239538%252Fexterior_rear_driver-1774702337298.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_rear_driver-1774702337298.jpg saved to cache
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e
2026-03-29 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6560/20396560/interior_boot-1774697037064.jpg> (referer: None)
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94b9750>
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9538%252F20239538%252Fdocs_service_history-1774706844553.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df30cfb4ed29f3c962fbe2bf2e604f765') HTTP/1.1" 204 0
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9538/20239538/docs_service_history-1774706844553.jpg?ixlib=js-3.8.0&auto=format&s=f30cfb4ed29f3c962fbe2bf2e604f765 saved to cache
2026-03-29 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e
2026-03-29 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5342/20485342/docs_service_history-1774781859817.jpg?ixlib=js-3.8.0&auto=format&s=89dd0a8ea54372a8990a9dda962d7b9a> (referer: None)
2026-03-29 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_rear_driver-1774780619710.jpg> (referer: None)
2026-03-29 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9538/20239538/interior_boot-1774703799210.jpg> (referer: None)
2026-03-29 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9538/20239538/wheels_front_driver-1774702998285.jpg> (referer: None)
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94b9d50>
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6560%252F20396560%252Finterior_boot-1774697037064.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6560/20396560/interior_boot-1774697037064.jpg saved to cache
2026-03-29 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e83713ab-6a6b-5504-a9bf-bb9181e874cf
2026-03-29 20:04:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e83713ab-6a6b-5504-a9bf-bb9181e874cf, skipping ID generation
2026-03-29 20:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e83713ab-6a6b-5504-a9bf-bb9181e874cf with scrape type 1
2026-03-29 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e83713ab-6a6b-5504-a9bf-bb9181e874cf sending to next pipeline
2026-03-29 20:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e83713ab-6a6b-5504-a9bf-bb9181e874cf, identifier: 20396560
2026-03-29 20:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e83713ab-6a6b-5504-a9bf-bb9181e874cf with identifier: 20396560
2026-03-29 20:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e83713ab-6a6b-5504-a9bf-bb9181e874cf with identifier: 20396560
2026-03-29 20:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e83713ab-6a6b-5504-a9bf-bb9181e874cf with identifier: 20396560 to the API
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6560/20396560/interior_boot-1774697037064.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e83713ab-6a6b-5504-a9bf-bb9181e874cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WM17 VNW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20396560',
'listing': 'auction',
'location': 'Hampshire Eastleigh',
'make': 'Honda',
'model': 'HR-V',
'odometer': 50690,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2189048,
'Height': 2726,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_front_driver-1774696126192.jpg',
'Width': 3634},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2111179,
'Height': 2672,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_rear_driver-1774695938213.jpg',
'Width': 3563},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1914647,
'Height': 2637,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_front_passenger-1774696017473.jpg',
'Width': 3516},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2124389,
'Height': 2651,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6560/20396560/exterior_rear_passenger-1774696010697.jpg',
'Width': 3535},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3387144,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6560/20396560/interior_front_seats-1774696972430.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3214067,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6560/20396560/interior_rear_seats-1774696996010.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3179176,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6560/20396560/interior_dashboard-1774697035931.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3987320,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6560/20396560/interior_boot-1774697037064.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308341,
'Height': 1349,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6560/20396560/docs_service_history-1774698919895.jpg?ixlib=js-3.8.0&auto=format&s=c233cb8084503c56a9e5c7745a44b0a9',
'Width': 1994},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e83713ab-6a6b-5504-a9bf-bb9181e874cf/e83713ab-6a6b-5504-a9bf-bb9181e874cf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 558092,
'Height': 1479,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6560/20396560/docs_service_history-1774707724447.jpg?ixlib=js-3.8.0&auto=format&s=006b2ffac7b884be7ec25bbc4afe87c2',
'Width': 1972}],
'price': 9206,
'price_includes_vat': False,
'registration_date': '2017-06-26',
'seats_number': None,
'seller_name': None,
'title': 'Honda HR-V EX I-VTEC',
'transmission': 'manual',
'trim': 'EX I-VTEC',
'vin': '3HGRU1790HM302110',
'year': 2017}
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720396560%27 HTTP/1.1" 200 None
2026-03-29 20:04:08 [motorway.uk] INFO: Saving data for 20396560: {'created_time': 1774814648.693848, 'last_price_update_time': 1774814648.693859, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20396560') HTTP/1.1" 204 0
2026-03-29 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/2294/18832294/docs_service_history-1766050367745.jpg?ixlib=js-3.8.0&auto=format&s=4b210e909ed4c97a7eae78644e6c9e49> (referer: None)
2026-03-29 20:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f938d290>
2026-03-29 20:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5342%252F20485342%252Fdocs_service_history-1774781859817.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D89dd0a8ea54372a8990a9dda962d7b9a') HTTP/1.1" 204 0
2026-03-29 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5342/20485342/docs_service_history-1774781859817.jpg?ixlib=js-3.8.0&auto=format&s=89dd0a8ea54372a8990a9dda962d7b9a saved to cache
2026-03-29 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00
2026-03-29 20:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf90f90>
2026-03-29 20:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5342%252F20485342%252Fexterior_rear_driver-1774780619710.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_rear_driver-1774780619710.jpg saved to cache
2026-03-29 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00
2026-03-29 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x90\t\x00\x00'
2026-03-29 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 13:16:33\x00'
2026-03-29 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81fc710>
2026-03-29 20:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9538%252F20239538%252Finterior_boot-1774703799210.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9538/20239538/interior_boot-1774703799210.jpg saved to cache
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9495050>
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9538%252F20239538%252Fwheels_front_driver-1774702998285.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9538/20239538/wheels_front_driver-1774702998285.jpg saved to cache
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e
2026-03-29 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20215364.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9263b90>
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F2294%252F18832294%252Fdocs_service_history-1766050367745.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4b210e909ed4c97a7eae78644e6c9e49') HTTP/1.1" 204 0
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/2294/18832294/docs_service_history-1766050367745.jpg?ixlib=js-3.8.0&auto=format&s=4b210e909ed4c97a7eae78644e6c9e49 saved to cache
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4
2026-03-29 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_front_driver-1774706820434.jpg> (referer: None)
2026-03-29 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_rear_driver-1774706854291.jpg> (referer: None)
2026-03-29 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_front_passenger-1774706887392.jpg> (referer: None)
2026-03-29 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2294/18832294/interior_dashboard-1774707115438.jpg> (referer: None)
2026-03-29 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2294/18832294/interior_front_seats-1774707179945.jpg> (referer: None)
2026-03-29 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_rear_passenger-1774706872318.jpg> (referer: None)
2026-03-29 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2294/18832294/interior_rear_seats-1774707008670.jpg> (referer: None)
2026-03-29 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5342/20485342/interior_boot-1774781275283.jpg> (referer: None)
2026-03-29 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2294/18832294/instrument_cluster-1774707190422.jpg> (referer: None)
2026-03-29 20:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2294/18832294/interior_boot-1774706940300.jpg> (referer: None)
2026-03-29 20:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5132484a-de34-5f2b-a035-27ab89850356 with identifier: 20215364
2026-03-29 20:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5132484a-de34-5f2b-a035-27ab89850356 with scrape type 1
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5132484a-de34-5f2b-a035-27ab89850356
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5364%252F20215364%252Fexterior_front_driver-1774699844993.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_front_driver-1774699844993.jpg not downloaded yet
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5364%252F20215364%252Fexterior_rear_driver-1774699837512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_rear_driver-1774699837512.jpg not downloaded yet
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f897e890>
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2294%252F18832294%252Fexterior_front_driver-1774706820434.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_front_driver-1774706820434.jpg saved to cache
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94b45d0>
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2294%252F18832294%252Fexterior_rear_driver-1774706854291.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_rear_driver-1774706854291.jpg saved to cache
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cfa090>
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2294%252F18832294%252Fexterior_front_passenger-1774706887392.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_front_passenger-1774706887392.jpg saved to cache
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cf9fd0>
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2294%252F18832294%252Finterior_dashboard-1774707115438.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2294/18832294/interior_dashboard-1774707115438.jpg saved to cache
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8aa7690>
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2294%252F18832294%252Finterior_front_seats-1774707179945.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2294/18832294/interior_front_seats-1774707179945.jpg saved to cache
2026-03-29 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96bce50>
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2294%252F18832294%252Fexterior_rear_passenger-1774706872318.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_rear_passenger-1774706872318.jpg saved to cache
2026-03-29 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa7e5d0>
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2294%252F18832294%252Finterior_rear_seats-1774707008670.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2294/18832294/interior_rear_seats-1774707008670.jpg saved to cache
2026-03-29 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa01b050>
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5342%252F20485342%252Finterior_boot-1774781275283.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5342/20485342/interior_boot-1774781275283.jpg saved to cache
2026-03-29 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa7c910>
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2294%252F18832294%252Finstrument_cluster-1774707190422.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2294/18832294/instrument_cluster-1774707190422.jpg saved to cache
2026-03-29 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96bc810>
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2294%252F18832294%252Finterior_boot-1774706940300.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2294/18832294/interior_boot-1774706940300.jpg saved to cache
2026-03-29 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4
2026-03-29 20:04:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4, skipping ID generation
2026-03-29 20:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4 with scrape type 1
2026-03-29 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4 sending to next pipeline
2026-03-29 20:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4, identifier: 18832294
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5364%252F20215364%252Fexterior_front_passenger-1774699841865.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_front_passenger-1774699841865.jpg not downloaded yet
2026-03-29 20:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4 with identifier: 18832294
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Bronze HTTP/1.1" 200 None
2026-03-29 20:04:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4 with identifier: 18832294
2026-03-29 20:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4c1e31e2-52d5-5eb7-aca9-e7f9068742d4 with identifier: 18832294 to the API
2026-03-29 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2294/18832294/interior_boot-1774706940300.jpg>
{'auction_title': '',
'category': None,
'color': 'Bronze',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '4c1e31e2-52d5-5eb7-aca9-e7f9068742d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KF19 ZBW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18832294',
'listing': 'auction',
'location': 'Lincolnshire Spalding',
'make': 'Toyota',
'model': 'Prius',
'odometer': 33425,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1211768,
'Height': 2480,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_front_driver-1774706820434.jpg',
'Width': 3306},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1238944,
'Height': 2409,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_rear_driver-1774706854291.jpg',
'Width': 3212},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1278053,
'Height': 2788,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_front_passenger-1774706887392.jpg',
'Width': 3717},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1662488,
'Height': 2708,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2294/18832294/exterior_rear_passenger-1774706872318.jpg',
'Width': 3610},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1492826,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2294/18832294/interior_front_seats-1774707179945.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1850376,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2294/18832294/interior_rear_seats-1774707008670.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1493190,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2294/18832294/interior_dashboard-1774707115438.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2395228,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2294/18832294/instrument_cluster-1774707190422.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2356265,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2294/18832294/interior_boot-1774706940300.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c1e31e2-52d5-5eb7-aca9-e7f9068742d4/4c1e31e2-52d5-5eb7-aca9-e7f9068742d4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100427,
'Height': 831,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/2294/18832294/docs_service_history-1766050367745.jpg?ixlib=js-3.8.0&auto=format&s=4b210e909ed4c97a7eae78644e6c9e49',
'Width': 623}],
'price': 13520,
'price_includes_vat': False,
'registration_date': '2019-07-27',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Prius Active VVT-i CVT',
'transmission': 'automatic',
'trim': 'Active VVT-i CVT',
'vin': 'JTDKB3FU903087247',
'year': 2019}
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718832294%27 HTTP/1.1" 200 None
2026-03-29 20:04:11 [motorway.uk] INFO: Saving data for 18832294: {'created_time': 1774814651.806983, 'last_price_update_time': 1774814651.806996, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18832294') HTTP/1.1" 204 0
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5364%252F20215364%252Fexterior_rear_passenger-1774699840861.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_rear_passenger-1774699840861.jpg not downloaded yet
2026-03-29 20:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6322/20476322/docs_service_history-1774786767104.jpg?ixlib=js-3.8.0&auto=format&s=9dc7b20f53dbe38d58162c8c7aa439de> (referer: None)
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5364%252F20215364%252Finterior_front_seats-1774700675423.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5364/20215364/interior_front_seats-1774700675423.jpg not downloaded yet
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5364%252F20215364%252Finterior_rear_seats-1774699941160.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5364/20215364/interior_rear_seats-1774699941160.jpg not downloaded yet
2026-03-29 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9538/20239538/docs_service_history-1774706813861.jpg?ixlib=js-3.8.0&auto=format&s=407b4c6460a48a92d7fdf7b717f8a76b> (referer: None)
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5364%252F20215364%252Finterior_dashboard-1774700691653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5364/20215364/interior_dashboard-1774700691653.jpg not downloaded yet
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5364%252F20215364%252Finterior_boot-1774444837316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5364/20215364/interior_boot-1774444837316.jpg not downloaded yet
2026-03-29 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9124/19989124/docs_service_history-1774703278095.jpg?ixlib=js-3.8.0&auto=format&s=c5b4b67d77c598ead8d3fb2c2e311f3b> (referer: None)
2026-03-29 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5364%252F20215364%252Fwheels_front_driver-1774699613000.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5364/20215364/wheels_front_driver-1774699613000.jpg not downloaded yet
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a7c4d0>
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6322%252F20476322%252Fdocs_service_history-1774786767104.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9dc7b20f53dbe38d58162c8c7aa439de') HTTP/1.1" 204 0
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6322/20476322/docs_service_history-1774786767104.jpg?ixlib=js-3.8.0&auto=format&s=9dc7b20f53dbe38d58162c8c7aa439de saved to cache
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e210f682-15a4-588b-ae7a-b8332ac730bf
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5364%252F20215364%252Fwheels_rear_driver-1774699615493.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5364/20215364/wheels_rear_driver-1774699615493.jpg not downloaded yet
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93689d0>
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9538%252F20239538%252Fdocs_service_history-1774706813861.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D407b4c6460a48a92d7fdf7b717f8a76b') HTTP/1.1" 204 0
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9538/20239538/docs_service_history-1774706813861.jpg?ixlib=js-3.8.0&auto=format&s=407b4c6460a48a92d7fdf7b717f8a76b saved to cache
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e
2026-03-29 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5342/20485342/interior_dashboard-1774783218396.jpg> (referer: None)
2026-03-29 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5342/20485342/instrument_cluster-1774781121703.jpg> (referer: None)
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf1e1d0>
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9124%252F19989124%252Fdocs_service_history-1774703278095.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc5b4b67d77c598ead8d3fb2c2e311f3b') HTTP/1.1" 204 0
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9124/19989124/docs_service_history-1774703278095.jpg?ixlib=js-3.8.0&auto=format&s=c5b4b67d77c598ead8d3fb2c2e311f3b saved to cache
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd
2026-03-29 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_front_driver-1774699844993.jpg> (referer: None)
2026-03-29 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_rear_passenger-1774780428074.jpg> (referer: None)
2026-03-29 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5342/20485342/interior_rear_seats-1774781279690.jpg> (referer: None)
2026-03-29 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5342/20485342/interior_front_seats-1774781354688.jpg> (referer: None)
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f903a5d0>
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5342%252F20485342%252Finterior_dashboard-1774783218396.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5342/20485342/interior_dashboard-1774783218396.jpg saved to cache
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf1efd0>
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5342%252F20485342%252Finstrument_cluster-1774781121703.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5342/20485342/instrument_cluster-1774781121703.jpg saved to cache
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94aa990>
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5364%252F20215364%252Fexterior_front_driver-1774699844993.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_front_driver-1774699844993.jpg saved to cache
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5132484a-de34-5f2b-a035-27ab89850356
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f845b610>
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5342%252F20485342%252Fexterior_rear_passenger-1774780428074.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_rear_passenger-1774780428074.jpg saved to cache
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700e3cc10>
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5342%252F20485342%252Finterior_rear_seats-1774781279690.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5342/20485342/interior_rear_seats-1774781279690.jpg saved to cache
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9272190>
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5342%252F20485342%252Finterior_front_seats-1774781354688.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5342/20485342/interior_front_seats-1774781354688.jpg saved to cache
2026-03-29 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00
2026-03-29 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_rear_driver-1774699837512.jpg> (referer: None)
2026-03-29 20:04:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5364/20215364/wheels_front_driver-1774699613000.jpg> (referer: None)
2026-03-29 20:04:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5364/20215364/interior_boot-1774444837316.jpg> (referer: None)
2026-03-29 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_front_passenger-1774699841865.jpg> (referer: None)
2026-03-29 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9538/20239538/interior_front_seats-1774703645542.jpg> (referer: None)
2026-03-29 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9538/20239538/interior_dashboard-1774703760692.jpg> (referer: None)
2026-03-29 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_rear_passenger-1774702405080.jpg> (referer: None)
2026-03-29 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9124/19989124/interior_boot-1774702076255.jpg> (referer: None)
2026-03-29 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5364/20215364/interior_front_seats-1774700675423.jpg> (referer: None)
2026-03-29 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5364/20215364/wheels_rear_driver-1774699615493.jpg> (referer: None)
2026-03-29 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5364/20215364/interior_rear_seats-1774699941160.jpg> (referer: None)
2026-03-29 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5364/20215364/interior_dashboard-1774700691653.jpg> (referer: None)
2026-03-29 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6322/20476322/interior_boot-1774786242113.jpg> (referer: None)
2026-03-29 20:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_front_driver-1774780445015.jpg> (referer: None)
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ab27d0>
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5364%252F20215364%252Fexterior_rear_driver-1774699837512.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_rear_driver-1774699837512.jpg saved to cache
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5132484a-de34-5f2b-a035-27ab89850356
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadb9190>
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5364%252F20215364%252Fwheels_front_driver-1774699613000.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5364/20215364/wheels_front_driver-1774699613000.jpg saved to cache
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5132484a-de34-5f2b-a035-27ab89850356
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9110b50>
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5364%252F20215364%252Finterior_boot-1774444837316.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5364/20215364/interior_boot-1774444837316.jpg saved to cache
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5132484a-de34-5f2b-a035-27ab89850356
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d1d750>
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5364%252F20215364%252Fexterior_front_passenger-1774699841865.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_front_passenger-1774699841865.jpg saved to cache
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5132484a-de34-5f2b-a035-27ab89850356
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x90\t\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 13:13:58\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadbb350>
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9538%252F20239538%252Finterior_front_seats-1774703645542.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9538/20239538/interior_front_seats-1774703645542.jpg saved to cache
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x90\t\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 13:15:31\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa05b10>
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9538%252F20239538%252Finterior_dashboard-1774703760692.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9538/20239538/interior_dashboard-1774703760692.jpg saved to cache
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f811b010>
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9538%252F20239538%252Fexterior_rear_passenger-1774702405080.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_rear_passenger-1774702405080.jpg saved to cache
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d1c4d0>
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9124%252F19989124%252Finterior_boot-1774702076255.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9124/19989124/interior_boot-1774702076255.jpg saved to cache
2026-03-29 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f84c10>
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5364%252F20215364%252Finterior_front_seats-1774700675423.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5364/20215364/interior_front_seats-1774700675423.jpg saved to cache
2026-03-29 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5132484a-de34-5f2b-a035-27ab89850356
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8119f10>
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5364%252F20215364%252Fwheels_rear_driver-1774699615493.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5364/20215364/wheels_rear_driver-1774699615493.jpg saved to cache
2026-03-29 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5132484a-de34-5f2b-a035-27ab89850356
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9238bd0>
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5364%252F20215364%252Finterior_rear_seats-1774699941160.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5364/20215364/interior_rear_seats-1774699941160.jpg saved to cache
2026-03-29 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5132484a-de34-5f2b-a035-27ab89850356
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93699d0>
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5364%252F20215364%252Finterior_dashboard-1774700691653.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5364/20215364/interior_dashboard-1774700691653.jpg saved to cache
2026-03-29 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5132484a-de34-5f2b-a035-27ab89850356
2026-03-29 20:04:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae83a10>
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6322%252F20476322%252Finterior_boot-1774786242113.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6322/20476322/interior_boot-1774786242113.jpg saved to cache
2026-03-29 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e210f682-15a4-588b-ae7a-b8332ac730bf
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa06150>
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5342%252F20485342%252Fexterior_front_driver-1774780445015.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_front_driver-1774780445015.jpg saved to cache
2026-03-29 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00
2026-03-29 20:04:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fc016cb-3abc-5eb1-9666-840a2d00fe00, skipping ID generation
2026-03-29 20:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00 with scrape type 1
2026-03-29 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fc016cb-3abc-5eb1-9666-840a2d00fe00 sending to next pipeline
2026-03-29 20:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8fc016cb-3abc-5eb1-9666-840a2d00fe00, identifier: 20485342
2026-03-29 20:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8fc016cb-3abc-5eb1-9666-840a2d00fe00 with identifier: 20485342
2026-03-29 20:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8fc016cb-3abc-5eb1-9666-840a2d00fe00 with identifier: 20485342
2026-03-29 20:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8fc016cb-3abc-5eb1-9666-840a2d00fe00 with identifier: 20485342 to the API
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_front_driver-1774780445015.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '8fc016cb-3abc-5eb1-9666-840a2d00fe00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY21 GZM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20485342',
'listing': 'auction',
'location': 'Staffordshire Stoke-on-Trent',
'make': 'MG',
'model': 'ZS',
'odometer': 26189,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 779247,
'Height': 2529,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_front_driver-1774780445015.jpg',
'Width': 3372},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1326664,
'Height': 2570,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_rear_driver-1774780619710.jpg',
'Width': 3427},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1309875,
'Height': 2630,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_front_passenger-1774780447563.jpg',
'Width': 3507},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 829199,
'Height': 2701,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5342/20485342/exterior_rear_passenger-1774780428074.jpg',
'Width': 3601},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2191915,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5342/20485342/interior_front_seats-1774781354688.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2115800,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5342/20485342/interior_rear_seats-1774781279690.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1569303,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5342/20485342/interior_dashboard-1774783218396.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1417964,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5342/20485342/instrument_cluster-1774781121703.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2114794,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5342/20485342/interior_boot-1774781275283.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc016cb-3abc-5eb1-9666-840a2d00fe00/8fc016cb-3abc-5eb1-9666-840a2d00fe00_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1066051,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5342/20485342/docs_service_history-1774781859817.jpg?ixlib=js-3.8.0&auto=format&s=89dd0a8ea54372a8990a9dda962d7b9a',
'Width': 3840}],
'price': 9735,
'price_includes_vat': False,
'registration_date': '2021-03-25',
'seats_number': None,
'seller_name': None,
'title': 'MG ZS Exclusive VTI-TECH',
'transmission': 'manual',
'trim': 'Exclusive VTI-TECH',
'vin': 'LSJW74U94LZ241449',
'year': 2021}
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485342%27 HTTP/1.1" 200 None
2026-03-29 20:04:15 [motorway.uk] INFO: Saving data for 20485342: {'created_time': 1774814655.045809, 'last_price_update_time': 1774814655.045819, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20485342') HTTP/1.1" 204 0
2026-03-29 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=684&page=19&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_front_driver-1774702258994.jpg> (referer: None)
2026-03-29 20:04:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_rear_passenger-1774699840861.jpg> (referer: None)
2026-03-29 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6322/20476322/interior_dashboard-1774786292691.jpg> (referer: None)
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 19564729
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 6226570
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 16486995
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 20460973
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 20487463
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 20111851
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 20098217
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 19569480
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 20468681
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 14866645
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714866645%27 HTTP/1.1" 200 None
2026-03-29 20:04:15 [motorway.uk] INFO: Scrape type for 14866645: 1
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 13203122
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 15371876
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 17858829
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 8664899
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 14729168
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 13365584
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 19518797
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 19781742
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 18114762
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 20484591
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 4393703
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 19625865
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 20021655
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 4895685
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 20426345
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 15364589
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 20450018
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 17809359
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 20487947
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 20346112
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720346112%27 HTTP/1.1" 200 None
2026-03-29 20:04:15 [motorway.uk] INFO: Scrape type for 20346112: 1
2026-03-29 20:04:15 [motorway.uk] INFO: Found listing with ID: 15189137
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715189137%27 HTTP/1.1" 200 None
2026-03-29 20:04:15 [motorway.uk] INFO: Scrape type for 15189137: 1
2026-03-29 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94ddc50>
2026-03-29 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9538%252F20239538%252Fexterior_front_driver-1774702258994.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_front_driver-1774702258994.jpg saved to cache
2026-03-29 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e
2026-03-29 20:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc0534ad-03e3-53a8-914c-e3e2dca2be8e, skipping ID generation
2026-03-29 20:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e with scrape type 1
2026-03-29 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc0534ad-03e3-53a8-914c-e3e2dca2be8e sending to next pipeline
2026-03-29 20:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bc0534ad-03e3-53a8-914c-e3e2dca2be8e, identifier: 20239538
2026-03-29 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca7c10>
2026-03-29 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5364%252F20215364%252Fexterior_rear_passenger-1774699840861.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_rear_passenger-1774699840861.jpg saved to cache
2026-03-29 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5132484a-de34-5f2b-a035-27ab89850356
2026-03-29 20:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5132484a-de34-5f2b-a035-27ab89850356, skipping ID generation
2026-03-29 20:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5132484a-de34-5f2b-a035-27ab89850356 with scrape type 1
2026-03-29 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5132484a-de34-5f2b-a035-27ab89850356 sending to next pipeline
2026-03-29 20:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5132484a-de34-5f2b-a035-27ab89850356, identifier: 20215364
2026-03-29 20:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bc0534ad-03e3-53a8-914c-e3e2dca2be8e with identifier: 20239538
2026-03-29 20:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bc0534ad-03e3-53a8-914c-e3e2dca2be8e with identifier: 20239538
2026-03-29 20:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bc0534ad-03e3-53a8-914c-e3e2dca2be8e with identifier: 20239538 to the API
2026-03-29 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_front_driver-1774702258994.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bc0534ad-03e3-53a8-914c-e3e2dca2be8e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': '1120 HP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20239538',
'listing': 'auction',
'location': 'Cardiff Cardiff',
'make': 'Mazda',
'model': 'MX-5',
'odometer': 9827,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1011338,
'Height': 2064,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_front_driver-1774702258994.jpg',
'Width': 2752},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 856800,
'Height': 1680,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_rear_driver-1774702337298.jpg',
'Width': 2240},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 918517,
'Height': 1928,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_front_passenger-1774702445347.jpg',
'Width': 2570},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1374492,
'Height': 2117,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9538/20239538/exterior_rear_passenger-1774702405080.jpg',
'Width': 2823},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3342366,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/9538/20239538/interior_front_seats-1774703645542.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3027625,
'Height': 2448,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9538/20239538/interior_dashboard-1774703760692.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2907765,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/9538/20239538/interior_boot-1774703799210.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 758653,
'Height': 2876,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9538/20239538/docs_service_history-1774706813861.jpg?ixlib=js-3.8.0&auto=format&s=407b4c6460a48a92d7fdf7b717f8a76b',
'Width': 2157},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 848741,
'Height': 2921,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9538/20239538/docs_service_history-1774706844553.jpg?ixlib=js-3.8.0&auto=format&s=f30cfb4ed29f3c962fbe2bf2e604f765',
'Width': 2191},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc0534ad-03e3-53a8-914c-e3e2dca2be8e/bc0534ad-03e3-53a8-914c-e3e2dca2be8e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1403363,
'Height': 2405,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9538/20239538/wheels_front_driver-1774702998285.jpg',
'Width': 3207}],
'price': 14007,
'price_includes_vat': False,
'registration_date': '2016-11-29',
'seats_number': None,
'seller_name': None,
'title': 'Mazda MX-5 Sport NAV',
'transmission': 'manual',
'trim': 'Sport NAV',
'vin': 'JMZND6E7610121453',
'year': 2016}
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720239538%27 HTTP/1.1" 200 None
2026-03-29 20:04:17 [motorway.uk] INFO: Saving data for 20239538: {'created_time': 1774814657.219978, 'last_price_update_time': 1774814657.219989, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20239538') HTTP/1.1" 204 0
2026-03-29 20:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5132484a-de34-5f2b-a035-27ab89850356 with identifier: 20215364
2026-03-29 20:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5132484a-de34-5f2b-a035-27ab89850356 with identifier: 20215364
2026-03-29 20:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5132484a-de34-5f2b-a035-27ab89850356 with identifier: 20215364 to the API
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_rear_passenger-1774699840861.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '5132484a-de34-5f2b-a035-27ab89850356',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'NG25 LHX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20215364',
'listing': 'auction',
'location': 'Tyne and Wear Sunderland',
'make': 'BMW',
'model': 'X1',
'odometer': 9299,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1038969,
'Height': 2571,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_front_driver-1774699844993.jpg',
'Width': 3428},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1130035,
'Height': 2183,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_rear_driver-1774699837512.jpg',
'Width': 2910},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1398325,
'Height': 2630,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_front_passenger-1774699841865.jpg',
'Width': 3506},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1350906,
'Height': 2606,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5364/20215364/exterior_rear_passenger-1774699840861.jpg',
'Width': 3474},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1168015,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5364/20215364/interior_front_seats-1774700675423.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1344374,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5364/20215364/interior_rear_seats-1774699941160.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1662521,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5364/20215364/interior_dashboard-1774700691653.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1457084,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5364/20215364/interior_boot-1774444837316.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514338,
'Height': 1913,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5364/20215364/wheels_front_driver-1774699613000.jpg',
'Width': 2551},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5132484a-de34-5f2b-a035-27ab89850356/5132484a-de34-5f2b-a035-27ab89850356_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1312090,
'Height': 2248,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5364/20215364/wheels_rear_driver-1774699615493.jpg',
'Width': 2997}],
'price': 32575,
'price_includes_vat': False,
'registration_date': '2025-07-14',
'seats_number': None,
'seller_name': None,
'title': 'BMW X1 Sdrive 20I M Sport MHEV A',
'transmission': 'automatic',
'trim': 'Sdrive 20I M Sport MHEV A',
'vin': 'WBA32EE0905383899',
'year': 2025}
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720215364%27 HTTP/1.1" 200 None
2026-03-29 20:04:17 [motorway.uk] INFO: Saving data for 20215364: {'created_time': 1774814657.699185, 'last_price_update_time': 1774814657.699196, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20215364') HTTP/1.1" 204 0
2026-03-29 20:04:17 [motorway.uk] INFO: Found listing with ID: 20366507
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720366507%27 HTTP/1.1" 200 None
2026-03-29 20:04:17 [motorway.uk] INFO: Scrape type for 20366507: 1
2026-03-29 20:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f902c610>
2026-03-29 20:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6322%252F20476322%252Finterior_dashboard-1774786292691.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6322/20476322/interior_dashboard-1774786292691.jpg saved to cache
2026-03-29 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e210f682-15a4-588b-ae7a-b8332ac730bf
2026-03-29 20:04:17 [motorway.uk] INFO: Found listing with ID: 13105341
2026-03-29 20:04:17 [motorway.uk] INFO: Found listing with ID: 19925177
2026-03-29 20:04:17 [motorway.uk] INFO: Found listing with ID: 19729177
2026-03-29 20:04:17 [motorway.uk] INFO: Found listing with ID: 20387159
2026-03-29 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9124/19989124/exterior_rear_passenger-1774701562124.jpg> (referer: None)
2026-03-29 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_front_passenger-1774785105692.jpg> (referer: None)
2026-03-29 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9124/19989124/exterior_rear_driver-1774701563093.jpg> (referer: None)
2026-03-29 20:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_rear_passenger-1774785058149.jpg> (referer: None)
2026-03-29 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_rear_driver-1774785029179.jpg> (referer: None)
2026-03-29 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9124/19989124/exterior_front_passenger-1774701561174.jpg> (referer: None)
2026-03-29 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9124/19989124/interior_front_seats-1774702100868.jpg> (referer: None)
2026-03-29 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9124/19989124/interior_rear_seats-1774702127394.jpg> (referer: None)
2026-03-29 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6322/20476322/interior_rear_seats-1774786184815.jpg> (referer: None)
2026-03-29 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6322/20476322/interior_front_seats-1774786163525.jpg> (referer: None)
2026-03-29 20:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a647d0>
2026-03-29 20:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9124%252F19989124%252Fexterior_rear_passenger-1774701562124.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9124/19989124/exterior_rear_passenger-1774701562124.jpg saved to cache
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a67850>
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6322%252F20476322%252Fexterior_front_passenger-1774785105692.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_front_passenger-1774785105692.jpg saved to cache
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e210f682-15a4-588b-ae7a-b8332ac730bf
2026-03-29 20:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485771.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e1abd0>
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9124%252F19989124%252Fexterior_rear_driver-1774701563093.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9124/19989124/exterior_rear_driver-1774701563093.jpg saved to cache
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faffb150>
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6322%252F20476322%252Fexterior_rear_passenger-1774785058149.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_rear_passenger-1774785058149.jpg saved to cache
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e210f682-15a4-588b-ae7a-b8332ac730bf
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae8c4d0>
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6322%252F20476322%252Fexterior_rear_driver-1774785029179.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_rear_driver-1774785029179.jpg saved to cache
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e210f682-15a4-588b-ae7a-b8332ac730bf
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadb45d0>
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9124%252F19989124%252Fexterior_front_passenger-1774701561174.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9124/19989124/exterior_front_passenger-1774701561174.jpg saved to cache
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f91842d0>
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9124%252F19989124%252Finterior_front_seats-1774702100868.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9124/19989124/interior_front_seats-1774702100868.jpg saved to cache
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faff9810>
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9124%252F19989124%252Finterior_rear_seats-1774702127394.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9124/19989124/interior_rear_seats-1774702127394.jpg saved to cache
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd
2026-03-29 20:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadb6150>
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6322%252F20476322%252Finterior_rear_seats-1774786184815.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6322/20476322/interior_rear_seats-1774786184815.jpg saved to cache
2026-03-29 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e210f682-15a4-588b-ae7a-b8332ac730bf
2026-03-29 20:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a6ded0>
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6322%252F20476322%252Finterior_front_seats-1774786163525.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6322/20476322/interior_front_seats-1774786163525.jpg saved to cache
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e210f682-15a4-588b-ae7a-b8332ac730bf
2026-03-29 20:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfbbb3c3-08b7-503d-8e3e-06fa2a067302 with identifier: 20485771
2026-03-29 20:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfbbb3c3-08b7-503d-8e3e-06fa2a067302 with scrape type 1
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dfbbb3c3-08b7-503d-8e3e-06fa2a067302
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5771%252F20485771%252Fexterior_front_driver-1774698353214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5771/20485771/exterior_front_driver-1774698353214.jpg not downloaded yet
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5771%252F20485771%252Fexterior_rear_driver-1774698371985.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5771/20485771/exterior_rear_driver-1774698371985.jpg not downloaded yet
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5771%252F20485771%252Fexterior_front_passenger-1774696472130.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5771/20485771/exterior_front_passenger-1774696472130.jpg not downloaded yet
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5771%252F20485771%252Fexterior_rear_passenger-1774696496301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5771/20485771/exterior_rear_passenger-1774696496301.jpg not downloaded yet
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5771%252F20485771%252Finterior_front_seats-1774697688269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5771/20485771/interior_front_seats-1774697688269.jpg not downloaded yet
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5771%252F20485771%252Finterior_rear_seats-1774697555072.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5771/20485771/interior_rear_seats-1774697555072.jpg not downloaded yet
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5771%252F20485771%252Finterior_dashboard-1774697613345.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5771/20485771/interior_dashboard-1774697613345.jpg not downloaded yet
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5771%252F20485771%252Finterior_boot-1774697640357.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5771/20485771/interior_boot-1774697640357.jpg not downloaded yet
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5771%252F20485771%252Fdocs_service_history-1774698091625.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D74db4ac30032cf7acc8990bc6b9d5de4%27 HTTP/1.1" 200 None
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5771/20485771/docs_service_history-1774698091625.jpg?ixlib=js-3.8.0&auto=format&s=74db4ac30032cf7acc8990bc6b9d5de4 not downloaded yet
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5771%252F20485771%252Fdocs_service_history-1774698094191.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd1f4a32761117c1c1ed0692c3f72c957%27 HTTP/1.1" 200 None
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5771/20485771/docs_service_history-1774698094191.jpg?ixlib=js-3.8.0&auto=format&s=d1f4a32761117c1c1ed0692c3f72c957 not downloaded yet
2026-03-29 20:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_front_driver-1774784982783.jpg> (referer: None)
2026-03-29 20:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9124/19989124/exterior_front_driver-1774705302435.jpg> (referer: None)
2026-03-29 20:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6923/5866923/instrument_cluster-1774106651557.jpg> (referer: None)
2026-03-29 20:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9259950>
2026-03-29 20:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6322%252F20476322%252Fexterior_front_driver-1774784982783.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_front_driver-1774784982783.jpg saved to cache
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e210f682-15a4-588b-ae7a-b8332ac730bf
2026-03-29 20:04:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e210f682-15a4-588b-ae7a-b8332ac730bf, skipping ID generation
2026-03-29 20:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e210f682-15a4-588b-ae7a-b8332ac730bf with scrape type 1
2026-03-29 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e210f682-15a4-588b-ae7a-b8332ac730bf sending to next pipeline
2026-03-29 20:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e210f682-15a4-588b-ae7a-b8332ac730bf, identifier: 20476322
2026-03-29 20:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e210f682-15a4-588b-ae7a-b8332ac730bf with identifier: 20476322
2026-03-29 20:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e210f682-15a4-588b-ae7a-b8332ac730bf with identifier: 20476322
2026-03-29 20:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e210f682-15a4-588b-ae7a-b8332ac730bf with identifier: 20476322 to the API
2026-03-29 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_front_driver-1774784982783.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e210f682-15a4-588b-ae7a-b8332ac730bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SK68 KPE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20476322',
'listing': 'auction',
'location': 'Wiltshire Chippenham',
'make': 'Suzuki',
'model': 'Swift',
'odometer': 50013,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1742150,
'Height': 2426,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_front_driver-1774784982783.jpg',
'Width': 3235},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1180935,
'Height': 2114,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_rear_driver-1774785029179.jpg',
'Width': 2819},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 972129,
'Height': 1899,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_front_passenger-1774785105692.jpg',
'Width': 2532},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1149350,
'Height': 2117,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6322/20476322/exterior_rear_passenger-1774785058149.jpg',
'Width': 2823},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3903159,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6322/20476322/interior_front_seats-1774786163525.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3171141,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6322/20476322/interior_rear_seats-1774786184815.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1873748,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6322/20476322/interior_dashboard-1774786292691.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1505577,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6322/20476322/instrument_cluster-1774786435600.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3302259,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6322/20476322/interior_boot-1774786242113.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e210f682-15a4-588b-ae7a-b8332ac730bf/e210f682-15a4-588b-ae7a-b8332ac730bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212542,
'Height': 1276,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6322/20476322/docs_service_history-1774786767104.jpg?ixlib=js-3.8.0&auto=format&s=9dc7b20f53dbe38d58162c8c7aa439de',
'Width': 1467}],
'price': 5134,
'price_includes_vat': False,
'registration_date': '2018-09-14',
'seats_number': None,
'seller_name': None,
'title': 'Suzuki Swift SZ3 Dualjet',
'transmission': 'manual',
'trim': 'SZ3 Dualjet',
'vin': 'JSAAZC83S00207157',
'year': 2018}
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476322%27 HTTP/1.1" 200 None
2026-03-29 20:04:20 [motorway.uk] INFO: Saving data for 20476322: {'created_time': 1774814660.131333, 'last_price_update_time': 1774814660.131344, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20476322') HTTP/1.1" 204 0
2026-03-29 20:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa21650>
2026-03-29 20:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9124%252F19989124%252Fexterior_front_driver-1774705302435.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9124/19989124/exterior_front_driver-1774705302435.jpg saved to cache
2026-03-29 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd
2026-03-29 20:04:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd, skipping ID generation
2026-03-29 20:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd with scrape type 1
2026-03-29 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd sending to next pipeline
2026-03-29 20:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd, identifier: 19989124
2026-03-29 20:04:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d1e290>
2026-03-29 20:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a6981cd-b242-5452-8198-c71d1a7f90df/3a6981cd-b242-5452-8198-c71d1a7f90df_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6923%252F5866923%252Finstrument_cluster-1774106651557.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6923/5866923/instrument_cluster-1774106651557.jpg saved to cache
2026-03-29 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a6981cd-b242-5452-8198-c71d1a7f90df
2026-03-29 20:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd with identifier: 19989124
2026-03-29 20:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd with identifier: 19989124
2026-03-29 20:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd with identifier: 19989124 to the API
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/9124/19989124/exterior_front_driver-1774705302435.jpg>
{'auction_title': '',
'category': None,
'color': 'Orange',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MK23 HVT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19989124',
'listing': 'auction',
'location': 'Cheshire East Macclesfield',
'make': 'Dacia',
'model': 'Duster',
'odometer': 10500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1555389,
'Height': 2348,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9124/19989124/exterior_front_driver-1774705302435.jpg',
'Width': 3131},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 971690,
'Height': 2213,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9124/19989124/exterior_rear_driver-1774701563093.jpg',
'Width': 2951},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1458365,
'Height': 2534,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9124/19989124/exterior_front_passenger-1774701561174.jpg',
'Width': 3378},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 874017,
'Height': 2089,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9124/19989124/exterior_rear_passenger-1774701562124.jpg',
'Width': 2785},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1807558,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9124/19989124/interior_front_seats-1774702100868.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2819617,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9124/19989124/interior_rear_seats-1774702127394.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1456580,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9124/19989124/interior_dashboard-1774702953070.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1109019,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9124/19989124/instrument_cluster-1774702165033.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1868916,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9124/19989124/interior_boot-1774702076255.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd/7bab7cfb-f4ba-59ac-aed0-fac5e06f5bbd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 838941,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9124/19989124/docs_service_history-1774703278095.jpg?ixlib=js-3.8.0&auto=format&s=c5b4b67d77c598ead8d3fb2c2e311f3b',
'Width': 3840}],
'price': 13346,
'price_includes_vat': False,
'registration_date': '2023-03-14',
'seats_number': None,
'seller_name': None,
'title': 'Dacia Duster Expression TCE 4X2 Auto',
'transmission': 'automatic',
'trim': 'Expression TCE 4X2 Auto',
'vin': 'VF1HJD20370392338',
'year': 2023}
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719989124%27 HTTP/1.1" 200 None
2026-03-29 20:04:20 [motorway.uk] INFO: Saving data for 19989124: {'created_time': 1774814660.928058, 'last_price_update_time': 1774814660.92807, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19989124') HTTP/1.1" 204 0
2026-03-29 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5771/20485771/docs_service_history-1774698094191.jpg?ixlib=js-3.8.0&auto=format&s=d1f4a32761117c1c1ed0692c3f72c957> (referer: None)
2026-03-29 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5771/20485771/docs_service_history-1774698091625.jpg?ixlib=js-3.8.0&auto=format&s=74db4ac30032cf7acc8990bc6b9d5de4> (referer: None)
2026-03-29 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20484845.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=720&page=20&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8635790>
2026-03-29 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbbb3c3-08b7-503d-8e3e-06fa2a067302/dfbbb3c3-08b7-503d-8e3e-06fa2a067302_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5771%252F20485771%252Fdocs_service_history-1774698094191.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd1f4a32761117c1c1ed0692c3f72c957') HTTP/1.1" 204 0
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5771/20485771/docs_service_history-1774698094191.jpg?ixlib=js-3.8.0&auto=format&s=d1f4a32761117c1c1ed0692c3f72c957 saved to cache
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dfbbb3c3-08b7-503d-8e3e-06fa2a067302
2026-03-29 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9224510>
2026-03-29 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbbb3c3-08b7-503d-8e3e-06fa2a067302/dfbbb3c3-08b7-503d-8e3e-06fa2a067302_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5771%252F20485771%252Fdocs_service_history-1774698091625.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D74db4ac30032cf7acc8990bc6b9d5de4') HTTP/1.1" 204 0
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5771/20485771/docs_service_history-1774698091625.jpg?ixlib=js-3.8.0&auto=format&s=74db4ac30032cf7acc8990bc6b9d5de4 saved to cache
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dfbbb3c3-08b7-503d-8e3e-06fa2a067302
2026-03-29 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20422784.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5472f648-791f-5a3a-93f3-324430ca8149 with identifier: 20484845
2026-03-29 20:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5472f648-791f-5a3a-93f3-324430ca8149 with scrape type 1
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5472f648-791f-5a3a-93f3-324430ca8149
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4845%252F20484845%252Fexterior_front_driver-1774692555488.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4845/20484845/exterior_front_driver-1774692555488.jpg not downloaded yet
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 19584822
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 19981352
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 14405517
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714405517%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [motorway.uk] INFO: Scrape type for 14405517: 1
2026-03-29 20:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4845%252F20484845%252Fexterior_rear_driver-1774692570442.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4845/20484845/exterior_rear_driver-1774692570442.jpg not downloaded yet
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20490426
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20420305
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20257737
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 18590519
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 18378231
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20357052
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20469592
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 19514188
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719514188%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [motorway.uk] INFO: Scrape type for 19514188: 0
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 19747758
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 15938519
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715938519%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [motorway.uk] INFO: Scrape type for 15938519: 1
2026-03-29 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16290111.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4845%252F20484845%252Fexterior_front_passenger-1774713182770.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4845/20484845/exterior_front_passenger-1774713182770.jpg not downloaded yet
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20215486
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20230861
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 15219874
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715219874%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [motorway.uk] INFO: Scrape type for 15219874: 1
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4845%252F20484845%252Fexterior_rear_passenger-1774713191483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4845/20484845/exterior_rear_passenger-1774713191483.jpg not downloaded yet
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20429518
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 14732982
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 7660198
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277660198%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [motorway.uk] INFO: Scrape type for 7660198: 1
2026-03-29 20:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb1cb3d6-571b-54f5-9ab0-489c62346d00 with identifier: 20422784
2026-03-29 20:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb1cb3d6-571b-54f5-9ab0-489c62346d00 with scrape type 1
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb1cb3d6-571b-54f5-9ab0-489c62346d00
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2784%252F20422784%252Fexterior_front_driver-1774698883710.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2784/20422784/exterior_front_driver-1774698883710.jpg not downloaded yet
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4845%252F20484845%252Finterior_front_seats-1774693268125.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4845/20484845/interior_front_seats-1774693268125.jpg not downloaded yet
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 13648117
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 17991269
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717991269%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [motorway.uk] INFO: Scrape type for 17991269: 1
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2784%252F20422784%252Fexterior_rear_driver-1774703422762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2784/20422784/exterior_rear_driver-1774703422762.jpg not downloaded yet
2026-03-29 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14508639.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4845%252F20484845%252Finterior_rear_seats-1774693281048.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4845/20484845/interior_rear_seats-1774693281048.jpg not downloaded yet
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20487024
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 3181281
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 18078915
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20470010
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 19430237
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20422292
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20373984
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20471256
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20283277
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720283277%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [motorway.uk] INFO: Scrape type for 20283277: 1
2026-03-29 20:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9e829b2-2767-53be-be22-f36399a6713c with identifier: 16290111
2026-03-29 20:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9e829b2-2767-53be-be22-f36399a6713c with scrape type 1
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9e829b2-2767-53be-be22-f36399a6713c
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0111%252F16290111%252F16290111-exterior_front_driver-modified-1774775407036.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0111/16290111/16290111-exterior_front_driver-modified-1774775407036.jpeg not downloaded yet
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2784%252F20422784%252Fexterior_front_passenger-1774698884417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2784/20422784/exterior_front_passenger-1774698884417.jpg not downloaded yet
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4845%252F20484845%252Finterior_dashboard-1774713209386.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4845/20484845/interior_dashboard-1774713209386.jpg not downloaded yet
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20363739
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720363739%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [motorway.uk] INFO: Scrape type for 20363739: 1
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0111%252F16290111%252Fexterior_rear_driver-1774718108150.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0111/16290111/exterior_rear_driver-1774718108150.jpeg not downloaded yet
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2784%252F20422784%252Fexterior_rear_passenger-1774698887248.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2784/20422784/exterior_rear_passenger-1774698887248.jpg not downloaded yet
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4845%252F20484845%252Finstrument_cluster-1774713130453.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4845/20484845/instrument_cluster-1774713130453.jpg not downloaded yet
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 19842807
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 3792457
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 20423510
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 19452760
2026-03-29 20:04:21 [motorway.uk] INFO: Found listing with ID: 19601308
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0111%252F16290111%252F16290111-exterior_front_passenger-modified-1774775421868.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0111/16290111/16290111-exterior_front_passenger-modified-1774775421868.jpeg not downloaded yet
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2784%252F20422784%252Finterior_front_seats-1774700315651.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2784/20422784/interior_front_seats-1774700315651.jpg not downloaded yet
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4845%252F20484845%252Finterior_boot-1774693388870.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4845/20484845/interior_boot-1774693388870.jpg not downloaded yet
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0111%252F16290111%252F16290111-exterior_rear_passenger-modified-1774775465624.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0111/16290111/16290111-exterior_rear_passenger-modified-1774775465624.jpeg not downloaded yet
2026-03-29 20:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aa13d31-d20e-5b33-88ab-4843d99a5063 with identifier: 14508639
2026-03-29 20:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aa13d31-d20e-5b33-88ab-4843d99a5063 with scrape type 1
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9aa13d31-d20e-5b33-88ab-4843d99a5063
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8639%252F14508639%252Fexterior_front_driver-1774781503064.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_front_driver-1774781503064.jpeg not downloaded yet
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2784%252F20422784%252Finterior_rear_seats-1774700327722.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2784/20422784/interior_rear_seats-1774700327722.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4845%252F20484845%252Fdocs_service_history-1774712961040.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0fa834d5b1de112a6207b00f1007c54a%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4845/20484845/docs_service_history-1774712961040.jpg?ixlib=js-3.8.0&auto=format&s=0fa834d5b1de112a6207b00f1007c54a not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0111%252F16290111%252Finterior_front_seats-1774718146307.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0111/16290111/interior_front_seats-1774718146307.jpeg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8639%252F14508639%252Fexterior_rear_driver-1774781566013.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_rear_driver-1774781566013.jpeg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2784%252F20422784%252Finterior_dashboard-1774700257808.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2784/20422784/interior_dashboard-1774700257808.jpg not downloaded yet
2026-03-29 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/5286387.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0111%252F16290111%252Finterior_rear_seats-1774718228793.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0111/16290111/interior_rear_seats-1774718228793.jpeg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8639%252F14508639%252Fexterior_front_passenger-1774781526308.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_front_passenger-1774781526308.jpeg not downloaded yet
2026-03-29 20:04:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2784%252F20422784%252Finterior_boot-1774700242146.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2784/20422784/interior_boot-1774700242146.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0111%252F16290111%252Finterior_dashboard-1774718271913.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0111/16290111/interior_dashboard-1774718271913.jpeg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8639%252F14508639%252Fexterior_rear_passenger-1774781544453.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_rear_passenger-1774781544453.jpeg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2784%252F20422784%252Fdocs_service_history-1774702997667.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D121e5014d76f05c2a150e712a79725ca%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2784/20422784/docs_service_history-1774702997667.jpg?ixlib=js-3.8.0&auto=format&s=121e5014d76f05c2a150e712a79725ca not downloaded yet
2026-03-29 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20366507.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0111%252F16290111%252Finterior_boot-1774718299089.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0111/16290111/interior_boot-1774718299089.jpeg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8639%252F14508639%252Finterior_front_seats-1774781807645.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8639/14508639/interior_front_seats-1774781807645.jpeg not downloaded yet
2026-03-29 20:04:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2784%252F20422784%252Fdocs_service_history-1774703010487.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5bcb1e83194c9aaf6fa334338ce70f64%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2784/20422784/docs_service_history-1774703010487.jpg?ixlib=js-3.8.0&auto=format&s=5bcb1e83194c9aaf6fa334338ce70f64 not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0111%252F16290111%252Fdocs_service_history-1774718790010.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df0eeda3d995803744285b583a4ae00d5%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0111/16290111/docs_service_history-1774718790010.jpeg?ixlib=js-3.8.0&auto=format&s=f0eeda3d995803744285b583a4ae00d5 not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8639%252F14508639%252Finterior_rear_seats-1774782022919.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8639/14508639/interior_rear_seats-1774782022919.jpeg not downloaded yet
2026-03-29 20:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5055e9b5-43bb-5f48-8e36-5c040cacdd03 with identifier: 5286387
2026-03-29 20:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03 with scrape type 1
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6387%252F5286387%252Fexterior_front_driver-1774781148688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_front_driver-1774781148688.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0111%252F16290111%252Fdocs_service_history-1774718812714.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De44d3beb965088799f1c310a68f062dc%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0111/16290111/docs_service_history-1774718812714.jpeg?ixlib=js-3.8.0&auto=format&s=e44d3beb965088799f1c310a68f062dc not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8639%252F14508639%252F14508639-interior_dashboard-modified-1774784033223.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8639/14508639/14508639-interior_dashboard-modified-1774784033223.jpeg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6387%252F5286387%252Fexterior_rear_driver-1774781182704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_rear_driver-1774781182704.jpg not downloaded yet
2026-03-29 20:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bd2af70-ce3e-531a-99f4-e3799399d945 with identifier: 20366507
2026-03-29 20:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bd2af70-ce3e-531a-99f4-e3799399d945 with scrape type 1
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8bd2af70-ce3e-531a-99f4-e3799399d945
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6507%252F20366507%252Fexterior_front_driver-1774202544601.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6507/20366507/exterior_front_driver-1774202544601.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8639%252F14508639%252Finstrument_cluster-1774782110679.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8639/14508639/instrument_cluster-1774782110679.jpeg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6387%252F5286387%252Fexterior_front_passenger-1774781241578.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_front_passenger-1774781241578.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6507%252F20366507%252Fexterior_rear_driver-1774202591290.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6507/20366507/exterior_rear_driver-1774202591290.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8639%252F14508639%252Finterior_boot-1774782229627.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8639/14508639/interior_boot-1774782229627.jpeg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6387%252F5286387%252Fexterior_rear_passenger-1774781212672.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_rear_passenger-1774781212672.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6507%252F20366507%252Fexterior_front_passenger-1774610888317.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6507/20366507/exterior_front_passenger-1774610888317.jpg not downloaded yet
2026-03-29 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5771/20485771/exterior_rear_passenger-1774696496301.jpg> (referer: None)
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8639%252F14508639%252Fdocs_service_history-1774777142482.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6bec40835f83ae2edcb2a7bdd14369fb%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8639/14508639/docs_service_history-1774777142482.jpeg?ixlib=js-3.8.0&auto=format&s=6bec40835f83ae2edcb2a7bdd14369fb not downloaded yet
2026-03-29 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5771/20485771/exterior_front_passenger-1774696472130.jpg> (referer: None)
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6387%252F5286387%252Finterior_front_seats-1774781371032.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6387/5286387/interior_front_seats-1774781371032.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6507%252F20366507%252Fexterior_rear_passenger-1774202607707.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6507/20366507/exterior_rear_passenger-1774202607707.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6387%252F5286387%252Finterior_rear_seats-1774781392127.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6387/5286387/interior_rear_seats-1774781392127.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6507%252F20366507%252Finterior_front_seats-1774203405560.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6507/20366507/interior_front_seats-1774203405560.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6387%252F5286387%252Finterior_dashboard-1774781429178.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6387/5286387/interior_dashboard-1774781429178.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6507%252F20366507%252Finterior_rear_seats-1774203430536.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6507/20366507/interior_rear_seats-1774203430536.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6387%252F5286387%252Finterior_boot-1774781488713.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6387/5286387/interior_boot-1774781488713.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6507%252F20366507%252Finterior_dashboard-1774611735850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6507/20366507/interior_dashboard-1774611735850.jpg not downloaded yet
2026-03-29 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2784/20422784/interior_dashboard-1774700257808.jpg> (referer: None)
2026-03-29 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0a0f90>
2026-03-29 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbbb3c3-08b7-503d-8e3e-06fa2a067302/dfbbb3c3-08b7-503d-8e3e-06fa2a067302_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5771%252F20485771%252Fexterior_rear_passenger-1774696496301.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5771/20485771/exterior_rear_passenger-1774696496301.jpg saved to cache
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfbbb3c3-08b7-503d-8e3e-06fa2a067302
2026-03-29 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facc2890>
2026-03-29 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbbb3c3-08b7-503d-8e3e-06fa2a067302/dfbbb3c3-08b7-503d-8e3e-06fa2a067302_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5771%252F20485771%252Fexterior_front_passenger-1774696472130.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5771/20485771/exterior_front_passenger-1774696472130.jpg saved to cache
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfbbb3c3-08b7-503d-8e3e-06fa2a067302
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6387%252F5286387%252Fdocs_service_history-1774779192517.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd525b1f182c9a42f7d5ed361172d2cc3%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6387/5286387/docs_service_history-1774779192517.jpg?ixlib=js-3.8.0&auto=format&s=d525b1f182c9a42f7d5ed361172d2cc3 not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6507%252F20366507%252Finterior_boot-1774203529423.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6507/20366507/interior_boot-1774203529423.jpg not downloaded yet
2026-03-29 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6387%252F5286387%252Fdocs_service_history-1774779204464.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D74c1ad238f9514b02b28a344f5320767%27 HTTP/1.1" 200 None
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6387/5286387/docs_service_history-1774779204464.jpg?ixlib=js-3.8.0&auto=format&s=74c1ad238f9514b02b28a344f5320767 not downloaded yet
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6507%252F20366507%252Fdocs_service_history-1774380888023.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddfbe528e09f55a7f6410b4d0b0e2db93%27 HTTP/1.1" 200 None
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6507/20366507/docs_service_history-1774380888023.jpg?ixlib=js-3.8.0&auto=format&s=dfbe528e09f55a7f6410b4d0b0e2db93 not downloaded yet
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 12:17:17\x00'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A137F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f870ea6b050>
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2784%252F20422784%252Finterior_dashboard-1774700257808.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2784/20422784/interior_dashboard-1774700257808.jpg saved to cache
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb1cb3d6-571b-54f5-9ab0-489c62346d00
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6507%252F20366507%252Fdocs_service_history-1774380888129.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df2b75fd6d3c013e526c58ac8eb1a3444%27 HTTP/1.1" 200 None
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6507/20366507/docs_service_history-1774380888129.jpg?ixlib=js-3.8.0&auto=format&s=f2b75fd6d3c013e526c58ac8eb1a3444 not downloaded yet
2026-03-29 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5771/20485771/interior_dashboard-1774697613345.jpg> (referer: None)
2026-03-29 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5771/20485771/interior_boot-1774697640357.jpg> (referer: None)
2026-03-29 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5771/20485771/interior_rear_seats-1774697555072.jpg> (referer: None)
2026-03-29 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5771/20485771/interior_front_seats-1774697688269.jpg> (referer: None)
2026-03-29 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14866645.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_rear_passenger-1774781544453.jpeg> (referer: None)
2026-03-29 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6507/20366507/docs_service_history-1774380888129.jpg?ixlib=js-3.8.0&auto=format&s=f2b75fd6d3c013e526c58ac8eb1a3444> (referer: None)
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadb6210>
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbbb3c3-08b7-503d-8e3e-06fa2a067302/dfbbb3c3-08b7-503d-8e3e-06fa2a067302_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5771%252F20485771%252Finterior_dashboard-1774697613345.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5771/20485771/interior_dashboard-1774697613345.jpg saved to cache
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfbbb3c3-08b7-503d-8e3e-06fa2a067302
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8977690>
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbbb3c3-08b7-503d-8e3e-06fa2a067302/dfbbb3c3-08b7-503d-8e3e-06fa2a067302_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5771%252F20485771%252Finterior_boot-1774697640357.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5771/20485771/interior_boot-1774697640357.jpg saved to cache
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dfbbb3c3-08b7-503d-8e3e-06fa2a067302
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa09bed0>
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbbb3c3-08b7-503d-8e3e-06fa2a067302/dfbbb3c3-08b7-503d-8e3e-06fa2a067302_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5771%252F20485771%252Finterior_rear_seats-1774697555072.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5771/20485771/interior_rear_seats-1774697555072.jpg saved to cache
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfbbb3c3-08b7-503d-8e3e-06fa2a067302
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ce3590>
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfbbb3c3-08b7-503d-8e3e-06fa2a067302/dfbbb3c3-08b7-503d-8e3e-06fa2a067302_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5771%252F20485771%252Finterior_front_seats-1774697688269.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5771/20485771/interior_front_seats-1774697688269.jpg saved to cache
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfbbb3c3-08b7-503d-8e3e-06fa2a067302
2026-03-29 20:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9 with identifier: 14866645
2026-03-29 20:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9 with scrape type 1
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6645%252F14866645%252Fexterior_front_driver-1774703198296.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_front_driver-1774703198296.jpeg not downloaded yet
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9254110>
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8639%252F14508639%252Fexterior_rear_passenger-1774781544453.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_rear_passenger-1774781544453.jpeg saved to cache
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9aa13d31-d20e-5b33-88ab-4843d99a5063
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f821f790>
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6507%252F20366507%252Fdocs_service_history-1774380888129.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df2b75fd6d3c013e526c58ac8eb1a3444') HTTP/1.1" 204 0
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6507/20366507/docs_service_history-1774380888129.jpg?ixlib=js-3.8.0&auto=format&s=f2b75fd6d3c013e526c58ac8eb1a3444 saved to cache
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8bd2af70-ce3e-531a-99f4-e3799399d945
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6645%252F14866645%252Fexterior_rear_driver-1774703293605.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_rear_driver-1774703293605.jpeg not downloaded yet
2026-03-29 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20346112.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6645%252F14866645%252Fexterior_front_passenger-1774703351525.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_front_passenger-1774703351525.jpeg not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6645%252F14866645%252Fexterior_rear_passenger-1774703257760.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_rear_passenger-1774703257760.jpeg not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6645%252F14866645%252Finterior_front_seats-1774703530130.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6645/14866645/interior_front_seats-1774703530130.jpeg not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6645%252F14866645%252F14866645-interior_rear_seats-modified-1774707416226.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6645/14866645/14866645-interior_rear_seats-modified-1774707416226.jpeg not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6645%252F14866645%252Finterior_dashboard-1774703753664.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6645/14866645/interior_dashboard-1774703753664.jpeg not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6645%252F14866645%252Finstrument_cluster-1774703778199.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6645/14866645/instrument_cluster-1774703778199.jpeg not downloaded yet
2026-03-29 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6507/20366507/docs_service_history-1774380888023.jpg?ixlib=js-3.8.0&auto=format&s=dfbe528e09f55a7f6410b4d0b0e2db93> (referer: None)
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6645%252F14866645%252Finterior_boot-1774704022664.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6645/14866645/interior_boot-1774704022664.jpeg not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6645%252F14866645%252F14866645-docs_service_history-modified-1774707494429.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D98e87286c2dcc4de7977ab065530327d%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6645/14866645/14866645-docs_service_history-modified-1774707494429.jpeg?ixlib=js-3.8.0&auto=format&s=98e87286c2dcc4de7977ab065530327d not downloaded yet
2026-03-29 20:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18a8539b-3bea-5139-a68f-870f52e33a47 with identifier: 20346112
2026-03-29 20:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a8539b-3bea-5139-a68f-870f52e33a47 with scrape type 1
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18a8539b-3bea-5139-a68f-870f52e33a47
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6112%252F20346112%252Fexterior_front_driver-1774714723851.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_front_driver-1774714723851.jpg not downloaded yet
2026-03-29 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20140691.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6112%252F20346112%252Fexterior_rear_driver-1774714741314.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_rear_driver-1774714741314.jpg not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6112%252F20346112%252Fexterior_front_passenger-1774714771568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_front_passenger-1774714771568.jpg not downloaded yet
2026-03-29 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6507/20366507/interior_front_seats-1774203405560.jpg> (referer: None)
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6112%252F20346112%252Fexterior_rear_passenger-1774714797118.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_rear_passenger-1774714797118.jpg not downloaded yet
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f905c5d0>
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6507%252F20366507%252Fdocs_service_history-1774380888023.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddfbe528e09f55a7f6410b4d0b0e2db93') HTTP/1.1" 204 0
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6507/20366507/docs_service_history-1774380888023.jpg?ixlib=js-3.8.0&auto=format&s=dfbe528e09f55a7f6410b4d0b0e2db93 saved to cache
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8bd2af70-ce3e-531a-99f4-e3799399d945
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6112%252F20346112%252Finterior_front_seats-1774715231580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6112/20346112/interior_front_seats-1774715231580.jpg not downloaded yet
2026-03-29 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15189137.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6112%252F20346112%252Finterior_rear_seats-1774715261388.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6112/20346112/interior_rear_seats-1774715261388.jpg not downloaded yet
2026-03-29 20:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de4d1af1-3b37-5867-a54c-d14c990ea18a with identifier: 20140691
2026-03-29 20:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de4d1af1-3b37-5867-a54c-d14c990ea18a with scrape type 1
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de4d1af1-3b37-5867-a54c-d14c990ea18a
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0691%252F20140691%252Fexterior_front_driver-1773166940294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_front_driver-1773166940294.jpg not downloaded yet
2026-03-29 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6387/5286387/interior_rear_seats-1774781392127.jpg> (referer: None)
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6112%252F20346112%252Finterior_dashboard-1774715324568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6112/20346112/interior_dashboard-1774715324568.jpg not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0691%252F20140691%252Fexterior_rear_driver-1773166929199.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_rear_driver-1773166929199.jpg not downloaded yet
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f821ded0>
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6507%252F20366507%252Finterior_front_seats-1774203405560.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6507/20366507/interior_front_seats-1774203405560.jpg saved to cache
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8bd2af70-ce3e-531a-99f4-e3799399d945
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6112%252F20346112%252Finstrument_cluster-1774715223373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6112/20346112/instrument_cluster-1774715223373.jpg not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0691%252F20140691%252Fexterior_front_passenger-1773166937683.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_front_passenger-1773166937683.jpg not downloaded yet
2026-03-29 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17991269.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20258462.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98405d19-77ec-5c93-9b58-4a6af63db7dd with identifier: 15189137
2026-03-29 20:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98405d19-77ec-5c93-9b58-4a6af63db7dd with scrape type 1
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98405d19-77ec-5c93-9b58-4a6af63db7dd
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9137%252F15189137%252Fexterior_front_driver-1774697318614.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9137/15189137/exterior_front_driver-1774697318614.jpg not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6112%252F20346112%252Finterior_boot-1774715205047.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6112/20346112/interior_boot-1774715205047.jpg not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0691%252F20140691%252Fexterior_rear_passenger-1773166921255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_rear_passenger-1773166921255.jpg not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9137%252F15189137%252Fexterior_rear_driver-1774697377255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9137/15189137/exterior_rear_driver-1774697377255.jpg not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6112%252F20346112%252Fdocs_service_history-1774715534199.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De87a9766ef953d500e1f40ac706ee004%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6112/20346112/docs_service_history-1774715534199.jpg?ixlib=js-3.8.0&auto=format&s=e87a9766ef953d500e1f40ac706ee004 not downloaded yet
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0691%252F20140691%252Finterior_front_seats-1773168158222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0691/20140691/interior_front_seats-1773168158222.jpg not downloaded yet
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8201490>
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6387%252F5286387%252Finterior_rear_seats-1774781392127.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6387/5286387/interior_rear_seats-1774781392127.jpg saved to cache
2026-03-29 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9137%252F15189137%252Fexterior_front_passenger-1774699493527.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9137/15189137/exterior_front_passenger-1774699493527.jpg not downloaded yet
2026-03-29 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6387/5286387/docs_service_history-1774779204464.jpg?ixlib=js-3.8.0&auto=format&s=74c1ad238f9514b02b28a344f5320767> (referer: None)
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0691%252F20140691%252Finterior_rear_seats-1773167761728.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0691/20140691/interior_rear_seats-1773167761728.jpg not downloaded yet
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9137%252F15189137%252Fexterior_rear_passenger-1774697427040.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9137/15189137/exterior_rear_passenger-1774697427040.jpg not downloaded yet
2026-03-29 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6387/5286387/docs_service_history-1774779192517.jpg?ixlib=js-3.8.0&auto=format&s=d525b1f182c9a42f7d5ed361172d2cc3> (referer: None)
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0691%252F20140691%252Finterior_dashboard-1773167528979.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0691/20140691/interior_dashboard-1773167528979.jpg not downloaded yet
2026-03-29 20:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 636d94ac-c67c-510f-93de-084f8fdf9cde with identifier: 17991269
2026-03-29 20:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 636d94ac-c67c-510f-93de-084f8fdf9cde with scrape type 1
2026-03-29 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 636d94ac-c67c-510f-93de-084f8fdf9cde
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1269%252F17991269%252Fexterior_front_driver-1774692778305.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_front_driver-1774692778305.jpeg not downloaded yet
2026-03-29 20:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca7b50b0-2ac4-5342-aca2-49994b54f799 with identifier: 20258462
2026-03-29 20:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca7b50b0-2ac4-5342-aca2-49994b54f799 with scrape type 2
2026-03-29 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca7b50b0-2ac4-5342-aca2-49994b54f799 with scrape type 2
2026-03-29 20:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ca7b50b0-2ac4-5342-aca2-49994b54f799, identifier: 20258462
2026-03-29 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_rear_driver-1774703293605.jpeg> (referer: None)
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9137%252F15189137%252Finterior_front_seats-1774699507602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9137/15189137/interior_front_seats-1774699507602.jpg not downloaded yet
2026-03-29 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15938519.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ca7b50b0-2ac4-5342-aca2-49994b54f799 with identifier: 20258462
2026-03-29 20:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ca7b50b0-2ac4-5342-aca2-49994b54f799 with identifier: 20258462
2026-03-29 20:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ca7b50b0-2ac4-5342-aca2-49994b54f799 with identifier: 20258462 to the API
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20258462.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ca7b50b0-2ac4-5342-aca2-49994b54f799',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YB21 EYT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20258462',
'listing': 'auction',
'location': 'Merseyside Liverpool',
'make': 'BMW',
'model': '1 Series',
'odometer': 33011,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 16000,
'price_includes_vat': False,
'registration_date': '2021-03-01',
'seats_number': None,
'seller_name': None,
'title': 'BMW 116D M Sport',
'transmission': 'automatic',
'trim': '116D M Sport',
'vin': 'WBA7M720X07H53244',
'year': 2021}
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720258462%27 HTTP/1.1" 200 None
2026-03-29 20:04:25 [motorway.uk] INFO: Saving data for 20258462: {'auction_closing_time': 1774884600.0, 'created_time': 1774555776.458832, 'last_price_update_time': 1774814665.926425}
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20258462') HTTP/1.1" 204 0
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0691%252F20140691%252Finstrument_cluster-1773167385896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0691/20140691/instrument_cluster-1773167385896.jpg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1269%252F17991269%252Fexterior_rear_driver-1774692941628.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_rear_driver-1774692941628.jpeg not downloaded yet
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f852cbd0>
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6387%252F5286387%252Fdocs_service_history-1774779204464.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D74c1ad238f9514b02b28a344f5320767') HTTP/1.1" 204 0
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6387/5286387/docs_service_history-1774779204464.jpg?ixlib=js-3.8.0&auto=format&s=74c1ad238f9514b02b28a344f5320767 saved to cache
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03
2026-03-29 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6507/20366507/interior_boot-1774203529423.jpg> (referer: None)
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9137%252F15189137%252Finterior_rear_seats-1774698021690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9137/15189137/interior_rear_seats-1774698021690.jpg not downloaded yet
2026-03-29 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20403490.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0691%252F20140691%252Finterior_boot-1773167646600.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0691/20140691/interior_boot-1773167646600.jpg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1269%252F17991269%252Fexterior_front_passenger-1774692863509.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_front_passenger-1774692863509.jpeg not downloaded yet
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa04610>
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6387%252F5286387%252Fdocs_service_history-1774779192517.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd525b1f182c9a42f7d5ed361172d2cc3') HTTP/1.1" 204 0
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6387/5286387/docs_service_history-1774779192517.jpg?ixlib=js-3.8.0&auto=format&s=d525b1f182c9a42f7d5ed361172d2cc3 saved to cache
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f901c690>
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6645%252F14866645%252Fexterior_rear_driver-1774703293605.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_rear_driver-1774703293605.jpeg saved to cache
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9
2026-03-29 20:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1df043fd-d235-501e-be06-8bd1f9e00f9a with identifier: 15938519
2026-03-29 20:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df043fd-d235-501e-be06-8bd1f9e00f9a with scrape type 1
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1df043fd-d235-501e-be06-8bd1f9e00f9a
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F15938519%252Fexterior_front_driver-1774545258829.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_front_driver-1774545258829.jpg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9137%252F15189137%252Finterior_dashboard-1774699477470.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9137/15189137/interior_dashboard-1774699477470.jpg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0691%252F20140691%252Fdocs_service_history-1774692713210.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da85a75de29f91572a353fd7488b1f025%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0691/20140691/docs_service_history-1774692713210.jpg?ixlib=js-3.8.0&auto=format&s=a85a75de29f91572a353fd7488b1f025 not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1269%252F17991269%252Fexterior_rear_passenger-1774692900243.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_rear_passenger-1774692900243.jpeg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F15938519%252Fexterior_rear_driver-1774545260899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_rear_driver-1774545260899.jpg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9137%252F15189137%252Finterior_boot-1774697753707.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9137/15189137/interior_boot-1774697753707.jpg not downloaded yet
2026-03-29 20:04:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafeb990>
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6507%252F20366507%252Finterior_boot-1774203529423.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6507/20366507/interior_boot-1774203529423.jpg saved to cache
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8bd2af70-ce3e-531a-99f4-e3799399d945
2026-03-29 20:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8 with identifier: 20403490
2026-03-29 20:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8 with scrape type 1
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F20403490%252Fexterior_front_driver-1774266481556.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_front_driver-1774266481556.jpg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1269%252F17991269%252Finterior_front_seats-1774692981517.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1269/17991269/interior_front_seats-1774692981517.jpeg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F15938519%252Fexterior_front_passenger-1774545262590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_front_passenger-1774545262590.jpg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9137%252F15189137%252Fdocs_service_history-1774698282643.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df421ad698b5253e5e92d681c4ef3a6dd%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9137/15189137/docs_service_history-1774698282643.jpg?ixlib=js-3.8.0&auto=format&s=f421ad698b5253e5e92d681c4ef3a6dd not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F20403490%252Fexterior_rear_driver-1774266517702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_rear_driver-1774266517702.jpg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1269%252F17991269%252Finterior_rear_seats-1774693204880.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1269/17991269/interior_rear_seats-1774693204880.jpeg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F15938519%252Fexterior_rear_passenger-1774545256730.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_rear_passenger-1774545256730.jpg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9137%252F15189137%252Fdocs_service_history-1774698282584.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D24acc467fc72f96812b612aef4bd072f%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9137/15189137/docs_service_history-1774698282584.jpg?ixlib=js-3.8.0&auto=format&s=24acc467fc72f96812b612aef4bd072f not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F20403490%252Fexterior_front_passenger-1774266549700.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_front_passenger-1774266549700.jpg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1269%252F17991269%252Finterior_dashboard-1774693260568.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1269/17991269/interior_dashboard-1774693260568.jpeg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8519%252F15938519%252Finterior_front_seats-1774545696648.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8519/15938519/interior_front_seats-1774545696648.jpg not downloaded yet
2026-03-29 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_front_driver-1774703198296.jpeg> (referer: None)
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F20403490%252Fexterior_rear_passenger-1774266530818.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_rear_passenger-1774266530818.jpg not downloaded yet
2026-03-29 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_front_driver-1774714723851.jpg> (referer: None)
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1269%252F17991269%252Finterior_boot-1774693272494.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1269/17991269/interior_boot-1774693272494.jpeg not downloaded yet
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8519%252F15938519%252Finterior_rear_seats-1774548333020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8519/15938519/interior_rear_seats-1774548333020.jpg not downloaded yet
2026-03-29 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6507/20366507/interior_dashboard-1774611735850.jpg> (referer: None)
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3490%252F20403490%252Finterior_front_seats-1774266971850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3490/20403490/interior_front_seats-1774266971850.jpg not downloaded yet
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1269%252F17991269%252F17991269-damage_scratches-default-1765192957127.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1269/17991269/17991269-damage_scratches-default-1765192957127.jpg not downloaded yet
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8519%252F15938519%252Finterior_dashboard-1774548347561.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8519/15938519/interior_dashboard-1774548347561.jpg not downloaded yet
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3490%252F20403490%252Finterior_rear_seats-1774267156856.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3490/20403490/interior_rear_seats-1774267156856.jpg not downloaded yet
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1269%252F17991269%252F17991269-damage_scratches-default-1765192961166.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1269/17991269/17991269-damage_scratches-default-1765192961166.jpg not downloaded yet
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8519%252F15938519%252Finstrument_cluster-1774548359488.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8519/15938519/instrument_cluster-1774548359488.jpg not downloaded yet
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F20403490%252Finterior_dashboard-1774267054222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/20403490/interior_dashboard-1774267054222.jpg not downloaded yet
2026-03-29 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_rear_passenger-1773166921255.jpg> (referer: None)
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8519%252F15938519%252Finterior_boot-1774545694898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8519/15938519/interior_boot-1774545694898.jpg not downloaded yet
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f861fb50>
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6645%252F14866645%252Fexterior_front_driver-1774703198296.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_front_driver-1774703198296.jpeg saved to cache
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81b7890>
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6112%252F20346112%252Fexterior_front_driver-1774714723851.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_front_driver-1774714723851.jpg saved to cache
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18a8539b-3bea-5139-a68f-870f52e33a47
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F20403490%252Finstrument_cluster-1774267239743.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/20403490/instrument_cluster-1774267239743.jpg not downloaded yet
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8519%252F15938519%252Fdocs_service_history-1774546252297.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5e894dc6637ec119fafc663d6f5df438%27 HTTP/1.1" 200 None
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8519/15938519/docs_service_history-1774546252297.jpg?ixlib=js-3.8.0&auto=format&s=5e894dc6637ec119fafc663d6f5df438 not downloaded yet
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8452290>
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6507%252F20366507%252Finterior_dashboard-1774611735850.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6507/20366507/interior_dashboard-1774611735850.jpg saved to cache
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8bd2af70-ce3e-531a-99f4-e3799399d945
2026-03-29 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6387/5286387/interior_boot-1774781488713.jpg> (referer: None)
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3490%252F20403490%252Finterior_boot-1774267065510.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3490/20403490/interior_boot-1774267065510.jpg not downloaded yet
2026-03-29 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_front_passenger-1774714771568.jpg> (referer: None)
2026-03-29 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6645/14866645/interior_dashboard-1774703753664.jpeg> (referer: None)
2026-03-29 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9137/15189137/exterior_front_passenger-1774699493527.jpg> (referer: None)
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3490%252F20403490%252Fdocs_service_history-1774268508972.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2c163dbea68dafb5a2545616e21d1fa8%27 HTTP/1.1" 200 None
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3490/20403490/docs_service_history-1774268508972.jpg?ixlib=js-3.8.0&auto=format&s=2c163dbea68dafb5a2545616e21d1fa8 not downloaded yet
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84511d0>
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0691%252F20140691%252Fexterior_rear_passenger-1773166921255.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_rear_passenger-1773166921255.jpg saved to cache
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de4d1af1-3b37-5867-a54c-d14c990ea18a
2026-03-29 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9137/15189137/docs_service_history-1774698282643.jpg?ixlib=js-3.8.0&auto=format&s=f421ad698b5253e5e92d681c4ef3a6dd> (referer: None)
2026-03-29 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9137/15189137/exterior_rear_driver-1774697377255.jpg> (referer: None)
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f816d910>
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6387%252F5286387%252Finterior_boot-1774781488713.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6387/5286387/interior_boot-1774781488713.jpg saved to cache
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f828e850>
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6112%252F20346112%252Fexterior_front_passenger-1774714771568.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_front_passenger-1774714771568.jpg saved to cache
2026-03-29 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18a8539b-3bea-5139-a68f-870f52e33a47
2026-03-29 20:04:27 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:27 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:27 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*\xcb\xd0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xa5V\x00*\xc1\xc0\x00\x00\x00\x00'
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fdac90>
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6645%252F14866645%252Finterior_dashboard-1774703753664.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6645/14866645/interior_dashboard-1774703753664.jpeg saved to cache
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf5b590>
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9137%252F15189137%252Fexterior_front_passenger-1774699493527.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9137/15189137/exterior_front_passenger-1774699493527.jpg saved to cache
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98405d19-77ec-5c93-9b58-4a6af63db7dd
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf75490>
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9137%252F15189137%252Fdocs_service_history-1774698282643.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df421ad698b5253e5e92d681c4ef3a6dd') HTTP/1.1" 204 0
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9137/15189137/docs_service_history-1774698282643.jpg?ixlib=js-3.8.0&auto=format&s=f421ad698b5253e5e92d681c4ef3a6dd saved to cache
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98405d19-77ec-5c93-9b58-4a6af63db7dd
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9158190>
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9137%252F15189137%252Fexterior_rear_driver-1774697377255.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9137/15189137/exterior_rear_driver-1774697377255.jpg saved to cache
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98405d19-77ec-5c93-9b58-4a6af63db7dd
2026-03-29 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_front_passenger-1774545262590.jpg> (referer: None)
2026-03-29 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_rear_driver-1774266517702.jpg> (referer: None)
2026-03-29 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6112/20346112/docs_service_history-1774715534199.jpg?ixlib=js-3.8.0&auto=format&s=e87a9766ef953d500e1f40ac706ee004> (referer: None)
2026-03-29 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1269/17991269/interior_front_seats-1774692981517.jpeg> (referer: None)
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faecf9d0>
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F15938519%252Fexterior_front_passenger-1774545262590.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_front_passenger-1774545262590.jpg saved to cache
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1df043fd-d235-501e-be06-8bd1f9e00f9a
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8faf6d0>
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F20403490%252Fexterior_rear_driver-1774266517702.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_rear_driver-1774266517702.jpg saved to cache
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81b4ad0>
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6112%252F20346112%252Fdocs_service_history-1774715534199.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De87a9766ef953d500e1f40ac706ee004') HTTP/1.1" 204 0
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6112/20346112/docs_service_history-1774715534199.jpg?ixlib=js-3.8.0&auto=format&s=e87a9766ef953d500e1f40ac706ee004 saved to cache
2026-03-29 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18a8539b-3bea-5139-a68f-870f52e33a47
2026-03-29 20:04:28 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:28 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:28 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00G\xdc\x1f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03E\xf2\x00G\xd2\xab\x00\x00\x00\x00'
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8701c10f50>
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1269%252F17991269%252Finterior_front_seats-1774692981517.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1269/17991269/interior_front_seats-1774692981517.jpeg saved to cache
2026-03-29 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 636d94ac-c67c-510f-93de-084f8fdf9cde
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0691/20140691/interior_front_seats-1773168158222.jpg> (referer: None)
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8519/15938519/instrument_cluster-1774548359488.jpg> (referer: None)
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0691/20140691/interior_rear_seats-1773167761728.jpg> (referer: None)
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3490/20403490/docs_service_history-1774268508972.jpg?ixlib=js-3.8.0&auto=format&s=2c163dbea68dafb5a2545616e21d1fa8> (referer: None)
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8519/15938519/docs_service_history-1774546252297.jpg?ixlib=js-3.8.0&auto=format&s=5e894dc6637ec119fafc663d6f5df438> (referer: None)
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1269/17991269/17991269-damage_scratches-default-1765192961166.jpg> (referer: None)
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8519/15938519/interior_dashboard-1774548347561.jpg> (referer: None)
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1269/17991269/17991269-damage_scratches-default-1765192957127.jpg> (referer: None)
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8519/15938519/interior_boot-1774545694898.jpg> (referer: None)
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3490/20403490/interior_dashboard-1774267054222.jpg> (referer: None)
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3490/20403490/interior_rear_seats-1774267156856.jpg> (referer: None)
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3490/20403490/instrument_cluster-1774267239743.jpg> (referer: None)
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3490/20403490/interior_front_seats-1774266971850.jpg> (referer: None)
2026-03-29 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3490/20403490/interior_boot-1774267065510.jpg> (referer: None)
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2026:03:10 18:42:24\x00'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S721B\x00'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S721BXXS7CYJ5\x00'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010dbc90>
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0691%252F20140691%252Finterior_front_seats-1773168158222.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0691/20140691/interior_front_seats-1773168158222.jpg saved to cache
2026-03-29 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de4d1af1-3b37-5867-a54c-d14c990ea18a
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf74650>
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8519%252F15938519%252Finstrument_cluster-1774548359488.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8519/15938519/instrument_cluster-1774548359488.jpg saved to cache
2026-03-29 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1df043fd-d235-501e-be06-8bd1f9e00f9a
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2026:03:10 18:28:12\x00'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S721B\x00'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S721BXXS7CYJ5\x00'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f2b710>
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0691%252F20140691%252Finterior_rear_seats-1773167761728.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0691/20140691/interior_rear_seats-1773167761728.jpg saved to cache
2026-03-29 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de4d1af1-3b37-5867-a54c-d14c990ea18a
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9310610>
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3490%252F20403490%252Fdocs_service_history-1774268508972.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2c163dbea68dafb5a2545616e21d1fa8') HTTP/1.1" 204 0
2026-03-29 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3490/20403490/docs_service_history-1774268508972.jpg?ixlib=js-3.8.0&auto=format&s=2c163dbea68dafb5a2545616e21d1fa8 saved to cache
2026-03-29 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9457510>
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8519%252F15938519%252Fdocs_service_history-1774546252297.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5e894dc6637ec119fafc663d6f5df438') HTTP/1.1" 204 0
2026-03-29 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8519/15938519/docs_service_history-1774546252297.jpg?ixlib=js-3.8.0&auto=format&s=5e894dc6637ec119fafc663d6f5df438 saved to cache
2026-03-29 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1df043fd-d235-501e-be06-8bd1f9e00f9a
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafeb410>
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1269%252F17991269%252F17991269-damage_scratches-default-1765192961166.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1269/17991269/17991269-damage_scratches-default-1765192961166.jpg saved to cache
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 636d94ac-c67c-510f-93de-084f8fdf9cde
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8634f50>
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8519%252F15938519%252Finterior_dashboard-1774548347561.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8519/15938519/interior_dashboard-1774548347561.jpg saved to cache
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1df043fd-d235-501e-be06-8bd1f9e00f9a
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9310210>
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1269%252F17991269%252F17991269-damage_scratches-default-1765192957127.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1269/17991269/17991269-damage_scratches-default-1765192957127.jpg saved to cache
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 636d94ac-c67c-510f-93de-084f8fdf9cde
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f2b450>
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8519%252F15938519%252Finterior_boot-1774545694898.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8519/15938519/interior_boot-1774545694898.jpg saved to cache
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1df043fd-d235-501e-be06-8bd1f9e00f9a
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f828d8d0>
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F20403490%252Finterior_dashboard-1774267054222.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/20403490/interior_dashboard-1774267054222.jpg saved to cache
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1c6290>
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3490%252F20403490%252Finterior_rear_seats-1774267156856.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3490/20403490/interior_rear_seats-1774267156856.jpg saved to cache
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f861c8d0>
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F20403490%252Finstrument_cluster-1774267239743.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/20403490/instrument_cluster-1774267239743.jpg saved to cache
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93691d0>
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3490%252F20403490%252Finterior_front_seats-1774266971850.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3490/20403490/interior_front_seats-1774266971850.jpg saved to cache
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafeb6d0>
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3490%252F20403490%252Finterior_boot-1774267065510.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3490/20403490/interior_boot-1774267065510.jpg saved to cache
2026-03-29 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8
2026-03-29 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_front_driver-1774545258829.jpg> (referer: None)
2026-03-29 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_front_driver-1774266481556.jpg> (referer: None)
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8fb9e10>
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F15938519%252Fexterior_front_driver-1774545258829.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_front_driver-1774545258829.jpg saved to cache
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1df043fd-d235-501e-be06-8bd1f9e00f9a
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabd8350>
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F20403490%252Fexterior_front_driver-1774266481556.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_front_driver-1774266481556.jpg saved to cache
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8
2026-03-29 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0691/20140691/docs_service_history-1774692713210.jpg?ixlib=js-3.8.0&auto=format&s=a85a75de29f91572a353fd7488b1f025> (referer: None)
2026-03-29 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9137/15189137/interior_dashboard-1774699477470.jpg> (referer: None)
2026-03-29 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9137/15189137/docs_service_history-1774698282584.jpg?ixlib=js-3.8.0&auto=format&s=24acc467fc72f96812b612aef4bd072f> (referer: None)
2026-03-29 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_rear_passenger-1774545256730.jpg> (referer: None)
2026-03-29 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1269/17991269/interior_dashboard-1774693260568.jpeg> (referer: None)
2026-03-29 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_front_passenger-1774692863509.jpeg> (referer: None)
2026-03-29 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8519/15938519/interior_front_seats-1774545696648.jpg> (referer: None)
2026-03-29 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_rear_passenger-1774692900243.jpeg> (referer: None)
2026-03-29 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_front_passenger-1774266549700.jpg> (referer: None)
2026-03-29 20:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x048'
2026-03-29 20:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\t$'
2026-03-29 20:04:31 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 46 - Data Location: 86 - value: <table: 41 bytes>
2026-03-29 20:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x93'
2026-03-29 20:04:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:31 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 82 - Data Location: 127 - value: b'2026:03:27 10:47:37\x00'
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d6b90>
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0691%252F20140691%252Fdocs_service_history-1774692713210.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da85a75de29f91572a353fd7488b1f025') HTTP/1.1" 204 0
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0691/20140691/docs_service_history-1774692713210.jpg?ixlib=js-3.8.0&auto=format&s=a85a75de29f91572a353fd7488b1f025 saved to cache
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de4d1af1-3b37-5867-a54c-d14c990ea18a
2026-03-29 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_rear_driver-1774545260899.jpg> (referer: None)
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cf9990>
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9137%252F15189137%252Finterior_dashboard-1774699477470.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9137/15189137/interior_dashboard-1774699477470.jpg saved to cache
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98405d19-77ec-5c93-9b58-4a6af63db7dd
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f861fed0>
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9137%252F15189137%252Fdocs_service_history-1774698282584.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D24acc467fc72f96812b612aef4bd072f') HTTP/1.1" 204 0
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9137/15189137/docs_service_history-1774698282584.jpg?ixlib=js-3.8.0&auto=format&s=24acc467fc72f96812b612aef4bd072f saved to cache
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98405d19-77ec-5c93-9b58-4a6af63db7dd
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f904b590>
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F15938519%252Fexterior_rear_passenger-1774545256730.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_rear_passenger-1774545256730.jpg saved to cache
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1df043fd-d235-501e-be06-8bd1f9e00f9a
2026-03-29 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_rear_passenger-1774266530818.jpg> (referer: None)
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9054bd0>
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1269%252F17991269%252Finterior_dashboard-1774693260568.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1269/17991269/interior_dashboard-1774693260568.jpeg saved to cache
2026-03-29 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 636d94ac-c67c-510f-93de-084f8fdf9cde
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f934fe50>
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1269%252F17991269%252Fexterior_front_passenger-1774692863509.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_front_passenger-1774692863509.jpeg saved to cache
2026-03-29 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 636d94ac-c67c-510f-93de-084f8fdf9cde
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae9d150>
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8519%252F15938519%252Finterior_front_seats-1774545696648.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8519/15938519/interior_front_seats-1774545696648.jpg saved to cache
2026-03-29 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1df043fd-d235-501e-be06-8bd1f9e00f9a
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f825ec90>
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1269%252F17991269%252Fexterior_rear_passenger-1774692900243.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_rear_passenger-1774692900243.jpeg saved to cache
2026-03-29 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 636d94ac-c67c-510f-93de-084f8fdf9cde
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f904b210>
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F20403490%252Fexterior_front_passenger-1774266549700.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_front_passenger-1774266549700.jpg saved to cache
2026-03-29 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d4b50>
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8519%252F15938519%252Fexterior_rear_driver-1774545260899.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_rear_driver-1774545260899.jpg saved to cache
2026-03-29 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1df043fd-d235-501e-be06-8bd1f9e00f9a
2026-03-29 20:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8519/15938519/interior_rear_seats-1774548333020.jpg> (referer: None)
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81ecd50>
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3490%252F20403490%252Fexterior_rear_passenger-1774266530818.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_rear_passenger-1774266530818.jpg saved to cache
2026-03-29 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8
2026-03-29 20:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8, skipping ID generation
2026-03-29 20:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8 with scrape type 1
2026-03-29 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8 sending to next pipeline
2026-03-29 20:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8, identifier: 20403490
2026-03-29 20:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8 with identifier: 20403490
2026-03-29 20:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8 with identifier: 20403490
2026-03-29 20:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 363ba0b1-eab0-5447-aa4f-26d8a9b22eb8 with identifier: 20403490 to the API
2026-03-29 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_rear_passenger-1774266530818.jpg>
{'auction_title': '',
'category': None,
'color': 'Beige',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '363ba0b1-eab0-5447-aa4f-26d8a9b22eb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MK18 HXU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20403490',
'listing': 'auction',
'location': 'Greater Manchester Altrincham',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 37020,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1620419,
'Height': 2429,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_front_driver-1774266481556.jpg',
'Width': 3239},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1702138,
'Height': 2461,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_rear_driver-1774266517702.jpg',
'Width': 3281},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1668145,
'Height': 2546,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_front_passenger-1774266549700.jpg',
'Width': 3395},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1858401,
'Height': 2592,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3490/20403490/exterior_rear_passenger-1774266530818.jpg',
'Width': 3456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3256723,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3490/20403490/interior_front_seats-1774266971850.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2387406,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3490/20403490/interior_rear_seats-1774267156856.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1795456,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3490/20403490/interior_dashboard-1774267054222.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2431306,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3490/20403490/instrument_cluster-1774267239743.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3614820,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3490/20403490/interior_boot-1774267065510.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_363ba0b1-eab0-5447-aa4f-26d8a9b22eb8/363ba0b1-eab0-5447-aa4f-26d8a9b22eb8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435688,
'Height': 3018,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3490/20403490/docs_service_history-1774268508972.jpg?ixlib=js-3.8.0&auto=format&s=2c163dbea68dafb5a2545616e21d1fa8',
'Width': 2132}],
'price': 7351,
'price_includes_vat': False,
'registration_date': '2018-03-22',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Fabia SE L TSI',
'transmission': 'manual',
'trim': 'SE L TSI',
'vin': 'TMBFP6NJ3JZ132175',
'year': 2018}
2026-03-29 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720403490%27 HTTP/1.1" 200 None
2026-03-29 20:04:33 [motorway.uk] INFO: Saving data for 20403490: {'created_time': 1774814673.587294, 'last_price_update_time': 1774814673.587306, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20403490') HTTP/1.1" 204 0
2026-03-29 20:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9663490>
2026-03-29 20:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8519%252F15938519%252Finterior_rear_seats-1774548333020.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8519/15938519/interior_rear_seats-1774548333020.jpg saved to cache
2026-03-29 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1df043fd-d235-501e-be06-8bd1f9e00f9a
2026-03-29 20:04:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1df043fd-d235-501e-be06-8bd1f9e00f9a, skipping ID generation
2026-03-29 20:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df043fd-d235-501e-be06-8bd1f9e00f9a with scrape type 1
2026-03-29 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1df043fd-d235-501e-be06-8bd1f9e00f9a sending to next pipeline
2026-03-29 20:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1df043fd-d235-501e-be06-8bd1f9e00f9a, identifier: 15938519
2026-03-29 20:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1df043fd-d235-501e-be06-8bd1f9e00f9a with identifier: 15938519
2026-03-29 20:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1df043fd-d235-501e-be06-8bd1f9e00f9a with identifier: 15938519
2026-03-29 20:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1df043fd-d235-501e-be06-8bd1f9e00f9a with identifier: 15938519 to the API
2026-03-29 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/8519/15938519/interior_rear_seats-1774548333020.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '1df043fd-d235-501e-be06-8bd1f9e00f9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FP71 NBK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15938519',
'listing': 'auction',
'location': 'Leicestershire Coalville',
'make': 'Kia',
'model': 'Sportage',
'odometer': 31539,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 946672,
'Height': 2153,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_front_driver-1774545258829.jpg',
'Width': 2871},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 972919,
'Height': 2218,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_rear_driver-1774545260899.jpg',
'Width': 2957},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1230353,
'Height': 2542,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_front_passenger-1774545262590.jpg',
'Width': 3389},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1046707,
'Height': 2191,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8519/15938519/exterior_rear_passenger-1774545256730.jpg',
'Width': 2921},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1623620,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8519/15938519/interior_front_seats-1774545696648.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1386636,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8519/15938519/interior_rear_seats-1774548333020.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1357003,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8519/15938519/interior_dashboard-1774548347561.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339028,
'Height': 1480,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8519/15938519/instrument_cluster-1774548359488.jpg',
'Width': 1974},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1642956,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8519/15938519/interior_boot-1774545694898.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1df043fd-d235-501e-be06-8bd1f9e00f9a/1df043fd-d235-501e-be06-8bd1f9e00f9a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 827719,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8519/15938519/docs_service_history-1774546252297.jpg?ixlib=js-3.8.0&auto=format&s=5e894dc6637ec119fafc663d6f5df438',
'Width': 2880}],
'price': 13345,
'price_includes_vat': False,
'registration_date': '2022-01-04',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage GT-LINE CRDI ISG MHEV',
'transmission': 'manual',
'trim': 'GT-LINE CRDI ISG MHEV',
'vin': 'U5YPK812LML144365',
'year': 2022}
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715938519%27 HTTP/1.1" 200 None
2026-03-29 20:04:34 [motorway.uk] INFO: Saving data for 15938519: {'created_time': 1774814674.133909, 'last_price_update_time': 1774814674.13392, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15938519') HTTP/1.1" 204 0
2026-03-29 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9137/15189137/interior_boot-1774697753707.jpg> (referer: None)
2026-03-29 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9137/15189137/exterior_front_driver-1774697318614.jpg> (referer: None)
2026-03-29 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_front_passenger-1773166937683.jpg> (referer: None)
2026-03-29 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9137/15189137/exterior_rear_passenger-1774697427040.jpg> (referer: None)
2026-03-29 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_rear_driver-1774692941628.jpeg> (referer: None)
2026-03-29 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0691/20140691/interior_dashboard-1773167528979.jpg> (referer: None)
2026-03-29 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9137/15189137/interior_front_seats-1774699507602.jpg> (referer: None)
2026-03-29 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1269/17991269/interior_boot-1774693272494.jpeg> (referer: None)
2026-03-29 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1269/17991269/interior_rear_seats-1774693204880.jpeg> (referer: None)
2026-03-29 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9137/15189137/interior_rear_seats-1774698021690.jpg> (referer: None)
2026-03-29 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_front_driver-1774692778305.jpeg> (referer: None)
2026-03-29 20:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fdad50>
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9137%252F15189137%252Finterior_boot-1774697753707.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9137/15189137/interior_boot-1774697753707.jpg saved to cache
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98405d19-77ec-5c93-9b58-4a6af63db7dd
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8aba590>
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9137%252F15189137%252Fexterior_front_driver-1774697318614.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9137/15189137/exterior_front_driver-1774697318614.jpg saved to cache
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98405d19-77ec-5c93-9b58-4a6af63db7dd
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a7f590>
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0691%252F20140691%252Fexterior_front_passenger-1773166937683.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_front_passenger-1773166937683.jpg saved to cache
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de4d1af1-3b37-5867-a54c-d14c990ea18a
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8275390>
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9137%252F15189137%252Fexterior_rear_passenger-1774697427040.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9137/15189137/exterior_rear_passenger-1774697427040.jpg saved to cache
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98405d19-77ec-5c93-9b58-4a6af63db7dd
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a7f690>
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1269%252F17991269%252Fexterior_rear_driver-1774692941628.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_rear_driver-1774692941628.jpeg saved to cache
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 636d94ac-c67c-510f-93de-084f8fdf9cde
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9495590>
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0691%252F20140691%252Finterior_dashboard-1773167528979.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0691/20140691/interior_dashboard-1773167528979.jpg saved to cache
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de4d1af1-3b37-5867-a54c-d14c990ea18a
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8277ed0>
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9137%252F15189137%252Finterior_front_seats-1774699507602.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9137/15189137/interior_front_seats-1774699507602.jpg saved to cache
2026-03-29 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98405d19-77ec-5c93-9b58-4a6af63db7dd
2026-03-29 20:04:34 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:34 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:34 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00>\xc41\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xf6\xdd\x00>\xba\xbd\x00\x00\x00\x00'
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a7f690>
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1269%252F17991269%252Finterior_boot-1774693272494.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1269/17991269/interior_boot-1774693272494.jpeg saved to cache
2026-03-29 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 636d94ac-c67c-510f-93de-084f8fdf9cde
2026-03-29 20:04:35 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:35 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:35 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00B\x06\xb0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x032\xff\x00A\xfd<\x00\x00\x00\x00'
2026-03-29 20:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9591510>
2026-03-29 20:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1269%252F17991269%252Finterior_rear_seats-1774693204880.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1269/17991269/interior_rear_seats-1774693204880.jpeg saved to cache
2026-03-29 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 636d94ac-c67c-510f-93de-084f8fdf9cde
2026-03-29 20:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8277890>
2026-03-29 20:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9137%252F15189137%252Finterior_rear_seats-1774698021690.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9137/15189137/interior_rear_seats-1774698021690.jpg saved to cache
2026-03-29 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98405d19-77ec-5c93-9b58-4a6af63db7dd
2026-03-29 20:04:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98405d19-77ec-5c93-9b58-4a6af63db7dd, skipping ID generation
2026-03-29 20:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98405d19-77ec-5c93-9b58-4a6af63db7dd with scrape type 1
2026-03-29 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98405d19-77ec-5c93-9b58-4a6af63db7dd sending to next pipeline
2026-03-29 20:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 98405d19-77ec-5c93-9b58-4a6af63db7dd, identifier: 15189137
2026-03-29 20:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d1c410>
2026-03-29 20:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1269%252F17991269%252Fexterior_front_driver-1774692778305.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_front_driver-1774692778305.jpeg saved to cache
2026-03-29 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 636d94ac-c67c-510f-93de-084f8fdf9cde
2026-03-29 20:04:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 636d94ac-c67c-510f-93de-084f8fdf9cde, skipping ID generation
2026-03-29 20:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 636d94ac-c67c-510f-93de-084f8fdf9cde with scrape type 1
2026-03-29 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 636d94ac-c67c-510f-93de-084f8fdf9cde sending to next pipeline
2026-03-29 20:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 636d94ac-c67c-510f-93de-084f8fdf9cde, identifier: 17991269
2026-03-29 20:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 98405d19-77ec-5c93-9b58-4a6af63db7dd with identifier: 15189137
2026-03-29 20:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 98405d19-77ec-5c93-9b58-4a6af63db7dd with identifier: 15189137
2026-03-29 20:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 98405d19-77ec-5c93-9b58-4a6af63db7dd with identifier: 15189137 to the API
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9137/15189137/interior_rear_seats-1774698021690.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '98405d19-77ec-5c93-9b58-4a6af63db7dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AJ03 JEN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15189137',
'listing': 'auction',
'location': 'Greater Manchester Cheadle',
'make': 'Peugeot',
'model': '2008',
'odometer': 32850,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 824585,
'Height': 1922,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9137/15189137/exterior_front_driver-1774697318614.jpg',
'Width': 2562},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1655542,
'Height': 2706,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9137/15189137/exterior_rear_driver-1774697377255.jpg',
'Width': 3608},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1492908,
'Height': 2292,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9137/15189137/exterior_front_passenger-1774699493527.jpg',
'Width': 3056},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1132776,
'Height': 2427,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9137/15189137/exterior_rear_passenger-1774697427040.jpg',
'Width': 3236},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2669069,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9137/15189137/interior_front_seats-1774699507602.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2595384,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9137/15189137/interior_rear_seats-1774698021690.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1983999,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9137/15189137/interior_dashboard-1774699477470.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2758059,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9137/15189137/interior_boot-1774697753707.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325576,
'Height': 1282,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9137/15189137/docs_service_history-1774698282643.jpg?ixlib=js-3.8.0&auto=format&s=f421ad698b5253e5e92d681c4ef3a6dd',
'Width': 1892},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98405d19-77ec-5c93-9b58-4a6af63db7dd/98405d19-77ec-5c93-9b58-4a6af63db7dd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369845,
'Height': 1314,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9137/15189137/docs_service_history-1774698282584.jpg?ixlib=js-3.8.0&auto=format&s=24acc467fc72f96812b612aef4bd072f',
'Width': 1938}],
'price': 11497,
'price_includes_vat': False,
'registration_date': '2020-07-11',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 2008 GT Line PureTech S/S Auto',
'transmission': 'automatic',
'trim': 'GT Line PureTech S/S Auto',
'vin': 'VR3USHNSSLJ696934',
'year': 2020}
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715189137%27 HTTP/1.1" 200 None
2026-03-29 20:04:35 [motorway.uk] INFO: Saving data for 15189137: {'created_time': 1774814675.992428, 'last_price_update_time': 1774814675.992441, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15189137') HTTP/1.1" 204 0
2026-03-29 20:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 636d94ac-c67c-510f-93de-084f8fdf9cde with identifier: 17991269
2026-03-29 20:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 636d94ac-c67c-510f-93de-084f8fdf9cde with identifier: 17991269
2026-03-29 20:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 636d94ac-c67c-510f-93de-084f8fdf9cde with identifier: 17991269 to the API
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_front_driver-1774692778305.jpeg>
{'auction_title': '',
'category': None,
'color': 'Orange',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '636d94ac-c67c-510f-93de-084f8fdf9cde',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FA19 MBF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17991269',
'listing': 'auction',
'location': 'Lincolnshire Alford',
'make': 'Vauxhall',
'model': 'Mokka',
'odometer': 28442,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2708452,
'Height': 2999,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_front_driver-1774692778305.jpeg',
'Width': 3998},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2002606,
'Height': 2691,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_rear_driver-1774692941628.jpeg',
'Width': 3588},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2557078,
'Height': 2999,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_front_passenger-1774692863509.jpeg',
'Width': 3998},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1992370,
'Height': 2718,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1269/17991269/exterior_rear_passenger-1774692900243.jpeg',
'Width': 3624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4923921,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1269/17991269/interior_front_seats-1774692981517.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4536751,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1269/17991269/interior_rear_seats-1774693204880.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1809845,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1269/17991269/interior_dashboard-1774693260568.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4307726,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1269/17991269/interior_boot-1774693272494.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2116866,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1269/17991269/17991269-damage_scratches-default-1765192957127.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_636d94ac-c67c-510f-93de-084f8fdf9cde/636d94ac-c67c-510f-93de-084f8fdf9cde_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1926966,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1269/17991269/17991269-damage_scratches-default-1765192961166.jpg',
'Width': 4032}],
'price': 8600,
'price_includes_vat': False,
'registration_date': '2019-06-25',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Mokka X Design NAV Turbo Auto',
'transmission': 'automatic',
'trim': 'X Design NAV Turbo Auto',
'vin': 'W0VJC7E80KB910554',
'year': 2019}
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717991269%27 HTTP/1.1" 200 None
2026-03-29 20:04:36 [motorway.uk] INFO: Saving data for 17991269: {'created_time': 1774814676.386781, 'last_price_update_time': 1774814676.386792, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17991269') HTTP/1.1" 204 0
2026-03-29 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6112/20346112/interior_boot-1774715205047.jpg> (referer: None)
2026-03-29 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6112/20346112/instrument_cluster-1774715223373.jpg> (referer: None)
2026-03-29 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_front_driver-1773166940294.jpg> (referer: None)
2026-03-29 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_rear_driver-1773166929199.jpg> (referer: None)
2026-03-29 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0691/20140691/interior_boot-1773167646600.jpg> (referer: None)
2026-03-29 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6112/20346112/interior_dashboard-1774715324568.jpg> (referer: None)
2026-03-29 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0691/20140691/instrument_cluster-1773167385896.jpg> (referer: None)
2026-03-29 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6112/20346112/interior_rear_seats-1774715261388.jpg> (referer: None)
2026-03-29 20:04:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:04:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae9f1d0>
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6112%252F20346112%252Finterior_boot-1774715205047.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6112/20346112/interior_boot-1774715205047.jpg saved to cache
2026-03-29 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18a8539b-3bea-5139-a68f-870f52e33a47
2026-03-29 20:04:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:04:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700da2650>
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6112%252F20346112%252Finstrument_cluster-1774715223373.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6112/20346112/instrument_cluster-1774715223373.jpg saved to cache
2026-03-29 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18a8539b-3bea-5139-a68f-870f52e33a47
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f934d910>
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0691%252F20140691%252Fexterior_front_driver-1773166940294.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_front_driver-1773166940294.jpg saved to cache
2026-03-29 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de4d1af1-3b37-5867-a54c-d14c990ea18a
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8244850>
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0691%252F20140691%252Fexterior_rear_driver-1773166929199.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_rear_driver-1773166929199.jpg saved to cache
2026-03-29 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de4d1af1-3b37-5867-a54c-d14c990ea18a
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2026:03:10 18:29:40\x00'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S721B\x00'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S721BXXS7CYJ5\x00'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8244fd0>
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0691%252F20140691%252Finterior_boot-1773167646600.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0691/20140691/interior_boot-1773167646600.jpg saved to cache
2026-03-29 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de4d1af1-3b37-5867-a54c-d14c990ea18a
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9046fd0>
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6112%252F20346112%252Finterior_dashboard-1774715324568.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6112/20346112/interior_dashboard-1774715324568.jpg saved to cache
2026-03-29 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18a8539b-3bea-5139-a68f-870f52e33a47
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2026:03:10 18:26:25\x00'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S721B\x00'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S721BXXS7CYJ5\x00'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9033990>
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0691%252F20140691%252Finstrument_cluster-1773167385896.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0691/20140691/instrument_cluster-1773167385896.jpg saved to cache
2026-03-29 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de4d1af1-3b37-5867-a54c-d14c990ea18a
2026-03-29 20:04:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de4d1af1-3b37-5867-a54c-d14c990ea18a, skipping ID generation
2026-03-29 20:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de4d1af1-3b37-5867-a54c-d14c990ea18a with scrape type 1
2026-03-29 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de4d1af1-3b37-5867-a54c-d14c990ea18a sending to next pipeline
2026-03-29 20:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: de4d1af1-3b37-5867-a54c-d14c990ea18a, identifier: 20140691
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700da1650>
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6112%252F20346112%252Finterior_rear_seats-1774715261388.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6112/20346112/interior_rear_seats-1774715261388.jpg saved to cache
2026-03-29 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18a8539b-3bea-5139-a68f-870f52e33a47
2026-03-29 20:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: de4d1af1-3b37-5867-a54c-d14c990ea18a with identifier: 20140691
2026-03-29 20:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: de4d1af1-3b37-5867-a54c-d14c990ea18a with identifier: 20140691
2026-03-29 20:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: de4d1af1-3b37-5867-a54c-d14c990ea18a with identifier: 20140691 to the API
2026-03-29 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0691/20140691/instrument_cluster-1773167385896.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'de4d1af1-3b37-5867-a54c-d14c990ea18a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DK71 XDD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20140691',
'listing': 'auction',
'location': 'Greater Manchester Bolton',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 41300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1113952,
'Height': 2292,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_front_driver-1773166940294.jpg',
'Width': 3056},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1049079,
'Height': 2059,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_rear_driver-1773166929199.jpg',
'Width': 2745},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1006486,
'Height': 2179,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_front_passenger-1773166937683.jpg',
'Width': 2905},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1147502,
'Height': 2254,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0691/20140691/exterior_rear_passenger-1773166921255.jpg',
'Width': 3005},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8520057,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/0691/20140691/interior_front_seats-1773168158222.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 9197148,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/0691/20140691/interior_rear_seats-1773167761728.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1392817,
'Height': 4080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0691/20140691/interior_dashboard-1773167528979.jpg',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 9051565,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0691/20140691/instrument_cluster-1773167385896.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8923246,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/0691/20140691/interior_boot-1773167646600.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de4d1af1-3b37-5867-a54c-d14c990ea18a/de4d1af1-3b37-5867-a54c-d14c990ea18a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93719,
'Height': 961,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0691/20140691/docs_service_history-1774692713210.jpg?ixlib=js-3.8.0&auto=format&s=a85a75de29f91572a353fd7488b1f025',
'Width': 1080}],
'price': 22150,
'price_includes_vat': False,
'registration_date': '2021-09-25',
'seats_number': None,
'seller_name': None,
'title': 'Cupra Formentor VZ2 TSI 4DRIVE S-A',
'transmission': 'automatic',
'trim': 'VZ2 TSI 4DRIVE S-A',
'vin': 'VSSZZZKMZNR000546',
'year': 2021}
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720140691%27 HTTP/1.1" 200 None
2026-03-29 20:04:38 [motorway.uk] INFO: Saving data for 20140691: {'created_time': 1774814678.209217, 'last_price_update_time': 1774814678.209228, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20140691') HTTP/1.1" 204 0
2026-03-29 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6645/14866645/instrument_cluster-1774703778199.jpeg> (referer: None)
2026-03-29 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_front_passenger-1774703351525.jpeg> (referer: None)
2026-03-29 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6645/14866645/14866645-docs_service_history-modified-1774707494429.jpeg?ixlib=js-3.8.0&auto=format&s=98e87286c2dcc4de7977ab065530327d> (referer: None)
2026-03-29 20:04:38 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:38 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:38 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00%^Q\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xb0\xe4\x00%TA\x00\x00\x00\x00'
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8245910>
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6645%252F14866645%252Finstrument_cluster-1774703778199.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6645/14866645/instrument_cluster-1774703778199.jpeg saved to cache
2026-03-29 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c1d890>
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6645%252F14866645%252Fexterior_front_passenger-1774703351525.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_front_passenger-1774703351525.jpeg saved to cache
2026-03-29 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f92725d0>
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6645%252F14866645%252F14866645-docs_service_history-modified-1774707494429.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D98e87286c2dcc4de7977ab065530327d') HTTP/1.1" 204 0
2026-03-29 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6645/14866645/14866645-docs_service_history-modified-1774707494429.jpeg?ixlib=js-3.8.0&auto=format&s=98e87286c2dcc4de7977ab065530327d saved to cache
2026-03-29 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9
2026-03-29 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_rear_passenger-1774703257760.jpeg> (referer: None)
2026-03-29 20:04:38 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (13322190) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8639/14508639/interior_boot-1774782229627.jpeg>.
2026-03-29 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6645/14866645/14866645-interior_rear_seats-modified-1774707416226.jpeg> (referer: None)
2026-03-29 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_rear_driver-1774714741314.jpg> (referer: None)
2026-03-29 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_rear_passenger-1774781212672.jpg> (referer: None)
2026-03-29 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_rear_passenger-1774714797118.jpg> (referer: None)
2026-03-29 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6387/5286387/interior_dashboard-1774781429178.jpg> (referer: None)
2026-03-29 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6507/20366507/exterior_rear_passenger-1774202607707.jpg> (referer: None)
2026-03-29 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6645/14866645/interior_boot-1774704022664.jpeg> (referer: None)
2026-03-29 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8639/14508639/docs_service_history-1774777142482.jpeg?ixlib=js-3.8.0&auto=format&s=6bec40835f83ae2edcb2a7bdd14369fb> (referer: None)
2026-03-29 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6112/20346112/interior_front_seats-1774715231580.jpg> (referer: None)
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9317e10>
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6645%252F14866645%252Fexterior_rear_passenger-1774703257760.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_rear_passenger-1774703257760.jpeg saved to cache
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9
2026-03-29 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6387/5286387/interior_front_seats-1774781371032.jpg> (referer: None)
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f23e90>
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6645%252F14866645%252F14866645-interior_rear_seats-modified-1774707416226.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6645/14866645/14866645-interior_rear_seats-modified-1774707416226.jpeg saved to cache
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d7dd0>
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6112%252F20346112%252Fexterior_rear_driver-1774714741314.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_rear_driver-1774714741314.jpg saved to cache
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18a8539b-3bea-5139-a68f-870f52e33a47
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90a2bd0>
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6387%252F5286387%252Fexterior_rear_passenger-1774781212672.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_rear_passenger-1774781212672.jpg saved to cache
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d4550>
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6112%252F20346112%252Fexterior_rear_passenger-1774714797118.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_rear_passenger-1774714797118.jpg saved to cache
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18a8539b-3bea-5139-a68f-870f52e33a47
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c337d0>
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6387%252F5286387%252Finterior_dashboard-1774781429178.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6387/5286387/interior_dashboard-1774781429178.jpg saved to cache
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafeaa50>
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6507%252F20366507%252Fexterior_rear_passenger-1774202607707.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6507/20366507/exterior_rear_passenger-1774202607707.jpg saved to cache
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bd2af70-ce3e-531a-99f4-e3799399d945
2026-03-29 20:04:39 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:39 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:39 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00>i\x9a\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xb9\xef\x00>_\x8a\x00\x00\x00\x00'
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafeb0d0>
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6645%252F14866645%252Finterior_boot-1774704022664.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6645/14866645/interior_boot-1774704022664.jpeg saved to cache
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90a0050>
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8639%252F14508639%252Fdocs_service_history-1774777142482.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6bec40835f83ae2edcb2a7bdd14369fb') HTTP/1.1" 204 0
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8639/14508639/docs_service_history-1774777142482.jpeg?ixlib=js-3.8.0&auto=format&s=6bec40835f83ae2edcb2a7bdd14369fb saved to cache
2026-03-29 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9aa13d31-d20e-5b33-88ab-4843d99a5063
2026-03-29 20:04:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:04:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d70d0>
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6112%252F20346112%252Finterior_front_seats-1774715231580.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6112/20346112/interior_front_seats-1774715231580.jpg saved to cache
2026-03-29 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18a8539b-3bea-5139-a68f-870f52e33a47
2026-03-29 20:04:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18a8539b-3bea-5139-a68f-870f52e33a47, skipping ID generation
2026-03-29 20:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a8539b-3bea-5139-a68f-870f52e33a47 with scrape type 1
2026-03-29 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18a8539b-3bea-5139-a68f-870f52e33a47 sending to next pipeline
2026-03-29 20:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 18a8539b-3bea-5139-a68f-870f52e33a47, identifier: 20346112
2026-03-29 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6507/20366507/exterior_front_passenger-1774610888317.jpg> (referer: None)
2026-03-29 20:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 18a8539b-3bea-5139-a68f-870f52e33a47 with identifier: 20346112
2026-03-29 20:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 18a8539b-3bea-5139-a68f-870f52e33a47 with identifier: 20346112
2026-03-29 20:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 18a8539b-3bea-5139-a68f-870f52e33a47 with identifier: 20346112 to the API
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6112/20346112/interior_front_seats-1774715231580.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '18a8539b-3bea-5139-a68f-870f52e33a47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DF68 XYS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20346112',
'listing': 'auction',
'location': 'Merseyside Southport',
'make': 'Kia',
'model': 'Sportage',
'odometer': 50300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1875380,
'Height': 2447,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_front_driver-1774714723851.jpg',
'Width': 3262},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2437304,
'Height': 2945,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_rear_driver-1774714741314.jpg',
'Width': 3927},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2065822,
'Height': 2501,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_front_passenger-1774714771568.jpg',
'Width': 3335},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1807595,
'Height': 2615,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6112/20346112/exterior_rear_passenger-1774714797118.jpg',
'Width': 3487},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3535803,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6112/20346112/interior_front_seats-1774715231580.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2898591,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6112/20346112/interior_rear_seats-1774715261388.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1844550,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6112/20346112/interior_dashboard-1774715324568.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2682365,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6112/20346112/instrument_cluster-1774715223373.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3027896,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6112/20346112/interior_boot-1774715205047.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18a8539b-3bea-5139-a68f-870f52e33a47/18a8539b-3bea-5139-a68f-870f52e33a47_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3309388,
'Height': 4284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6112/20346112/docs_service_history-1774715534199.jpg?ixlib=js-3.8.0&auto=format&s=e87a9766ef953d500e1f40ac706ee004',
'Width': 5712}],
'price': 10541,
'price_includes_vat': False,
'registration_date': '2019-02-27',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage 4 CRDI ISG',
'transmission': 'manual',
'trim': '4 CRDI ISG',
'vin': 'U5YPH812LKL671836',
'year': 2019}
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720346112%27 HTTP/1.1" 200 None
2026-03-29 20:04:40 [motorway.uk] INFO: Saving data for 20346112: {'created_time': 1774814680.562696, 'last_price_update_time': 1774814680.562711, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20346112') HTTP/1.1" 204 0
2026-03-29 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6645/14866645/interior_front_seats-1774703530130.jpeg> (referer: None)
2026-03-29 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81a64d0>
2026-03-29 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6387%252F5286387%252Finterior_front_seats-1774781371032.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6387/5286387/interior_front_seats-1774781371032.jpg saved to cache
2026-03-29 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03
2026-03-29 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facd7990>
2026-03-29 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6507%252F20366507%252Fexterior_front_passenger-1774610888317.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6507/20366507/exterior_front_passenger-1774610888317.jpg saved to cache
2026-03-29 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bd2af70-ce3e-531a-99f4-e3799399d945
2026-03-29 20:04:40 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:40 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:40 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x006\x1f-\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xa6\xbe\x006\x15\x1d\x00\x00\x00\x00'
2026-03-29 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f897dd50>
2026-03-29 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6645%252F14866645%252Finterior_front_seats-1774703530130.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6645/14866645/interior_front_seats-1774703530130.jpeg saved to cache
2026-03-29 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9
2026-03-29 20:04:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9, skipping ID generation
2026-03-29 20:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9 with scrape type 1
2026-03-29 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9 sending to next pipeline
2026-03-29 20:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9, identifier: 14866645
2026-03-29 20:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9 with identifier: 14866645
2026-03-29 20:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9 with identifier: 14866645
2026-03-29 20:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9 with identifier: 14866645 to the API
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6645/14866645/interior_front_seats-1774703530130.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KP13 STY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14866645',
'listing': 'auction',
'location': 'Hampshire Southampton',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 72000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2578710,
'Height': 2612,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_front_driver-1774703198296.jpeg',
'Width': 3482},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1895478,
'Height': 2529,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_rear_driver-1774703293605.jpeg',
'Width': 3372},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2624047,
'Height': 2576,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_front_passenger-1774703351525.jpeg',
'Width': 3434},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2472006,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6645/14866645/exterior_rear_passenger-1774703257760.jpeg',
'Width': 3454},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3720683,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6645/14866645/interior_front_seats-1774703530130.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2056222,
'Height': 2641,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6645/14866645/14866645-interior_rear_seats-modified-1774707416226.jpeg',
'Width': 3522},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2978086,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6645/14866645/interior_dashboard-1774703753664.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2559797,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6645/14866645/instrument_cluster-1774703778199.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4268937,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6645/14866645/interior_boot-1774704022664.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9/e8ea43d1-d9bb-51b5-b600-3d2cc44db6c9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237967,
'Height': 1443,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6645/14866645/14866645-docs_service_history-modified-1774707494429.jpeg?ixlib=js-3.8.0&auto=format&s=98e87286c2dcc4de7977ab065530327d',
'Width': 1924}],
'price': 10979,
'price_includes_vat': False,
'registration_date': '2017-11-16',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover RR Evoque HSE DYN LUX SI4 240A',
'transmission': 'automatic',
'trim': 'RR Evoque HSE DYN LUX SI4 240A',
'vin': 'SALVA2AX1JH278038',
'year': 2017}
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714866645%27 HTTP/1.1" 200 None
2026-03-29 20:04:41 [motorway.uk] INFO: Saving data for 14866645: {'created_time': 1774814681.609787, 'last_price_update_time': 1774814681.609797, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14866645') HTTP/1.1" 204 0
2026-03-29 20:04:41 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12920036) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8639/14508639/interior_rear_seats-1774782022919.jpeg>.
2026-03-29 20:04:41 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12804470) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8639/14508639/interior_front_seats-1774781807645.jpeg>.
2026-03-29 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6507/20366507/interior_rear_seats-1774203430536.jpg> (referer: None)
2026-03-29 20:04:41 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (16325906) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0111/16290111/interior_boot-1774718299089.jpeg>.
2026-03-29 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_front_passenger-1774781241578.jpg> (referer: None)
2026-03-29 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2784/20422784/docs_service_history-1774702997667.jpg?ixlib=js-3.8.0&auto=format&s=121e5014d76f05c2a150e712a79725ca> (referer: None)
2026-03-29 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6507/20366507/exterior_rear_driver-1774202591290.jpg> (referer: None)
2026-03-29 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_front_driver-1774781148688.jpg> (referer: None)
2026-03-29 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0111/16290111/docs_service_history-1774718812714.jpeg?ixlib=js-3.8.0&auto=format&s=e44d3beb965088799f1c310a68f062dc> (referer: None)
2026-03-29 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6507/20366507/exterior_front_driver-1774202544601.jpg> (referer: None)
2026-03-29 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_rear_driver-1774781182704.jpg> (referer: None)
2026-03-29 20:04:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f897eb90>
2026-03-29 20:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6507%252F20366507%252Finterior_rear_seats-1774203430536.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6507/20366507/interior_rear_seats-1774203430536.jpg saved to cache
2026-03-29 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8bd2af70-ce3e-531a-99f4-e3799399d945
2026-03-29 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2784/20422784/docs_service_history-1774703010487.jpg?ixlib=js-3.8.0&auto=format&s=5bcb1e83194c9aaf6fa334338ce70f64> (referer: None)
2026-03-29 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8639/14508639/14508639-interior_dashboard-modified-1774784033223.jpeg> (referer: None)
2026-03-29 20:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81a6b90>
2026-03-29 20:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6387%252F5286387%252Fexterior_front_passenger-1774781241578.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_front_passenger-1774781241578.jpg saved to cache
2026-03-29 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03
2026-03-29 20:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa514d0>
2026-03-29 20:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2784%252F20422784%252Fdocs_service_history-1774702997667.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D121e5014d76f05c2a150e712a79725ca') HTTP/1.1" 204 0
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2784/20422784/docs_service_history-1774702997667.jpg?ixlib=js-3.8.0&auto=format&s=121e5014d76f05c2a150e712a79725ca saved to cache
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb1cb3d6-571b-54f5-9ab0-489c62346d00
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010d9510>
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6507%252F20366507%252Fexterior_rear_driver-1774202591290.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6507/20366507/exterior_rear_driver-1774202591290.jpg saved to cache
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bd2af70-ce3e-531a-99f4-e3799399d945
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9056890>
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6387%252F5286387%252Fexterior_front_driver-1774781148688.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_front_driver-1774781148688.jpg saved to cache
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03
2026-03-29 20:04:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87016dd390>
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0111%252F16290111%252Fdocs_service_history-1774718812714.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De44d3beb965088799f1c310a68f062dc') HTTP/1.1" 204 0
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0111/16290111/docs_service_history-1774718812714.jpeg?ixlib=js-3.8.0&auto=format&s=e44d3beb965088799f1c310a68f062dc saved to cache
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9e829b2-2767-53be-be22-f36399a6713c
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f852f9d0>
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6507%252F20366507%252Fexterior_front_driver-1774202544601.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6507/20366507/exterior_front_driver-1774202544601.jpg saved to cache
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bd2af70-ce3e-531a-99f4-e3799399d945
2026-03-29 20:04:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bd2af70-ce3e-531a-99f4-e3799399d945, skipping ID generation
2026-03-29 20:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bd2af70-ce3e-531a-99f4-e3799399d945 with scrape type 1
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bd2af70-ce3e-531a-99f4-e3799399d945 sending to next pipeline
2026-03-29 20:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8bd2af70-ce3e-531a-99f4-e3799399d945, identifier: 20366507
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa02ced0>
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6387%252F5286387%252Fexterior_rear_driver-1774781182704.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_rear_driver-1774781182704.jpg saved to cache
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03
2026-03-29 20:04:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5055e9b5-43bb-5f48-8e36-5c040cacdd03, skipping ID generation
2026-03-29 20:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03 with scrape type 1
2026-03-29 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5055e9b5-43bb-5f48-8e36-5c040cacdd03 sending to next pipeline
2026-03-29 20:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5055e9b5-43bb-5f48-8e36-5c040cacdd03, identifier: 5286387
2026-03-29 20:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8bd2af70-ce3e-531a-99f4-e3799399d945 with identifier: 20366507
2026-03-29 20:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8bd2af70-ce3e-531a-99f4-e3799399d945 with identifier: 20366507
2026-03-29 20:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8bd2af70-ce3e-531a-99f4-e3799399d945 with identifier: 20366507 to the API
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6507/20366507/exterior_front_driver-1774202544601.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '8bd2af70-ce3e-531a-99f4-e3799399d945',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': '5 RBP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20366507',
'listing': 'auction',
'location': 'Hertfordshire St Albans',
'make': 'BMW',
'model': '5 Series',
'odometer': 102469,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2450400,
'Height': 2609,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6507/20366507/exterior_front_driver-1774202544601.jpg',
'Width': 3478},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2655393,
'Height': 2737,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6507/20366507/exterior_rear_driver-1774202591290.jpg',
'Width': 3649},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2576367,
'Height': 2617,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6507/20366507/exterior_front_passenger-1774610888317.jpg',
'Width': 3489},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2243051,
'Height': 2747,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6507/20366507/exterior_rear_passenger-1774202607707.jpg',
'Width': 3663},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3482954,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6507/20366507/interior_front_seats-1774203405560.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2870894,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6507/20366507/interior_rear_seats-1774203430536.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2000116,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6507/20366507/interior_dashboard-1774611735850.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2828238,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6507/20366507/interior_boot-1774203529423.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115937,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6507/20366507/docs_service_history-1774380888023.jpg?ixlib=js-3.8.0&auto=format&s=dfbe528e09f55a7f6410b4d0b0e2db93',
'Width': 596},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bd2af70-ce3e-531a-99f4-e3799399d945/8bd2af70-ce3e-531a-99f4-e3799399d945_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113209,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6507/20366507/docs_service_history-1774380888129.jpg?ixlib=js-3.8.0&auto=format&s=f2b75fd6d3c013e526c58ac8eb1a3444',
'Width': 596}],
'price': 14856,
'price_includes_vat': False,
'registration_date': '2018-03-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW 540I xDrive M Sport Auto',
'transmission': 'automatic',
'trim': '540I xDrive M Sport Auto',
'vin': 'WBAJB52040WC69219',
'year': 2018}
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720366507%27 HTTP/1.1" 200 None
2026-03-29 20:04:43 [motorway.uk] INFO: Saving data for 20366507: {'created_time': 1774814683.32671, 'last_price_update_time': 1774814683.326721, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20366507') HTTP/1.1" 204 0
2026-03-29 20:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5055e9b5-43bb-5f48-8e36-5c040cacdd03 with identifier: 5286387
2026-03-29 20:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5055e9b5-43bb-5f48-8e36-5c040cacdd03 with identifier: 5286387
2026-03-29 20:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5055e9b5-43bb-5f48-8e36-5c040cacdd03 with identifier: 5286387 to the API
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_rear_driver-1774781182704.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '5055e9b5-43bb-5f48-8e36-5c040cacdd03',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WO65 AET',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/5286387',
'listing': 'auction',
'location': 'Somerset Wells',
'make': 'Citroen',
'model': 'C1',
'odometer': 27100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1688269,
'Height': 2685,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_front_driver-1774781148688.jpg',
'Width': 3580},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1580514,
'Height': 2584,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_rear_driver-1774781182704.jpg',
'Width': 3445},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1665965,
'Height': 2626,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_front_passenger-1774781241578.jpg',
'Width': 3501},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1688560,
'Height': 2652,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6387/5286387/exterior_rear_passenger-1774781212672.jpg',
'Width': 3536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3543857,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6387/5286387/interior_front_seats-1774781371032.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3446100,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6387/5286387/interior_rear_seats-1774781392127.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2017368,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6387/5286387/interior_dashboard-1774781429178.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2397626,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6387/5286387/interior_boot-1774781488713.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1064468,
'Height': 1936,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6387/5286387/docs_service_history-1774779192517.jpg?ixlib=js-3.8.0&auto=format&s=d525b1f182c9a42f7d5ed361172d2cc3',
'Width': 2581},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5055e9b5-43bb-5f48-8e36-5c040cacdd03/5055e9b5-43bb-5f48-8e36-5c040cacdd03_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 854551,
'Height': 1955,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6387/5286387/docs_service_history-1774779204464.jpg?ixlib=js-3.8.0&auto=format&s=74c1ad238f9514b02b28a344f5320767',
'Width': 2607}],
'price': 3601,
'price_includes_vat': False,
'registration_date': '2016-02-10',
'seats_number': None,
'seller_name': None,
'title': 'Citroen C1 Touch',
'transmission': 'manual',
'trim': 'Touch',
'vin': 'VF7PSCFBCFR576348',
'year': 2016}
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275286387%27 HTTP/1.1" 200 None
2026-03-29 20:04:43 [motorway.uk] INFO: Saving data for 5286387: {'created_time': 1774814683.722241, 'last_price_update_time': 1774814683.722251, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='5286387') HTTP/1.1" 204 0
2026-03-29 20:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa4f410>
2026-03-29 20:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2784%252F20422784%252Fdocs_service_history-1774703010487.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5bcb1e83194c9aaf6fa334338ce70f64') HTTP/1.1" 204 0
2026-03-29 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2784/20422784/docs_service_history-1774703010487.jpg?ixlib=js-3.8.0&auto=format&s=5bcb1e83194c9aaf6fa334338ce70f64 saved to cache
2026-03-29 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb1cb3d6-571b-54f5-9ab0-489c62346d00
2026-03-29 20:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700e21890>
2026-03-29 20:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8639%252F14508639%252F14508639-interior_dashboard-modified-1774784033223.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8639/14508639/14508639-interior_dashboard-modified-1774784033223.jpeg saved to cache
2026-03-29 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9aa13d31-d20e-5b33-88ab-4843d99a5063
2026-03-29 20:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8639/14508639/instrument_cluster-1774782110679.jpeg> (referer: None)
2026-03-29 20:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0111/16290111/docs_service_history-1774718790010.jpeg?ixlib=js-3.8.0&auto=format&s=f0eeda3d995803744285b583a4ae00d5> (referer: None)
2026-03-29 20:04:44 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8639/14508639/interior_boot-1774782229627.jpeg>.
2026-03-29 20:04:44 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8639/14508639/interior_front_seats-1774781807645.jpeg>.
2026-03-29 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8639/14508639/interior_boot-1774782229627.jpeg> (referer: None)
2026-03-29 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2784/20422784/interior_boot-1774700242146.jpg> (referer: None)
2026-03-29 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8639/14508639/interior_front_seats-1774781807645.jpeg> (referer: None)
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00uz\xfc\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\x1b\x1c\x00up\xf0\x00\x00\x00\x00'
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ab1cd0>
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8639%252F14508639%252Finstrument_cluster-1774782110679.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8639/14508639/instrument_cluster-1774782110679.jpeg saved to cache
2026-03-29 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9aa13d31-d20e-5b33-88ab-4843d99a5063
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93209d0>
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0111%252F16290111%252Fdocs_service_history-1774718790010.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df0eeda3d995803744285b583a4ae00d5') HTTP/1.1" 204 0
2026-03-29 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0111/16290111/docs_service_history-1774718790010.jpeg?ixlib=js-3.8.0&auto=format&s=f0eeda3d995803744285b583a4ae00d5 saved to cache
2026-03-29 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9e829b2-2767-53be-be22-f36399a6713c
2026-03-29 20:04:44 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (14146890) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0111/16290111/interior_rear_seats-1774718228793.jpeg>.
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xc1RL\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\t\xf5\x82\x00\xc1H@\x00\x00\x00\x00'
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa07fa50>
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8639%252F14508639%252Finterior_boot-1774782229627.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8639/14508639/interior_boot-1774782229627.jpeg saved to cache
2026-03-29 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9aa13d31-d20e-5b33-88ab-4843d99a5063
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 12:16:59\x00'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A137F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafbd210>
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2784%252F20422784%252Finterior_boot-1774700242146.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2784/20422784/interior_boot-1774700242146.jpg saved to cache
2026-03-29 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb1cb3d6-571b-54f5-9ab0-489c62346d00
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xbc\x7fZ\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06\xe2\x1c\x00\xbcuN\x00\x00\x00\x00'
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa4d850>
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8639%252F14508639%252Finterior_front_seats-1774781807645.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8639/14508639/interior_front_seats-1774781807645.jpeg saved to cache
2026-03-29 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9aa13d31-d20e-5b33-88ab-4843d99a5063
2026-03-29 20:04:45 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (13549499) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0111/16290111/interior_front_seats-1774718146307.jpeg>.
2026-03-29 20:04:45 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8639/14508639/interior_rear_seats-1774782022919.jpeg>.
2026-03-29 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2784/20422784/interior_rear_seats-1774700327722.jpg> (referer: None)
2026-03-29 20:04:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0111/16290111/interior_dashboard-1774718271913.jpeg> (referer: None)
2026-03-29 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4845/20484845/docs_service_history-1774712961040.jpg?ixlib=js-3.8.0&auto=format&s=0fa834d5b1de112a6207b00f1007c54a> (referer: None)
2026-03-29 20:04:45 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0111/16290111/interior_boot-1774718299089.jpeg>.
2026-03-29 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8639/14508639/interior_rear_seats-1774782022919.jpeg> (referer: None)
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 12:18:41\x00'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A137F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81f3050>
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2784%252F20422784%252Finterior_rear_seats-1774700327722.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2784/20422784/interior_rear_seats-1774700327722.jpg saved to cache
2026-03-29 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb1cb3d6-571b-54f5-9ab0-489c62346d00
2026-03-29 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_front_driver-1774781503064.jpeg> (referer: None)
2026-03-29 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_rear_driver-1774781566013.jpeg> (referer: None)
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87004dc850>
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0111%252F16290111%252Finterior_dashboard-1774718271913.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0111/16290111/interior_dashboard-1774718271913.jpeg saved to cache
2026-03-29 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9e829b2-2767-53be-be22-f36399a6713c
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81ed310>
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5472f648-791f-5a3a-93f3-324430ca8149/5472f648-791f-5a3a-93f3-324430ca8149_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4845%252F20484845%252Fdocs_service_history-1774712961040.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0fa834d5b1de112a6207b00f1007c54a') HTTP/1.1" 204 0
2026-03-29 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4845/20484845/docs_service_history-1774712961040.jpg?ixlib=js-3.8.0&auto=format&s=0fa834d5b1de112a6207b00f1007c54a saved to cache
2026-03-29 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5472f648-791f-5a3a-93f3-324430ca8149
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:45 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xbe;\xa9\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06\xe9;\x00\xbe1\x9d\x00\x00\x00\x00'
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa2d090>
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8639%252F14508639%252Finterior_rear_seats-1774782022919.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8639/14508639/interior_rear_seats-1774782022919.jpeg saved to cache
2026-03-29 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9aa13d31-d20e-5b33-88ab-4843d99a5063
2026-03-29 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2784/20422784/interior_front_seats-1774700315651.jpg> (referer: None)
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faecd0d0>
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8639%252F14508639%252Fexterior_front_driver-1774781503064.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_front_driver-1774781503064.jpeg saved to cache
2026-03-29 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9aa13d31-d20e-5b33-88ab-4843d99a5063
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa315d0>
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8639%252F14508639%252Fexterior_rear_driver-1774781566013.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_rear_driver-1774781566013.jpeg saved to cache
2026-03-29 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9aa13d31-d20e-5b33-88ab-4843d99a5063
2026-03-29 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2784/20422784/exterior_rear_passenger-1774698887248.jpg> (referer: None)
2026-03-29 20:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 12:18:27\x00'
2026-03-29 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A137F\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae65450>
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2784%252F20422784%252Finterior_front_seats-1774700315651.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2784/20422784/interior_front_seats-1774700315651.jpg saved to cache
2026-03-29 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb1cb3d6-571b-54f5-9ab0-489c62346d00
2026-03-29 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0111/16290111/16290111-exterior_rear_passenger-modified-1774775465624.jpeg> (referer: None)
2026-03-29 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4845/20484845/instrument_cluster-1774713130453.jpg> (referer: None)
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d6dd0>
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2784%252F20422784%252Fexterior_rear_passenger-1774698887248.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2784/20422784/exterior_rear_passenger-1774698887248.jpg saved to cache
2026-03-29 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb1cb3d6-571b-54f5-9ab0-489c62346d00
2026-03-29 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_front_passenger-1774781526308.jpeg> (referer: None)
2026-03-29 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0111/16290111/interior_boot-1774718299089.jpeg> (referer: None)
2026-03-29 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4845/20484845/interior_boot-1774693388870.jpg> (referer: None)
2026-03-29 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0111/16290111/16290111-exterior_front_passenger-modified-1774775421868.jpeg> (referer: None)
2026-03-29 20:04:46 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0111/16290111/interior_rear_seats-1774718228793.jpeg>.
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa31e90>
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0111%252F16290111%252F16290111-exterior_rear_passenger-modified-1774775465624.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0111/16290111/16290111-exterior_rear_passenger-modified-1774775465624.jpeg saved to cache
2026-03-29 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9e829b2-2767-53be-be22-f36399a6713c
2026-03-29 20:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9321e50>
2026-03-29 20:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5472f648-791f-5a3a-93f3-324430ca8149/5472f648-791f-5a3a-93f3-324430ca8149_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4845%252F20484845%252Finstrument_cluster-1774713130453.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4845/20484845/instrument_cluster-1774713130453.jpg saved to cache
2026-03-29 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5472f648-791f-5a3a-93f3-324430ca8149
2026-03-29 20:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2784/20422784/exterior_front_passenger-1774698884417.jpg> (referer: None)
2026-03-29 20:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa7e2d0>
2026-03-29 20:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8639%252F14508639%252Fexterior_front_passenger-1774781526308.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_front_passenger-1774781526308.jpeg saved to cache
2026-03-29 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9aa13d31-d20e-5b33-88ab-4843d99a5063
2026-03-29 20:04:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9aa13d31-d20e-5b33-88ab-4843d99a5063, skipping ID generation
2026-03-29 20:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aa13d31-d20e-5b33-88ab-4843d99a5063 with scrape type 1
2026-03-29 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9aa13d31-d20e-5b33-88ab-4843d99a5063 sending to next pipeline
2026-03-29 20:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9aa13d31-d20e-5b33-88ab-4843d99a5063, identifier: 14508639
2026-03-29 20:04:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xf1{\xae\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07\xa1d\x00\xf1q4\x00\x00\x00\x00'
2026-03-29 20:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa157bd0>
2026-03-29 20:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0111%252F16290111%252Finterior_boot-1774718299089.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0111/16290111/interior_boot-1774718299089.jpeg saved to cache
2026-03-29 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9e829b2-2767-53be-be22-f36399a6713c
2026-03-29 20:04:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa4f110>
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5472f648-791f-5a3a-93f3-324430ca8149/5472f648-791f-5a3a-93f3-324430ca8149_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4845%252F20484845%252Finterior_boot-1774693388870.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4845/20484845/interior_boot-1774693388870.jpg saved to cache
2026-03-29 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5472f648-791f-5a3a-93f3-324430ca8149
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8855b10>
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0111%252F16290111%252F16290111-exterior_front_passenger-modified-1774775421868.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0111/16290111/16290111-exterior_front_passenger-modified-1774775421868.jpeg saved to cache
2026-03-29 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9e829b2-2767-53be-be22-f36399a6713c
2026-03-29 20:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9aa13d31-d20e-5b33-88ab-4843d99a5063 with identifier: 14508639
2026-03-29 20:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9aa13d31-d20e-5b33-88ab-4843d99a5063 with identifier: 14508639
2026-03-29 20:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9aa13d31-d20e-5b33-88ab-4843d99a5063 with identifier: 14508639 to the API
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_front_passenger-1774781526308.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '9aa13d31-d20e-5b33-88ab-4843d99a5063',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BF24 VGN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14508639',
'listing': 'auction',
'location': 'Shropshire Bridgnorth',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 14505,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5218105,
'Height': 4897,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_front_driver-1774781503064.jpeg',
'Width': 6529},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5279367,
'Height': 4969,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_rear_driver-1774781566013.jpeg',
'Width': 6625},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5938458,
'Height': 4901,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_front_passenger-1774781526308.jpeg',
'Width': 6534},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5757530,
'Height': 4913,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8639/14508639/exterior_rear_passenger-1774781544453.jpeg',
'Width': 6550},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 12804470,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8639/14508639/interior_front_seats-1774781807645.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 12920036,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8639/14508639/interior_rear_seats-1774782022919.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5562391,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8639/14508639/14508639-interior_dashboard-modified-1774784033223.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 8033816,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8639/14508639/instrument_cluster-1774782110679.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 13322190,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8639/14508639/interior_boot-1774782229627.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aa13d31-d20e-5b33-88ab-4843d99a5063/9aa13d31-d20e-5b33-88ab-4843d99a5063_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2935330,
'Height': 5712,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8639/14508639/docs_service_history-1774777142482.jpeg?ixlib=js-3.8.0&auto=format&s=6bec40835f83ae2edcb2a7bdd14369fb',
'Width': 4284}],
'price': 23488,
'price_includes_vat': False,
'registration_date': '2024-03-16',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Yaris Cross Excel HEV 4X4 Auto',
'transmission': 'automatic',
'trim': 'Cross Excel HEV 4X4 Auto',
'vin': 'JTDKCACB70A060189',
'year': 2024}
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714508639%27 HTTP/1.1" 200 None
2026-03-29 20:04:48 [motorway.uk] INFO: Saving data for 14508639: {'created_time': 1774814688.753183, 'last_price_update_time': 1774814688.753196, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14508639') HTTP/1.1" 204 0
2026-03-29 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=756&page=21&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f912e6d0>
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2784%252F20422784%252Fexterior_front_passenger-1774698884417.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2784/20422784/exterior_front_passenger-1774698884417.jpg saved to cache
2026-03-29 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb1cb3d6-571b-54f5-9ab0-489c62346d00
2026-03-29 20:04:48 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/0111/16290111/interior_front_seats-1774718146307.jpeg>.
2026-03-29 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4845/20484845/interior_dashboard-1774713209386.jpg> (referer: None)
2026-03-29 20:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4845/20484845/interior_rear_seats-1774693281048.jpg> (referer: None)
2026-03-29 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0111/16290111/interior_rear_seats-1774718228793.jpeg> (referer: None)
2026-03-29 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0111/16290111/interior_front_seats-1774718146307.jpeg> (referer: None)
2026-03-29 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0111/16290111/exterior_rear_driver-1774718108150.jpeg> (referer: None)
2026-03-29 20:04:48 [motorway.uk] INFO: Found listing with ID: 19444118
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719444118%27 HTTP/1.1" 200 None
2026-03-29 20:04:48 [motorway.uk] INFO: Scrape type for 19444118: 1
2026-03-29 20:04:48 [motorway.uk] INFO: Found listing with ID: 20486974
2026-03-29 20:04:48 [motorway.uk] INFO: Found listing with ID: 20486509
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486509%27 HTTP/1.1" 200 None
2026-03-29 20:04:48 [motorway.uk] INFO: Scrape type for 20486509: 1
2026-03-29 20:04:48 [motorway.uk] INFO: Found listing with ID: 14040355
2026-03-29 20:04:48 [motorway.uk] INFO: Found listing with ID: 17809843
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717809843%27 HTTP/1.1" 200 None
2026-03-29 20:04:48 [motorway.uk] INFO: Scrape type for 17809843: 1
2026-03-29 20:04:48 [motorway.uk] INFO: Found listing with ID: 20270906
2026-03-29 20:04:48 [motorway.uk] INFO: Found listing with ID: 9667311
2026-03-29 20:04:48 [motorway.uk] INFO: Found listing with ID: 19797838
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719797838%27 HTTP/1.1" 200 None
2026-03-29 20:04:48 [motorway.uk] INFO: Scrape type for 19797838: 1
2026-03-29 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2784/20422784/exterior_rear_driver-1774703422762.jpg> (referer: None)
2026-03-29 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0111/16290111/16290111-exterior_front_driver-modified-1774775407036.jpeg> (referer: None)
2026-03-29 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2784/20422784/exterior_front_driver-1774698883710.jpg> (referer: None)
2026-03-29 20:04:48 [motorway.uk] INFO: Found listing with ID: 20486919
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486919%27 HTTP/1.1" 200 None
2026-03-29 20:04:48 [motorway.uk] INFO: Scrape type for 20486919: 1
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8236090>
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5472f648-791f-5a3a-93f3-324430ca8149/5472f648-791f-5a3a-93f3-324430ca8149_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4845%252F20484845%252Finterior_dashboard-1774713209386.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4845/20484845/interior_dashboard-1774713209386.jpg saved to cache
2026-03-29 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5472f648-791f-5a3a-93f3-324430ca8149
2026-03-29 20:04:49 [motorway.uk] INFO: Found listing with ID: 20406062
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720406062%27 HTTP/1.1" 200 None
2026-03-29 20:04:49 [motorway.uk] INFO: Scrape type for 20406062: 1
2026-03-29 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94b4cd0>
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5472f648-791f-5a3a-93f3-324430ca8149/5472f648-791f-5a3a-93f3-324430ca8149_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4845%252F20484845%252Finterior_rear_seats-1774693281048.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4845/20484845/interior_rear_seats-1774693281048.jpg saved to cache
2026-03-29 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5472f648-791f-5a3a-93f3-324430ca8149
2026-03-29 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xcf\x12\xb5\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xca\x95\x00\xcf\x08;\x00\x00\x00\x00'
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ed6c50>
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0111%252F16290111%252Finterior_rear_seats-1774718228793.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0111/16290111/interior_rear_seats-1774718228793.jpeg saved to cache
2026-03-29 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9e829b2-2767-53be-be22-f36399a6713c
2026-03-29 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xc4\xb9\x11\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\n\x06\xaa\x00\xc4\xae\x97\x00\x00\x00\x00'
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81b5910>
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0111%252F16290111%252Finterior_front_seats-1774718146307.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0111/16290111/interior_front_seats-1774718146307.jpeg saved to cache
2026-03-29 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9e829b2-2767-53be-be22-f36399a6713c
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa11b890>
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0111%252F16290111%252Fexterior_rear_driver-1774718108150.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0111/16290111/exterior_rear_driver-1774718108150.jpeg saved to cache
2026-03-29 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9e829b2-2767-53be-be22-f36399a6713c
2026-03-29 20:04:50 [motorway.uk] INFO: Found listing with ID: 18135215
2026-03-29 20:04:50 [motorway.uk] INFO: Found listing with ID: 20348082
2026-03-29 20:04:50 [motorway.uk] INFO: Found listing with ID: 19815321
2026-03-29 20:04:50 [motorway.uk] INFO: Found listing with ID: 18899297
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718899297%27 HTTP/1.1" 200 None
2026-03-29 20:04:50 [motorway.uk] INFO: Scrape type for 18899297: 1
2026-03-29 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20363739.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:50 [motorway.uk] INFO: Found listing with ID: 20382953
2026-03-29 20:04:50 [motorway.uk] INFO: Found listing with ID: 15048808
2026-03-29 20:04:50 [motorway.uk] INFO: Found listing with ID: 20376604
2026-03-29 20:04:50 [motorway.uk] INFO: Found listing with ID: 19669683
2026-03-29 20:04:50 [motorway.uk] INFO: Found listing with ID: 16614089
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716614089%27 HTTP/1.1" 200 None
2026-03-29 20:04:50 [motorway.uk] INFO: Scrape type for 16614089: 1
2026-03-29 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8535210>
2026-03-29 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2784%252F20422784%252Fexterior_rear_driver-1774703422762.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2784/20422784/exterior_rear_driver-1774703422762.jpg saved to cache
2026-03-29 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb1cb3d6-571b-54f5-9ab0-489c62346d00
2026-03-29 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81b9410>
2026-03-29 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0111%252F16290111%252F16290111-exterior_front_driver-modified-1774775407036.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0111/16290111/16290111-exterior_front_driver-modified-1774775407036.jpeg saved to cache
2026-03-29 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9e829b2-2767-53be-be22-f36399a6713c
2026-03-29 20:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9e829b2-2767-53be-be22-f36399a6713c, skipping ID generation
2026-03-29 20:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9e829b2-2767-53be-be22-f36399a6713c with scrape type 1
2026-03-29 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9e829b2-2767-53be-be22-f36399a6713c sending to next pipeline
2026-03-29 20:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a9e829b2-2767-53be-be22-f36399a6713c, identifier: 16290111
2026-03-29 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8452a10>
2026-03-29 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2784%252F20422784%252Fexterior_front_driver-1774698883710.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2784/20422784/exterior_front_driver-1774698883710.jpg saved to cache
2026-03-29 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb1cb3d6-571b-54f5-9ab0-489c62346d00
2026-03-29 20:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb1cb3d6-571b-54f5-9ab0-489c62346d00, skipping ID generation
2026-03-29 20:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb1cb3d6-571b-54f5-9ab0-489c62346d00 with scrape type 1
2026-03-29 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb1cb3d6-571b-54f5-9ab0-489c62346d00 sending to next pipeline
2026-03-29 20:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bb1cb3d6-571b-54f5-9ab0-489c62346d00, identifier: 20422784
2026-03-29 20:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a9e829b2-2767-53be-be22-f36399a6713c with identifier: 16290111
2026-03-29 20:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a9e829b2-2767-53be-be22-f36399a6713c with identifier: 16290111
2026-03-29 20:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a9e829b2-2767-53be-be22-f36399a6713c with identifier: 16290111 to the API
2026-03-29 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0111/16290111/16290111-exterior_front_driver-modified-1774775407036.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a9e829b2-2767-53be-be22-f36399a6713c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LX68 NNH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16290111',
'listing': 'auction',
'location': 'Greater London London',
'make': 'MINI',
'model': 'Cooper',
'odometer': 37724,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6276233,
'Height': 4879,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0111/16290111/16290111-exterior_front_driver-modified-1774775407036.jpeg',
'Width': 6505},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4254804,
'Height': 4526,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0111/16290111/exterior_rear_driver-1774718108150.jpeg',
'Width': 6035},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6049826,
'Height': 4866,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0111/16290111/16290111-exterior_front_passenger-modified-1774775421868.jpeg',
'Width': 6488},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5121996,
'Height': 4488,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0111/16290111/16290111-exterior_rear_passenger-modified-1774775465624.jpeg',
'Width': 5984},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 13549499,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/0111/16290111/interior_front_seats-1774718146307.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 14146890,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/0111/16290111/interior_rear_seats-1774718228793.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7383965,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0111/16290111/interior_dashboard-1774718271913.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 16325906,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/0111/16290111/interior_boot-1774718299089.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2948368,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0111/16290111/docs_service_history-1774718790010.jpeg?ixlib=js-3.8.0&auto=format&s=f0eeda3d995803744285b583a4ae00d5',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e829b2-2767-53be-be22-f36399a6713c/a9e829b2-2767-53be-be22-f36399a6713c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2416353,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0111/16290111/docs_service_history-1774718812714.jpeg?ixlib=js-3.8.0&auto=format&s=e44d3beb965088799f1c310a68f062dc',
'Width': 4032}],
'price': 8126,
'price_includes_vat': False,
'registration_date': '2018-09-18',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'vin': 'WMWXR32020TL99671',
'year': 2018}
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716290111%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [motorway.uk] INFO: Saving data for 16290111: {'created_time': 1774814691.141529, 'last_price_update_time': 1774814691.14154, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16290111') HTTP/1.1" 204 0
2026-03-29 20:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bb1cb3d6-571b-54f5-9ab0-489c62346d00 with identifier: 20422784
2026-03-29 20:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bb1cb3d6-571b-54f5-9ab0-489c62346d00 with identifier: 20422784
2026-03-29 20:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bb1cb3d6-571b-54f5-9ab0-489c62346d00 with identifier: 20422784 to the API
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2784/20422784/exterior_front_driver-1774698883710.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'bb1cb3d6-571b-54f5-9ab0-489c62346d00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'NA14 YGE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20422784',
'listing': 'auction',
'location': 'Stockton-on-Tees Stockton-on-Tees',
'make': 'Volkswagen',
'model': 'Beetle',
'odometer': 93092,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332643,
'Height': 1038,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2784/20422784/exterior_front_driver-1774698883710.jpg',
'Width': 1384},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463928,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2784/20422784/exterior_rear_driver-1774703422762.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197939,
'Height': 878,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2784/20422784/exterior_front_passenger-1774698884417.jpg',
'Width': 1171},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 231542,
'Height': 891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2784/20422784/exterior_rear_passenger-1774698887248.jpg',
'Width': 1188},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 820317,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/2784/20422784/interior_front_seats-1774700315651.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 809097,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/2784/20422784/interior_rear_seats-1774700327722.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 802856,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2784/20422784/interior_dashboard-1774700257808.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 738594,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/2784/20422784/interior_boot-1774700242146.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1066309,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2784/20422784/docs_service_history-1774702997667.jpg?ixlib=js-3.8.0&auto=format&s=121e5014d76f05c2a150e712a79725ca',
'Width': 2880},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb1cb3d6-571b-54f5-9ab0-489c62346d00/bb1cb3d6-571b-54f5-9ab0-489c62346d00_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1288804,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2784/20422784/docs_service_history-1774703010487.jpg?ixlib=js-3.8.0&auto=format&s=5bcb1e83194c9aaf6fa334338ce70f64',
'Width': 2880}],
'price': 7852,
'price_includes_vat': False,
'registration_date': '2014-05-14',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Beetle Sport TDI S-A',
'transmission': 'automatic',
'trim': 'Sport TDI S-A',
'vin': 'WVWZZZ16ZEM813498',
'year': 2014}
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720422784%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [motorway.uk] INFO: Saving data for 20422784: {'created_time': 1774814691.648776, 'last_price_update_time': 1774814691.648788, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20422784') HTTP/1.1" 204 0
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 20281844
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 20472398
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 20463285
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 10521418
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710521418%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [motorway.uk] INFO: Scrape type for 10521418: 1
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 20325744
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 7322331
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 6590662
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 12561164
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712561164%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [motorway.uk] INFO: Scrape type for 12561164: 1
2026-03-29 20:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4336905a-6d4b-5182-ba0f-d223fbabbe56 with identifier: 20363739
2026-03-29 20:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4336905a-6d4b-5182-ba0f-d223fbabbe56 with scrape type 1
2026-03-29 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4336905a-6d4b-5182-ba0f-d223fbabbe56
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3739%252F20363739%252Fexterior_front_driver-1774617932127.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3739/20363739/exterior_front_driver-1774617932127.jpg not downloaded yet
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 20346563
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720346563%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [motorway.uk] INFO: Scrape type for 20346563: 1
2026-03-29 20:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3739%252F20363739%252Fexterior_rear_driver-1774617947514.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3739/20363739/exterior_rear_driver-1774617947514.jpg not downloaded yet
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 18746892
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 18935928
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 11445648
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 20471200
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471200%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [motorway.uk] INFO: Scrape type for 20471200: 1
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3739%252F20363739%252Fexterior_front_passenger-1774617966727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3739/20363739/exterior_front_passenger-1774617966727.jpg not downloaded yet
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 20259315
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720259315%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [motorway.uk] INFO: Scrape type for 20259315: 1
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3739%252F20363739%252Fexterior_rear_passenger-1774617958432.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3739/20363739/exterior_rear_passenger-1774617958432.jpg not downloaded yet
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 18569454
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 19681726
2026-03-29 20:04:51 [motorway.uk] INFO: Found listing with ID: 20483853
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483853%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [motorway.uk] INFO: Scrape type for 20483853: 1
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3739%252F20363739%252Finterior_front_seats-1774618342107.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3739/20363739/interior_front_seats-1774618342107.jpg not downloaded yet
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3739%252F20363739%252Finterior_rear_seats-1774618301297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3739/20363739/interior_rear_seats-1774618301297.jpg not downloaded yet
2026-03-29 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4845/20484845/exterior_rear_driver-1774692570442.jpg> (referer: None)
2026-03-29 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3739%252F20363739%252Finterior_dashboard-1774717731278.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3739/20363739/interior_dashboard-1774717731278.jpg not downloaded yet
2026-03-29 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20283277.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3739%252F20363739%252Finstrument_cluster-1774717528885.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3739/20363739/instrument_cluster-1774717528885.jpg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3739%252F20363739%252Finterior_boot-1774618324339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3739/20363739/interior_boot-1774618324339.jpg not downloaded yet
2026-03-29 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4845/20484845/exterior_rear_passenger-1774713191483.jpg> (referer: None)
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3739%252F20363739%252Fdamage_scratches-1774363575802.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3739/20363739/damage_scratches-1774363575802.jpg not downloaded yet
2026-03-29 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8534c90>
2026-03-29 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5472f648-791f-5a3a-93f3-324430ca8149/5472f648-791f-5a3a-93f3-324430ca8149_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4845%252F20484845%252Fexterior_rear_driver-1774692570442.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4845/20484845/exterior_rear_driver-1774692570442.jpg saved to cache
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5472f648-791f-5a3a-93f3-324430ca8149
2026-03-29 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/7660198.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df33850d-ad59-5b73-a974-1ffc3184bb29 with identifier: 20283277
2026-03-29 20:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df33850d-ad59-5b73-a974-1ffc3184bb29 with scrape type 1
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df33850d-ad59-5b73-a974-1ffc3184bb29
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3277%252F20283277%252Fexterior_front_driver-1774358783973.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3277/20283277/exterior_front_driver-1774358783973.jpg not downloaded yet
2026-03-29 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ed4090>
2026-03-29 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5472f648-791f-5a3a-93f3-324430ca8149/5472f648-791f-5a3a-93f3-324430ca8149_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4845%252F20484845%252Fexterior_rear_passenger-1774713191483.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4845/20484845/exterior_rear_passenger-1774713191483.jpg saved to cache
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5472f648-791f-5a3a-93f3-324430ca8149
2026-03-29 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15219874.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3277%252F20283277%252Fexterior_rear_driver-1774282496568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3277/20283277/exterior_rear_driver-1774282496568.jpg not downloaded yet
2026-03-29 20:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb5463ea-bbaa-50de-be3e-3ddc342cc7c4 with identifier: 7660198
2026-03-29 20:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb5463ea-bbaa-50de-be3e-3ddc342cc7c4 with scrape type 1
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb5463ea-bbaa-50de-be3e-3ddc342cc7c4
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0198%252F7660198%252Fexterior_front_driver-1774696852792.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0198/7660198/exterior_front_driver-1774696852792.jpeg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3277%252F20283277%252Fexterior_front_passenger-1774282730313.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3277/20283277/exterior_front_passenger-1774282730313.jpg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0198%252F7660198%252Fexterior_rear_driver-1774696828534.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0198/7660198/exterior_rear_driver-1774696828534.jpeg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3277%252F20283277%252Fexterior_rear_passenger-1774282716532.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3277/20283277/exterior_rear_passenger-1774282716532.jpg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0198%252F7660198%252Fexterior_front_passenger-1774696803959.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0198/7660198/exterior_front_passenger-1774696803959.jpeg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3277%252F20283277%252Finterior_front_seats-1774283062135.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3277/20283277/interior_front_seats-1774283062135.jpg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0198%252F7660198%252Fexterior_rear_passenger-1774696819465.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0198/7660198/exterior_rear_passenger-1774696819465.jpeg not downloaded yet
2026-03-29 20:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20fb1bc8-9299-5616-885b-a59d03fdec54 with identifier: 15219874
2026-03-29 20:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20fb1bc8-9299-5616-885b-a59d03fdec54 with scrape type 1
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20fb1bc8-9299-5616-885b-a59d03fdec54
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9874%252F15219874%252F15219874-exterior_front_driver-default-1774710247520.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9874/15219874/15219874-exterior_front_driver-default-1774710247520.jpg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3277%252F20283277%252Finterior_rear_seats-1774283085126.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3277/20283277/interior_rear_seats-1774283085126.jpg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0198%252F7660198%252Finterior_front_seats-1774696875225.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0198/7660198/interior_front_seats-1774696875225.jpeg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9874%252F15219874%252F15219874-exterior_rear_driver-default-1774710244985.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9874/15219874/15219874-exterior_rear_driver-default-1774710244985.jpg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3277%252F20283277%252Finterior_dashboard-1774284196932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3277/20283277/interior_dashboard-1774284196932.jpg not downloaded yet
2026-03-29 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4845/20484845/exterior_front_passenger-1774713182770.jpg> (referer: None)
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0198%252F7660198%252Finterior_rear_seats-1774696907635.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0198/7660198/interior_rear_seats-1774696907635.jpeg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9874%252F15219874%252F15219874-exterior_front_passenger-default-1774710245785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9874/15219874/15219874-exterior_front_passenger-default-1774710245785.jpg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3277%252F20283277%252Finstrument_cluster-1774283173234.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3277/20283277/instrument_cluster-1774283173234.jpg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0198%252F7660198%252Finterior_dashboard-1774696938815.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0198/7660198/interior_dashboard-1774696938815.jpeg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9874%252F15219874%252F15219874-exterior_rear_passenger-default-1774710243671.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9874/15219874/15219874-exterior_rear_passenger-default-1774710243671.jpg not downloaded yet
2026-03-29 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3277%252F20283277%252Finterior_boot-1774283128922.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3277/20283277/interior_boot-1774283128922.jpg not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0198%252F7660198%252Finstrument_cluster-1774697025131.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0198/7660198/instrument_cluster-1774697025131.jpeg not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9874%252F15219874%252F15219874-interior_front_seats-modified-1774774764546.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9874/15219874/15219874-interior_front_seats-modified-1774774764546.jpeg not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3277%252F20283277%252Fdocs_service_history-1774358744988.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6600481050a8dd53eb408d9c29cbd85e%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3277/20283277/docs_service_history-1774358744988.jpg?ixlib=js-3.8.0&auto=format&s=6600481050a8dd53eb408d9c29cbd85e not downloaded yet
2026-03-29 20:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14405517.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadc5c90>
2026-03-29 20:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5472f648-791f-5a3a-93f3-324430ca8149/5472f648-791f-5a3a-93f3-324430ca8149_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4845%252F20484845%252Fexterior_front_passenger-1774713182770.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4845/20484845/exterior_front_passenger-1774713182770.jpg saved to cache
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5472f648-791f-5a3a-93f3-324430ca8149
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0198%252F7660198%252Finterior_boot-1774696950385.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0198/7660198/interior_boot-1774696950385.jpeg not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9874%252F15219874%252F15219874-interior_rear_seats-default-1774710491935.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9874/15219874/15219874-interior_rear_seats-default-1774710491935.jpg not downloaded yet
2026-03-29 20:04:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4845/20484845/interior_front_seats-1774693268125.jpg> (referer: None)
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0198%252F7660198%252Fdocs_service_history-1774698962303.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df2644f9c932960699ba4faaff2af69c8%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0198/7660198/docs_service_history-1774698962303.jpeg?ixlib=js-3.8.0&auto=format&s=f2644f9c932960699ba4faaff2af69c8 not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9874%252F15219874%252F15219874-interior_dashboard-default-1774710233489.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9874/15219874/15219874-interior_dashboard-default-1774710233489.jpg not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9874%252F15219874%252F15219874-instrument_cluster-default-1774710323761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9874/15219874/15219874-instrument_cluster-default-1774710323761.jpg not downloaded yet
2026-03-29 20:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 865761cc-8917-5a57-b876-59368ede7ad2 with identifier: 14405517
2026-03-29 20:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 865761cc-8917-5a57-b876-59368ede7ad2 with scrape type 1
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 865761cc-8917-5a57-b876-59368ede7ad2
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5517%252F14405517%252Fexterior_front_driver-1774709025484.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_front_driver-1774709025484.jpeg not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9874%252F15219874%252F15219874-interior_boot-default-1774710211042.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9874/15219874/15219874-interior_boot-default-1774710211042.jpg not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5517%252F14405517%252Fexterior_rear_driver-1774709076356.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_rear_driver-1774709076356.jpeg not downloaded yet
2026-03-29 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f967ed10>
2026-03-29 20:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5472f648-791f-5a3a-93f3-324430ca8149/5472f648-791f-5a3a-93f3-324430ca8149_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4845%252F20484845%252Finterior_front_seats-1774693268125.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4845/20484845/interior_front_seats-1774693268125.jpg saved to cache
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5472f648-791f-5a3a-93f3-324430ca8149
2026-03-29 20:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3277/20283277/docs_service_history-1774358744988.jpg?ixlib=js-3.8.0&auto=format&s=6600481050a8dd53eb408d9c29cbd85e> (referer: None)
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9874%252F15219874%252F15219874-docs_service_history-modified-1758028211801.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5d1083821ebe62d4322aa9bd3362563a%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9874/15219874/15219874-docs_service_history-modified-1758028211801.jpeg?ixlib=js-3.8.0&auto=format&s=5d1083821ebe62d4322aa9bd3362563a not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5517%252F14405517%252Fexterior_front_passenger-1774709041989.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_front_passenger-1774709041989.jpeg not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5517%252F14405517%252Fexterior_rear_passenger-1774709062493.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_rear_passenger-1774709062493.jpeg not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5517%252F14405517%252Finterior_front_seats-1774709135020.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5517/14405517/interior_front_seats-1774709135020.jpeg not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5517%252F14405517%252Finterior_rear_seats-1774709445580.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5517/14405517/interior_rear_seats-1774709445580.jpeg not downloaded yet
2026-03-29 20:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9474810>
2026-03-29 20:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df33850d-ad59-5b73-a974-1ffc3184bb29/df33850d-ad59-5b73-a974-1ffc3184bb29_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3277%252F20283277%252Fdocs_service_history-1774358744988.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6600481050a8dd53eb408d9c29cbd85e') HTTP/1.1" 204 0
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3277/20283277/docs_service_history-1774358744988.jpg?ixlib=js-3.8.0&auto=format&s=6600481050a8dd53eb408d9c29cbd85e saved to cache
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df33850d-ad59-5b73-a974-1ffc3184bb29
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5517%252F14405517%252Finterior_dashboard-1774709527782.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5517/14405517/interior_dashboard-1774709527782.jpeg not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5517%252F14405517%252Finstrument_cluster-1774709473148.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5517/14405517/instrument_cluster-1774709473148.jpeg not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5517%252F14405517%252F14405517-interior_boot-modified-1774711552970.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5517/14405517/14405517-interior_boot-modified-1774711552970.jpeg not downloaded yet
2026-03-29 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5517%252F14405517%252F14405517-docs_service_history-modified-1774711679178.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3e3a2918cef92e93ecc507d9d8c7cb80%27 HTTP/1.1" 200 None
2026-03-29 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5517/14405517/14405517-docs_service_history-modified-1774711679178.jpeg?ixlib=js-3.8.0&auto=format&s=3e3a2918cef92e93ecc507d9d8c7cb80 not downloaded yet
2026-03-29 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3277/20283277/exterior_front_driver-1774358783973.jpg> (referer: None)
2026-03-29 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9874/15219874/15219874-exterior_rear_driver-default-1774710244985.jpg> (referer: None)
2026-03-29 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3739/20363739/interior_rear_seats-1774618301297.jpg> (referer: None)
2026-03-29 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9874/15219874/15219874-interior_dashboard-default-1774710233489.jpg> (referer: None)
2026-03-29 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_rear_driver-1774709076356.jpeg> (referer: None)
2026-03-29 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3739/20363739/damage_scratches-1774363575802.jpg> (referer: None)
2026-03-29 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3739/20363739/interior_boot-1774618324339.jpg> (referer: None)
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84eefd0>
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df33850d-ad59-5b73-a974-1ffc3184bb29/df33850d-ad59-5b73-a974-1ffc3184bb29_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3277%252F20283277%252Fexterior_front_driver-1774358783973.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3277/20283277/exterior_front_driver-1774358783973.jpg saved to cache
2026-03-29 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df33850d-ad59-5b73-a974-1ffc3184bb29
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa108350>
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20fb1bc8-9299-5616-885b-a59d03fdec54/20fb1bc8-9299-5616-885b-a59d03fdec54_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9874%252F15219874%252F15219874-exterior_rear_driver-default-1774710244985.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9874/15219874/15219874-exterior_rear_driver-default-1774710244985.jpg saved to cache
2026-03-29 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20fb1bc8-9299-5616-885b-a59d03fdec54
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae0b510>
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4336905a-6d4b-5182-ba0f-d223fbabbe56/4336905a-6d4b-5182-ba0f-d223fbabbe56_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3739%252F20363739%252Finterior_rear_seats-1774618301297.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3739/20363739/interior_rear_seats-1774618301297.jpg saved to cache
2026-03-29 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4336905a-6d4b-5182-ba0f-d223fbabbe56
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8250550>
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20fb1bc8-9299-5616-885b-a59d03fdec54/20fb1bc8-9299-5616-885b-a59d03fdec54_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9874%252F15219874%252F15219874-interior_dashboard-default-1774710233489.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9874/15219874/15219874-interior_dashboard-default-1774710233489.jpg saved to cache
2026-03-29 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20fb1bc8-9299-5616-885b-a59d03fdec54
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94ab410>
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5517%252F14405517%252Fexterior_rear_driver-1774709076356.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_rear_driver-1774709076356.jpeg saved to cache
2026-03-29 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 865761cc-8917-5a57-b876-59368ede7ad2
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8251050>
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4336905a-6d4b-5182-ba0f-d223fbabbe56/4336905a-6d4b-5182-ba0f-d223fbabbe56_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3739%252F20363739%252Fdamage_scratches-1774363575802.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3739/20363739/damage_scratches-1774363575802.jpg saved to cache
2026-03-29 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4336905a-6d4b-5182-ba0f-d223fbabbe56
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fade3090>
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4336905a-6d4b-5182-ba0f-d223fbabbe56/4336905a-6d4b-5182-ba0f-d223fbabbe56_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3739%252F20363739%252Finterior_boot-1774618324339.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3739/20363739/interior_boot-1774618324339.jpg saved to cache
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4336905a-6d4b-5182-ba0f-d223fbabbe56
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/5517/14405517/14405517-docs_service_history-modified-1774711679178.jpeg?ixlib=js-3.8.0&auto=format&s=3e3a2918cef92e93ecc507d9d8c7cb80> (referer: None)
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5517/14405517/14405517-interior_boot-modified-1774711552970.jpeg> (referer: None)
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9874/15219874/15219874-docs_service_history-modified-1758028211801.jpeg?ixlib=js-3.8.0&auto=format&s=5d1083821ebe62d4322aa9bd3362563a> (referer: None)
2026-03-29 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8250450>
2026-03-29 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5517%252F14405517%252F14405517-docs_service_history-modified-1774711679178.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3e3a2918cef92e93ecc507d9d8c7cb80') HTTP/1.1" 204 0
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5517/14405517/14405517-docs_service_history-modified-1774711679178.jpeg?ixlib=js-3.8.0&auto=format&s=3e3a2918cef92e93ecc507d9d8c7cb80 saved to cache
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 865761cc-8917-5a57-b876-59368ede7ad2
2026-03-29 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facf0490>
2026-03-29 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5517%252F14405517%252F14405517-interior_boot-modified-1774711552970.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5517/14405517/14405517-interior_boot-modified-1774711552970.jpeg saved to cache
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 865761cc-8917-5a57-b876-59368ede7ad2
2026-03-29 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f851ac90>
2026-03-29 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20fb1bc8-9299-5616-885b-a59d03fdec54/20fb1bc8-9299-5616-885b-a59d03fdec54_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9874%252F15219874%252F15219874-docs_service_history-modified-1758028211801.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5d1083821ebe62d4322aa9bd3362563a') HTTP/1.1" 204 0
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9874/15219874/15219874-docs_service_history-modified-1758028211801.jpeg?ixlib=js-3.8.0&auto=format&s=5d1083821ebe62d4322aa9bd3362563a saved to cache
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20fb1bc8-9299-5616-885b-a59d03fdec54
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19797838.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10521418.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20406062.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486919.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12561164.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18899297.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_rear_passenger-1774709062493.jpeg> (referer: None)
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_front_passenger-1774709041989.jpeg> (referer: None)
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5517/14405517/interior_dashboard-1774709527782.jpeg> (referer: None)
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5517/14405517/instrument_cluster-1774709473148.jpeg> (referer: None)
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5517/14405517/interior_front_seats-1774709135020.jpeg> (referer: None)
2026-03-29 20:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94101075-92fa-524c-96bc-ebcbf1ec1a28 with identifier: 19797838
2026-03-29 20:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94101075-92fa-524c-96bc-ebcbf1ec1a28 with scrape type 1
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94101075-92fa-524c-96bc-ebcbf1ec1a28
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7838%252F19797838%252Fexterior_front_driver-1771670571443.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7838/19797838/exterior_front_driver-1771670571443.jpg not downloaded yet
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7838%252F19797838%252Fexterior_rear_driver-1771670575311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7838/19797838/exterior_rear_driver-1771670575311.jpg not downloaded yet
2026-03-29 20:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcbb1842-9020-5357-b439-bd54fe97f8cb with identifier: 10521418
2026-03-29 20:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcbb1842-9020-5357-b439-bd54fe97f8cb with scrape type 1
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcbb1842-9020-5357-b439-bd54fe97f8cb
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1418%252F10521418%252Fexterior_front_driver-1774701930475.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1418/10521418/exterior_front_driver-1774701930475.jpg not downloaded yet
2026-03-29 20:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dad55eb-b3e1-54f8-9435-5bc815d75381 with identifier: 20406062
2026-03-29 20:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dad55eb-b3e1-54f8-9435-5bc815d75381 with scrape type 1
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7dad55eb-b3e1-54f8-9435-5bc815d75381
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6062%252F20406062%252Fexterior_front_driver-1774694350223.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6062/20406062/exterior_front_driver-1774694350223.jpg not downloaded yet
2026-03-29 20:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7124d203-a7a7-5896-a67e-a98738e9a37d with identifier: 20486919
2026-03-29 20:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7124d203-a7a7-5896-a67e-a98738e9a37d with scrape type 1
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7124d203-a7a7-5896-a67e-a98738e9a37d
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6919%252F20486919%252Fexterior_front_driver-1774707111906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6919/20486919/exterior_front_driver-1774707111906.jpg not downloaded yet
2026-03-29 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5517/14405517/interior_rear_seats-1774709445580.jpeg> (referer: None)
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7838%252F19797838%252Fexterior_front_passenger-1771670567804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7838/19797838/exterior_front_passenger-1771670567804.jpg not downloaded yet
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1418%252F10521418%252Fexterior_rear_driver-1774701940399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1418/10521418/exterior_rear_driver-1774701940399.jpg not downloaded yet
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6062%252F20406062%252Fexterior_rear_driver-1774694379799.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6062/20406062/exterior_rear_driver-1774694379799.jpg not downloaded yet
2026-03-29 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6919%252F20486919%252Fexterior_rear_driver-1774707072742.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6919/20486919/exterior_rear_driver-1774707072742.jpg not downloaded yet
2026-03-29 20:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16614089.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b5f8538-a78c-5049-ac76-529becefd422 with identifier: 12561164
2026-03-29 20:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b5f8538-a78c-5049-ac76-529becefd422 with scrape type 1
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b5f8538-a78c-5049-ac76-529becefd422
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1164%252F12561164%252Fexterior_front_driver-1774705950179.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1164/12561164/exterior_front_driver-1774705950179.jpg not downloaded yet
2026-03-29 20:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 454fd327-df10-5223-8a5e-af36e330b64a with identifier: 18899297
2026-03-29 20:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 454fd327-df10-5223-8a5e-af36e330b64a with scrape type 1
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 454fd327-df10-5223-8a5e-af36e330b64a
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9297%252F18899297%252Fexterior_front_driver-1774705739024.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9297/18899297/exterior_front_driver-1774705739024.jpg not downloaded yet
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a3e3d0>
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5517%252F14405517%252Fexterior_rear_passenger-1774709062493.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_rear_passenger-1774709062493.jpeg saved to cache
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 865761cc-8917-5a57-b876-59368ede7ad2
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8881cd0>
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5517%252F14405517%252Fexterior_front_passenger-1774709041989.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_front_passenger-1774709041989.jpeg saved to cache
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 865761cc-8917-5a57-b876-59368ede7ad2
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8887c90>
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5517%252F14405517%252Finterior_dashboard-1774709527782.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5517/14405517/interior_dashboard-1774709527782.jpeg saved to cache
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 865761cc-8917-5a57-b876-59368ede7ad2
2026-03-29 20:04:56 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:56 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:56 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1cq\x81\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03b\xd2\x00\x1cf\xff\x00\x00\x00\x00'
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8894750>
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5517%252F14405517%252Finstrument_cluster-1774709473148.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5517/14405517/instrument_cluster-1774709473148.jpeg saved to cache
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 865761cc-8917-5a57-b876-59368ede7ad2
2026-03-29 20:04:56 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:56 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:56 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00,\x1b\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xd3\xc6\x00,\x11>\x00\x00\x00\x00'
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8887910>
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5517%252F14405517%252Finterior_front_seats-1774709135020.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5517/14405517/interior_front_seats-1774709135020.jpeg saved to cache
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 865761cc-8917-5a57-b876-59368ede7ad2
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7838%252F19797838%252Fexterior_rear_passenger-1771670564108.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7838/19797838/exterior_rear_passenger-1771670564108.jpg not downloaded yet
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1418%252F10521418%252Fexterior_front_passenger-1774702003308.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1418/10521418/exterior_front_passenger-1774702003308.jpg not downloaded yet
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6062%252F20406062%252Fexterior_front_passenger-1774694414281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6062/20406062/exterior_front_passenger-1774694414281.jpg not downloaded yet
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6919%252F20486919%252Fexterior_front_passenger-1774707128893.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6919/20486919/exterior_front_passenger-1774707128893.jpg not downloaded yet
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1164%252F12561164%252Fexterior_rear_driver-1774705970296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1164/12561164/exterior_rear_driver-1774705970296.jpg not downloaded yet
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9297%252F18899297%252Fexterior_rear_driver-1774705750620.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9297/18899297/exterior_rear_driver-1774705750620.jpg not downloaded yet
2026-03-29 20:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9874/15219874/15219874-instrument_cluster-default-1774710323761.jpg> (referer: None)
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7838%252F19797838%252Finterior_front_seats-1771671377635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7838/19797838/interior_front_seats-1771671377635.jpg not downloaded yet
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1418%252F10521418%252Fexterior_rear_passenger-1774701961741.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1418/10521418/exterior_rear_passenger-1774701961741.jpg not downloaded yet
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6062%252F20406062%252Fexterior_rear_passenger-1774694396650.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6062/20406062/exterior_rear_passenger-1774694396650.jpg not downloaded yet
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6919%252F20486919%252Fexterior_rear_passenger-1774707083946.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6919/20486919/exterior_rear_passenger-1774707083946.jpg not downloaded yet
2026-03-29 20:04:56 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:04:56 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:04:56 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x001\xfa\xe3\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xafu\x001\xf0a\x00\x00\x00\x00'
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf57350>
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5517%252F14405517%252Finterior_rear_seats-1774709445580.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5517/14405517/interior_rear_seats-1774709445580.jpeg saved to cache
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 865761cc-8917-5a57-b876-59368ede7ad2
2026-03-29 20:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dac3edd-01eb-503d-9ba1-65f2c161144a with identifier: 16614089
2026-03-29 20:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dac3edd-01eb-503d-9ba1-65f2c161144a with scrape type 1
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7dac3edd-01eb-503d-9ba1-65f2c161144a
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4089%252F16614089%252Fexterior_front_driver-1774702336755.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4089/16614089/exterior_front_driver-1774702336755.jpeg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1164%252F12561164%252Fexterior_front_passenger-1774706001324.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1164/12561164/exterior_front_passenger-1774706001324.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9297%252F18899297%252Fexterior_front_passenger-1774705919717.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9297/18899297/exterior_front_passenger-1774705919717.jpg not downloaded yet
2026-03-29 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_front_driver-1774709025484.jpeg> (referer: None)
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7838%252F19797838%252Finterior_rear_seats-1771671372439.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7838/19797838/interior_rear_seats-1771671372439.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1418%252F10521418%252Finterior_front_seats-1774702614455.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1418/10521418/interior_front_seats-1774702614455.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6062%252F20406062%252Finterior_front_seats-1774694813458.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6062/20406062/interior_front_seats-1774694813458.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6919%252F20486919%252Finterior_front_seats-1774707475334.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6919/20486919/interior_front_seats-1774707475334.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4089%252F16614089%252Fexterior_rear_driver-1774702401336.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4089/16614089/exterior_rear_driver-1774702401336.jpeg not downloaded yet
2026-03-29 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17809843.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1164%252F12561164%252Fexterior_rear_passenger-1774705984213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1164/12561164/exterior_rear_passenger-1774705984213.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9297%252F18899297%252Fexterior_rear_passenger-1774705758185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9297/18899297/exterior_rear_passenger-1774705758185.jpg not downloaded yet
2026-03-29 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebff2d50>
2026-03-29 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20fb1bc8-9299-5616-885b-a59d03fdec54/20fb1bc8-9299-5616-885b-a59d03fdec54_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9874%252F15219874%252F15219874-instrument_cluster-default-1774710323761.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9874/15219874/15219874-instrument_cluster-default-1774710323761.jpg saved to cache
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20fb1bc8-9299-5616-885b-a59d03fdec54
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7838%252F19797838%252Finterior_dashboard-1774703255990.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7838/19797838/interior_dashboard-1774703255990.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1418%252F10521418%252Finterior_rear_seats-1774702499362.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1418/10521418/interior_rear_seats-1774702499362.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6062%252F20406062%252Finterior_rear_seats-1774694837304.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6062/20406062/interior_rear_seats-1774694837304.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6919%252F20486919%252Finterior_rear_seats-1774707682475.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6919/20486919/interior_rear_seats-1774707682475.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4089%252F16614089%252Fexterior_front_passenger-1774702351647.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4089/16614089/exterior_front_passenger-1774702351647.jpeg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1164%252F12561164%252Finterior_front_seats-1774706965689.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1164/12561164/interior_front_seats-1774706965689.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9297%252F18899297%252Finterior_front_seats-1774706358035.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9297/18899297/interior_front_seats-1774706358035.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7838%252F19797838%252Finterior_boot-1771671381037.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7838/19797838/interior_boot-1771671381037.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1418%252F10521418%252Finterior_dashboard-1774702599485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1418/10521418/interior_dashboard-1774702599485.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6062%252F20406062%252Finterior_dashboard-1774694993270.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6062/20406062/interior_dashboard-1774694993270.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6919%252F20486919%252Finterior_dashboard-1774708683012.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6919/20486919/interior_dashboard-1774708683012.jpg not downloaded yet
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4089%252F16614089%252Fexterior_rear_passenger-1774702388176.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4089/16614089/exterior_rear_passenger-1774702388176.jpeg not downloaded yet
2026-03-29 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe3d450>
2026-03-29 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5517%252F14405517%252Fexterior_front_driver-1774709025484.jpeg') HTTP/1.1" 204 0
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_front_driver-1774709025484.jpeg saved to cache
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 865761cc-8917-5a57-b876-59368ede7ad2
2026-03-29 20:04:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 865761cc-8917-5a57-b876-59368ede7ad2, skipping ID generation
2026-03-29 20:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 865761cc-8917-5a57-b876-59368ede7ad2 with scrape type 1
2026-03-29 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 865761cc-8917-5a57-b876-59368ede7ad2 sending to next pipeline
2026-03-29 20:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 865761cc-8917-5a57-b876-59368ede7ad2, identifier: 14405517
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1164%252F12561164%252Finterior_rear_seats-1774707024441.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1164/12561164/interior_rear_seats-1774707024441.jpg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9297%252F18899297%252Finterior_rear_seats-1774706406004.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9297/18899297/interior_rear_seats-1774706406004.jpg not downloaded yet
2026-03-29 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=792&page=22&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 865761cc-8917-5a57-b876-59368ede7ad2 with identifier: 14405517
2026-03-29 20:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 865761cc-8917-5a57-b876-59368ede7ad2 with identifier: 14405517
2026-03-29 20:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 865761cc-8917-5a57-b876-59368ede7ad2 with identifier: 14405517 to the API
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_front_driver-1774709025484.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '865761cc-8917-5a57-b876-59368ede7ad2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EC03 EVE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14405517',
'listing': 'auction',
'location': 'East Riding of Yorkshire Bridlington',
'make': 'Audi',
'model': 'A1',
'odometer': 69040,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1011022,
'Height': 2207,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_front_driver-1774709025484.jpeg',
'Width': 2943},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1026099,
'Height': 2191,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_rear_driver-1774709076356.jpeg',
'Width': 2921},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1053862,
'Height': 2236,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_front_passenger-1774709041989.jpeg',
'Width': 2981},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 978917,
'Height': 2185,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5517/14405517/exterior_rear_passenger-1774709062493.jpeg',
'Width': 2913},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3075974,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5517/14405517/interior_front_seats-1774709135020.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3451480,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5517/14405517/interior_rear_seats-1774709445580.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1563626,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5517/14405517/interior_dashboard-1774709527782.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2085971,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5517/14405517/instrument_cluster-1774709473148.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 616323,
'Height': 1458,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5517/14405517/14405517-interior_boot-modified-1774711552970.jpeg',
'Width': 1944},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865761cc-8917-5a57-b876-59368ede7ad2/865761cc-8917-5a57-b876-59368ede7ad2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365440,
'Height': 1759,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/5517/14405517/14405517-docs_service_history-modified-1774711679178.jpeg?ixlib=js-3.8.0&auto=format&s=3e3a2918cef92e93ecc507d9d8c7cb80',
'Width': 1319}],
'price': 6744,
'price_includes_vat': False,
'registration_date': '2017-03-06',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 Sport TFSI',
'transmission': 'manual',
'trim': 'Sport TFSI',
'vin': 'WAUZZZ8X5HB058637',
'year': 2017}
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714405517%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [motorway.uk] INFO: Saving data for 14405517: {'created_time': 1774814698.431736, 'last_price_update_time': 1774814698.431746, 'auction_closing_time': 1774884600.0}
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14405517') HTTP/1.1" 204 0
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7838%252F19797838%252Fdocs_service_history-1772190002605.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2669e66b70fd4099c022df91a2d64285%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7838/19797838/docs_service_history-1772190002605.jpg?ixlib=js-3.8.0&auto=format&s=2669e66b70fd4099c022df91a2d64285 not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1418%252F10521418%252Finstrument_cluster-1774702547549.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1418/10521418/instrument_cluster-1774702547549.jpg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6062%252F20406062%252Finstrument_cluster-1774694903957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6062/20406062/instrument_cluster-1774694903957.jpg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6919%252F20486919%252Finstrument_cluster-1774707587048.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6919/20486919/instrument_cluster-1774707587048.jpg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4089%252F16614089%252F16614089-interior_front_seats-modified-1774703708173.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4089/16614089/16614089-interior_front_seats-modified-1774703708173.jpeg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1164%252F12561164%252Finterior_dashboard-1774707055330.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1164/12561164/interior_dashboard-1774707055330.jpg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9297%252F18899297%252Finterior_dashboard-1774706492735.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9297/18899297/interior_dashboard-1774706492735.jpg not downloaded yet
2026-03-29 20:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e44e4ea3-0d0b-5514-ad47-42b7f2feefda with identifier: 17809843
2026-03-29 20:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e44e4ea3-0d0b-5514-ad47-42b7f2feefda with scrape type 1
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e44e4ea3-0d0b-5514-ad47-42b7f2feefda
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9843%252F17809843%252Fexterior_front_driver-1774721380083.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9843/17809843/exterior_front_driver-1774721380083.jpg not downloaded yet
2026-03-29 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9874/15219874/15219874-interior_boot-default-1774710211042.jpg> (referer: None)
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7838%252F19797838%252Fdamage_scratches-1771670774097.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7838/19797838/damage_scratches-1771670774097.jpg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1418%252F10521418%252Finterior_boot-1774702593978.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1418/10521418/interior_boot-1774702593978.jpg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6062%252F20406062%252Finterior_boot-1774694883648.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6062/20406062/interior_boot-1774694883648.jpg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6919%252F20486919%252Finterior_boot-1774707529684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6919/20486919/interior_boot-1774707529684.jpg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4089%252F16614089%252Finterior_rear_seats-1774702632463.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4089/16614089/interior_rear_seats-1774702632463.jpeg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1164%252F12561164%252Finstrument_cluster-1774707051375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1164/12561164/instrument_cluster-1774707051375.jpg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9297%252F18899297%252Finstrument_cluster-1774706431649.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9297/18899297/instrument_cluster-1774706431649.jpg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9843%252F17809843%252Fexterior_rear_driver-1774721454479.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9843/17809843/exterior_rear_driver-1774721454479.jpg not downloaded yet
2026-03-29 20:04:58 [motorway.uk] INFO: Found listing with ID: 20385482
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720385482%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [motorway.uk] INFO: Scrape type for 20385482: 1
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1418%252F10521418%252Fdocs_service_history-1774705659199.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da6a8728cdc372f758aefece104ee9ab4%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1418/10521418/docs_service_history-1774705659199.jpg?ixlib=js-3.8.0&auto=format&s=a6a8728cdc372f758aefece104ee9ab4 not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6062%252F20406062%252Fdocs_service_history-1774695689286.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db3ad5fbb2d21d2699115a85130bb108a%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6062/20406062/docs_service_history-1774695689286.jpg?ixlib=js-3.8.0&auto=format&s=b3ad5fbb2d21d2699115a85130bb108a not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6919%252F20486919%252Fdocs_service_history-1774707893300.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D81e79abe1ffe42e593a610e56e540558%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6919/20486919/docs_service_history-1774707893300.jpg?ixlib=js-3.8.0&auto=format&s=81e79abe1ffe42e593a610e56e540558 not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4089%252F16614089%252Finterior_dashboard-1774702664949.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4089/16614089/interior_dashboard-1774702664949.jpeg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1164%252F12561164%252Finterior_boot-1774707076566.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1164/12561164/interior_boot-1774707076566.jpg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9297%252F18899297%252Finterior_boot-1774706549159.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9297/18899297/interior_boot-1774706549159.jpg not downloaded yet
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9843%252F17809843%252Fexterior_front_passenger-1774721459886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9843/17809843/exterior_front_passenger-1774721459886.jpg not downloaded yet
2026-03-29 20:04:58 [motorway.uk] INFO: Found listing with ID: 14497960
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714497960%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [motorway.uk] INFO: Scrape type for 14497960: 1
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4089%252F16614089%252Finstrument_cluster-1774702740672.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4089/16614089/instrument_cluster-1774702740672.jpeg not downloaded yet
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f817e310>
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20fb1bc8-9299-5616-885b-a59d03fdec54/20fb1bc8-9299-5616-885b-a59d03fdec54_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9874%252F15219874%252F15219874-interior_boot-default-1774710211042.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9874/15219874/15219874-interior_boot-default-1774710211042.jpg saved to cache
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20fb1bc8-9299-5616-885b-a59d03fdec54
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1164%252F12561164%252Fdocs_service_history-1774707289901.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D500b9a33d09838205a437b207d6ed85c%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1164/12561164/docs_service_history-1774707289901.jpg?ixlib=js-3.8.0&auto=format&s=500b9a33d09838205a437b207d6ed85c not downloaded yet
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F9297%252F18899297%252Fdocs_service_history-1765727370059.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddc8ed84cc9826233e98434f4f9917102%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/9297/18899297/docs_service_history-1765727370059.jpeg?ixlib=js-3.8.0&auto=format&s=dc8ed84cc9826233e98434f4f9917102 not downloaded yet
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9843%252F17809843%252Fexterior_rear_passenger-1774721478022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9843/17809843/exterior_rear_passenger-1774721478022.jpg not downloaded yet
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20393358
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20217991
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20383556
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20485756
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 19413267
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719413267%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [motorway.uk] INFO: Scrape type for 19413267: 1
2026-03-29 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9874/15219874/15219874-interior_rear_seats-default-1774710491935.jpg> (referer: None)
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4089%252F16614089%252Finterior_boot-1774702925506.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4089/16614089/interior_boot-1774702925506.jpeg not downloaded yet
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9843%252F17809843%252Finterior_front_seats-1774722633816.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9843/17809843/interior_front_seats-1774722633816.jpg not downloaded yet
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 19288331
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20462610
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720462610%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [motorway.uk] INFO: Scrape type for 20462610: 1
2026-03-29 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0198/7660198/docs_service_history-1774698962303.jpeg?ixlib=js-3.8.0&auto=format&s=f2644f9c932960699ba4faaff2af69c8> (referer: None)
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4089%252F16614089%252F16614089-docs_service_history-default-1774702072192.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd69424e5c4fd73fcc2bc0d56a3863efa%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4089/16614089/16614089-docs_service_history-default-1774702072192.jpeg?ixlib=js-3.8.0&auto=format&s=d69424e5c4fd73fcc2bc0d56a3863efa not downloaded yet
2026-03-29 20:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9843%252F17809843%252Finterior_rear_seats-1774722814053.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9843/17809843/interior_rear_seats-1774722814053.jpg not downloaded yet
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20490179
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20486724
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486724%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [motorway.uk] INFO: Scrape type for 20486724: 1
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9843%252F17809843%252Finterior_dashboard-1774786468393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9843/17809843/interior_dashboard-1774786468393.jpg not downloaded yet
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20489344
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20348979
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720348979%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [motorway.uk] INFO: Scrape type for 20348979: 1
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9843%252F17809843%252Finstrument_cluster-1774722585941.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9843/17809843/instrument_cluster-1774722585941.jpg not downloaded yet
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 14956280
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 18941047
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 13723227
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20423398
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20464480
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20471522
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 8915220
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20476962
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 17749520
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 15294916
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20018421
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20405344
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20465616
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 12468788
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20416075
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20337017
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720337017%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [motorway.uk] INFO: Scrape type for 20337017: 1
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebff4f50>
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20fb1bc8-9299-5616-885b-a59d03fdec54/20fb1bc8-9299-5616-885b-a59d03fdec54_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9874%252F15219874%252F15219874-interior_rear_seats-default-1774710491935.jpg') HTTP/1.1" 204 0
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9874/15219874/15219874-interior_rear_seats-default-1774710491935.jpg saved to cache
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20fb1bc8-9299-5616-885b-a59d03fdec54
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9843%252F17809843%252Finterior_boot-1774786480297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9843/17809843/interior_boot-1774786480297.jpg not downloaded yet
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 5750587
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20426574
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20428130
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20480796
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20477490
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720477490%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [motorway.uk] INFO: Scrape type for 20477490: 1
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe19b90>
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb5463ea-bbaa-50de-be3e-3ddc342cc7c4/eb5463ea-bbaa-50de-be3e-3ddc342cc7c4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0198%252F7660198%252Fdocs_service_history-1774698962303.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df2644f9c932960699ba4faaff2af69c8') HTTP/1.1" 204 0
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0198/7660198/docs_service_history-1774698962303.jpeg?ixlib=js-3.8.0&auto=format&s=f2644f9c932960699ba4faaff2af69c8 saved to cache
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb5463ea-bbaa-50de-be3e-3ddc342cc7c4
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9843%252F17809843%252Fdocs_service_history-1774733755115-4.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1e3d95ad1e01194dc09213f576ec6935%27 HTTP/1.1" 200 None
2026-03-29 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9843/17809843/docs_service_history-1774733755115-4.jpeg?ixlib=js-3.8.0&auto=format&s=1e3d95ad1e01194dc09213f576ec6935 not downloaded yet
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 20165932
2026-03-29 20:04:59 [motorway.uk] INFO: Found listing with ID: 19570678
2026-03-29 20:04:59 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (11552386) larger than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/4089/16614089/instrument_cluster-1774702740672.jpeg>.
2026-03-29 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6919/20486919/docs_service_history-1774707893300.jpg?ixlib=js-3.8.0&auto=format&s=81e79abe1ffe42e593a610e56e540558> (referer: None)
2026-03-29 20:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9874/15219874/15219874-interior_front_seats-modified-1774774764546.jpeg> (referer: None)
2026-03-29 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1164/12561164/docs_service_history-1774707289901.jpg?ixlib=js-3.8.0&auto=format&s=500b9a33d09838205a437b207d6ed85c> (referer: None)
2026-03-29 20:04:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0198/7660198/instrument_cluster-1774697025131.jpeg> (referer: None)
2026-03-29 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0198/7660198/interior_boot-1774696950385.jpeg> (referer: None)
2026-03-29 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9843/17809843/exterior_rear_passenger-1774721478022.jpg> (referer: None)
2026-03-29 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1164/12561164/interior_boot-1774707076566.jpg> (referer: None)
2026-03-29 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9843/17809843/exterior_front_passenger-1774721459886.jpg> (referer: None)
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe1a4d0>
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7124d203-a7a7-5896-a67e-a98738e9a37d/7124d203-a7a7-5896-a67e-a98738e9a37d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6919%252F20486919%252Fdocs_service_history-1774707893300.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D81e79abe1ffe42e593a610e56e540558') HTTP/1.1" 204 0
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6919/20486919/docs_service_history-1774707893300.jpg?ixlib=js-3.8.0&auto=format&s=81e79abe1ffe42e593a610e56e540558 saved to cache
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7124d203-a7a7-5896-a67e-a98738e9a37d
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8215ed0>
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20fb1bc8-9299-5616-885b-a59d03fdec54/20fb1bc8-9299-5616-885b-a59d03fdec54_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9874%252F15219874%252F15219874-interior_front_seats-modified-1774774764546.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9874/15219874/15219874-interior_front_seats-modified-1774774764546.jpeg saved to cache
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20fb1bc8-9299-5616-885b-a59d03fdec54
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf71b10>
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5f8538-a78c-5049-ac76-529becefd422/3b5f8538-a78c-5049-ac76-529becefd422_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1164%252F12561164%252Fdocs_service_history-1774707289901.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D500b9a33d09838205a437b207d6ed85c') HTTP/1.1" 204 0
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1164/12561164/docs_service_history-1774707289901.jpg?ixlib=js-3.8.0&auto=format&s=500b9a33d09838205a437b207d6ed85c saved to cache
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b5f8538-a78c-5049-ac76-529becefd422
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11\x00'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 162 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 170 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 178 - value: b'26.3.1\x00'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 186 - value: b'2026:03:28 11:21:24\x00'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 206 - value: b'iPhone 11\x00'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xd8'
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8214350>
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb5463ea-bbaa-50de-be3e-3ddc342cc7c4/eb5463ea-bbaa-50de-be3e-3ddc342cc7c4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0198%252F7660198%252Finstrument_cluster-1774697025131.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0198/7660198/instrument_cluster-1774697025131.jpeg saved to cache
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb5463ea-bbaa-50de-be3e-3ddc342cc7c4
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11\x00'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 162 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 170 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 178 - value: b'26.3.1\x00'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 186 - value: b'2026:03:28 11:22:25\x00'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 206 - value: b'iPhone 11\x00'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xd8'
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82c1d10>
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb5463ea-bbaa-50de-be3e-3ddc342cc7c4/eb5463ea-bbaa-50de-be3e-3ddc342cc7c4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0198%252F7660198%252Finterior_boot-1774696950385.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0198/7660198/interior_boot-1774696950385.jpeg saved to cache
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb5463ea-bbaa-50de-be3e-3ddc342cc7c4
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8238190>
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44e4ea3-0d0b-5514-ad47-42b7f2feefda/e44e4ea3-0d0b-5514-ad47-42b7f2feefda_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9843%252F17809843%252Fexterior_rear_passenger-1774721478022.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9843/17809843/exterior_rear_passenger-1774721478022.jpg saved to cache
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e44e4ea3-0d0b-5514-ad47-42b7f2feefda
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfd54d0>
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5f8538-a78c-5049-ac76-529becefd422/3b5f8538-a78c-5049-ac76-529becefd422_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1164%252F12561164%252Finterior_boot-1774707076566.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1164/12561164/interior_boot-1774707076566.jpg saved to cache
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b5f8538-a78c-5049-ac76-529becefd422
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf722d0>
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44e4ea3-0d0b-5514-ad47-42b7f2feefda/e44e4ea3-0d0b-5514-ad47-42b7f2feefda_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9843%252F17809843%252Fexterior_front_passenger-1774721459886.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9843/17809843/exterior_front_passenger-1774721459886.jpg saved to cache
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e44e4ea3-0d0b-5514-ad47-42b7f2feefda
2026-03-29 20:05:00 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (18875702) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4089/16614089/interior_boot-1774702925506.jpeg>.
2026-03-29 20:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9843/17809843/docs_service_history-1774733755115-4.jpeg?ixlib=js-3.8.0&auto=format&s=1e3d95ad1e01194dc09213f576ec6935> (referer: None)
2026-03-29 20:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/9297/18899297/docs_service_history-1765727370059.jpeg?ixlib=js-3.8.0&auto=format&s=dc8ed84cc9826233e98434f4f9917102> (referer: None)
2026-03-29 20:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6062/20406062/docs_service_history-1774695689286.jpg?ixlib=js-3.8.0&auto=format&s=b3ad5fbb2d21d2699115a85130bb108a> (referer: None)
2026-03-29 20:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9297/18899297/interior_boot-1774706549159.jpg> (referer: None)
2026-03-29 20:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4089/16614089/interior_dashboard-1774702664949.jpeg> (referer: None)
2026-03-29 20:05:00 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/4089/16614089/instrument_cluster-1774702740672.jpeg>.
2026-03-29 20:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4089/16614089/instrument_cluster-1774702740672.jpeg> (referer: None)
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf22f50>
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44e4ea3-0d0b-5514-ad47-42b7f2feefda/e44e4ea3-0d0b-5514-ad47-42b7f2feefda_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9843%252F17809843%252Fdocs_service_history-1774733755115-4.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1e3d95ad1e01194dc09213f576ec6935') HTTP/1.1" 204 0
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9843/17809843/docs_service_history-1774733755115-4.jpeg?ixlib=js-3.8.0&auto=format&s=1e3d95ad1e01194dc09213f576ec6935 saved to cache
2026-03-29 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e44e4ea3-0d0b-5514-ad47-42b7f2feefda
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf22090>
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_454fd327-df10-5223-8a5e-af36e330b64a/454fd327-df10-5223-8a5e-af36e330b64a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F9297%252F18899297%252Fdocs_service_history-1765727370059.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddc8ed84cc9826233e98434f4f9917102') HTTP/1.1" 204 0
2026-03-29 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/9297/18899297/docs_service_history-1765727370059.jpeg?ixlib=js-3.8.0&auto=format&s=dc8ed84cc9826233e98434f4f9917102 saved to cache
2026-03-29 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 454fd327-df10-5223-8a5e-af36e330b64a
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82af010>
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dad55eb-b3e1-54f8-9435-5bc815d75381/7dad55eb-b3e1-54f8-9435-5bc815d75381_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6062%252F20406062%252Fdocs_service_history-1774695689286.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db3ad5fbb2d21d2699115a85130bb108a') HTTP/1.1" 204 0
2026-03-29 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6062/20406062/docs_service_history-1774695689286.jpg?ixlib=js-3.8.0&auto=format&s=b3ad5fbb2d21d2699115a85130bb108a saved to cache
2026-03-29 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7dad55eb-b3e1-54f8-9435-5bc815d75381
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8259010>
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_454fd327-df10-5223-8a5e-af36e330b64a/454fd327-df10-5223-8a5e-af36e330b64a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9297%252F18899297%252Finterior_boot-1774706549159.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9297/18899297/interior_boot-1774706549159.jpg saved to cache
2026-03-29 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 454fd327-df10-5223-8a5e-af36e330b64a
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82afd50>
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dac3edd-01eb-503d-9ba1-65f2c161144a/7dac3edd-01eb-503d-9ba1-65f2c161144a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4089%252F16614089%252Finterior_dashboard-1774702664949.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4089/16614089/interior_dashboard-1774702664949.jpeg saved to cache
2026-03-29 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7dac3edd-01eb-503d-9ba1-65f2c161144a
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:05:01 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xaa\x18\x1d\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06.e\x00\xaa\r\x9d\x00\x00\x00\x00'
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf6a250>
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dac3edd-01eb-503d-9ba1-65f2c161144a/7dac3edd-01eb-503d-9ba1-65f2c161144a_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4089%252F16614089%252Finstrument_cluster-1774702740672.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4089/16614089/instrument_cluster-1774702740672.jpeg saved to cache
2026-03-29 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7dac3edd-01eb-503d-9ba1-65f2c161144a
2026-03-29 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9843/17809843/interior_dashboard-1774786468393.jpg> (referer: None)
2026-03-29 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14497960.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9843/17809843/interior_rear_seats-1774722814053.jpg> (referer: None)
2026-03-29 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9843/17809843/interior_boot-1774786480297.jpg> (referer: None)
2026-03-29 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9843/17809843/instrument_cluster-1774722585941.jpg> (referer: None)
2026-03-29 20:05:01 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4089/16614089/interior_boot-1774702925506.jpeg>.
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf7b750>
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44e4ea3-0d0b-5514-ad47-42b7f2feefda/e44e4ea3-0d0b-5514-ad47-42b7f2feefda_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9843%252F17809843%252Finterior_dashboard-1774786468393.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9843/17809843/interior_dashboard-1774786468393.jpg saved to cache
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e44e4ea3-0d0b-5514-ad47-42b7f2feefda
2026-03-29 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19413267.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73fa9589-d96d-574c-b0bc-8f01bf96c6aa with identifier: 14497960
2026-03-29 20:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa with scrape type 1
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7960%252F14497960%252Fexterior_front_driver-1774702495181.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_front_driver-1774702495181.jpg not downloaded yet
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf6dfd0>
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44e4ea3-0d0b-5514-ad47-42b7f2feefda/e44e4ea3-0d0b-5514-ad47-42b7f2feefda_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9843%252F17809843%252Finterior_rear_seats-1774722814053.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9843/17809843/interior_rear_seats-1774722814053.jpg saved to cache
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e44e4ea3-0d0b-5514-ad47-42b7f2feefda
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf92f50>
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44e4ea3-0d0b-5514-ad47-42b7f2feefda/e44e4ea3-0d0b-5514-ad47-42b7f2feefda_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9843%252F17809843%252Finterior_boot-1774786480297.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9843/17809843/interior_boot-1774786480297.jpg saved to cache
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e44e4ea3-0d0b-5514-ad47-42b7f2feefda
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf7f790>
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44e4ea3-0d0b-5514-ad47-42b7f2feefda/e44e4ea3-0d0b-5514-ad47-42b7f2feefda_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9843%252F17809843%252Finstrument_cluster-1774722585941.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9843/17809843/instrument_cluster-1774722585941.jpg saved to cache
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e44e4ea3-0d0b-5514-ad47-42b7f2feefda
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7960%252F14497960%252Fexterior_rear_driver-1774702519085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_rear_driver-1774702519085.jpg not downloaded yet
2026-03-29 20:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24852beb-41ab-5a6d-a2c5-1e2968a63637 with identifier: 19413267
2026-03-29 20:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24852beb-41ab-5a6d-a2c5-1e2968a63637 with scrape type 1
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24852beb-41ab-5a6d-a2c5-1e2968a63637
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3267%252F19413267%252Fexterior_front_driver-1774693444181.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3267/19413267/exterior_front_driver-1774693444181.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7960%252F14497960%252Fexterior_front_passenger-1774702562916.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_front_passenger-1774702562916.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3267%252F19413267%252Fexterior_rear_driver-1774693457910.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3267/19413267/exterior_rear_driver-1774693457910.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7960%252F14497960%252Fexterior_rear_passenger-1774702535301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_rear_passenger-1774702535301.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3267%252F19413267%252Fexterior_front_passenger-1774706481110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3267/19413267/exterior_front_passenger-1774706481110.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7960%252F14497960%252Finterior_front_seats-1774702968687.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7960/14497960/interior_front_seats-1774702968687.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3267%252F19413267%252Fexterior_rear_passenger-1774693469302.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3267/19413267/exterior_rear_passenger-1774693469302.jpg not downloaded yet
2026-03-29 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9843/17809843/interior_front_seats-1774722633816.jpg> (referer: None)
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7960%252F14497960%252Finterior_rear_seats-1774702980620.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7960/14497960/interior_rear_seats-1774702980620.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3267%252F19413267%252Finterior_front_seats-1774703982705.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3267/19413267/interior_front_seats-1774703982705.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7960%252F14497960%252Finterior_dashboard-1774704182417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7960/14497960/interior_dashboard-1774704182417.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3267%252F19413267%252Finterior_rear_seats-1774703996462.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3267/19413267/interior_rear_seats-1774703996462.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7960%252F14497960%252Finstrument_cluster-1774703063136.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7960/14497960/instrument_cluster-1774703063136.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3267%252F19413267%252Finterior_dashboard-1774706520395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3267/19413267/interior_dashboard-1774706520395.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7960%252F14497960%252Finterior_boot-1774703022160.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7960/14497960/interior_boot-1774703022160.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3267%252F19413267%252Finstrument_cluster-1774706508334.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3267/19413267/instrument_cluster-1774706508334.jpg not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7960%252F14497960%252Fdocs_service_history-1774703585282.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbd341aa3adab89f196dd5558ad5e6c02%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7960/14497960/docs_service_history-1774703585282.jpg?ixlib=js-3.8.0&auto=format&s=bd341aa3adab89f196dd5558ad5e6c02 not downloaded yet
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3267%252F19413267%252Finterior_boot-1774704043188.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3267/19413267/interior_boot-1774704043188.jpg not downloaded yet
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c12a10>
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44e4ea3-0d0b-5514-ad47-42b7f2feefda/e44e4ea3-0d0b-5514-ad47-42b7f2feefda_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9843%252F17809843%252Finterior_front_seats-1774722633816.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9843/17809843/interior_front_seats-1774722633816.jpg saved to cache
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e44e4ea3-0d0b-5514-ad47-42b7f2feefda
2026-03-29 20:05:02 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (10983416) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4089/16614089/interior_rear_seats-1774702632463.jpeg>.
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3267%252F19413267%252Fdocs_service_history-1774705294010.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4fa00ecb610879132ce5d782fb6f7c03%27 HTTP/1.1" 200 None
2026-03-29 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3267/19413267/docs_service_history-1774705294010.jpg?ixlib=js-3.8.0&auto=format&s=4fa00ecb610879132ce5d782fb6f7c03 not downloaded yet
2026-03-29 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9843/17809843/exterior_rear_driver-1774721454479.jpg> (referer: None)
2026-03-29 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1164/12561164/instrument_cluster-1774707051375.jpg> (referer: None)
2026-03-29 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9297/18899297/instrument_cluster-1774706431649.jpg> (referer: None)
2026-03-29 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4089/16614089/16614089-docs_service_history-default-1774702072192.jpeg?ixlib=js-3.8.0&auto=format&s=d69424e5c4fd73fcc2bc0d56a3863efa> (referer: None)
2026-03-29 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4089/16614089/interior_boot-1774702925506.jpeg> (referer: None)
2026-03-29 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1418/10521418/docs_service_history-1774705659199.jpg?ixlib=js-3.8.0&auto=format&s=a6a8728cdc372f758aefece104ee9ab4> (referer: None)
2026-03-29 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6919/20486919/interior_boot-1774707529684.jpg> (referer: None)
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9002ed0>
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e44e4ea3-0d0b-5514-ad47-42b7f2feefda/e44e4ea3-0d0b-5514-ad47-42b7f2feefda_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9843%252F17809843%252Fexterior_rear_driver-1774721454479.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9843/17809843/exterior_rear_driver-1774721454479.jpg saved to cache
2026-03-29 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e44e4ea3-0d0b-5514-ad47-42b7f2feefda
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cc20d0>
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b5f8538-a78c-5049-ac76-529becefd422/3b5f8538-a78c-5049-ac76-529becefd422_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1164%252F12561164%252Finstrument_cluster-1774707051375.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1164/12561164/instrument_cluster-1774707051375.jpg saved to cache
2026-03-29 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b5f8538-a78c-5049-ac76-529becefd422
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9272250>
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_454fd327-df10-5223-8a5e-af36e330b64a/454fd327-df10-5223-8a5e-af36e330b64a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9297%252F18899297%252Finstrument_cluster-1774706431649.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9297/18899297/instrument_cluster-1774706431649.jpg saved to cache
2026-03-29 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 454fd327-df10-5223-8a5e-af36e330b64a
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a93590>
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dac3edd-01eb-503d-9ba1-65f2c161144a/7dac3edd-01eb-503d-9ba1-65f2c161144a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4089%252F16614089%252F16614089-docs_service_history-default-1774702072192.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd69424e5c4fd73fcc2bc0d56a3863efa') HTTP/1.1" 204 0
2026-03-29 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4089/16614089/16614089-docs_service_history-default-1774702072192.jpeg?ixlib=js-3.8.0&auto=format&s=d69424e5c4fd73fcc2bc0d56a3863efa saved to cache
2026-03-29 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7dac3edd-01eb-503d-9ba1-65f2c161144a
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x01\x15"&\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\n\xe3\x10\x01\x15\x17\xa6\x00\x00\x00\x00'
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9270b10>
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dac3edd-01eb-503d-9ba1-65f2c161144a/7dac3edd-01eb-503d-9ba1-65f2c161144a_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4089%252F16614089%252Finterior_boot-1774702925506.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4089/16614089/interior_boot-1774702925506.jpeg saved to cache
2026-03-29 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7dac3edd-01eb-503d-9ba1-65f2c161144a
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d1d0d0>
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcbb1842-9020-5357-b439-bd54fe97f8cb/dcbb1842-9020-5357-b439-bd54fe97f8cb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1418%252F10521418%252Fdocs_service_history-1774705659199.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da6a8728cdc372f758aefece104ee9ab4') HTTP/1.1" 204 0
2026-03-29 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1418/10521418/docs_service_history-1774705659199.jpg?ixlib=js-3.8.0&auto=format&s=a6a8728cdc372f758aefece104ee9ab4 saved to cache
2026-03-29 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dcbb1842-9020-5357-b439-bd54fe97f8cb
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a7f390>
2026-03-29 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7124d203-a7a7-5896-a67e-a98738e9a37d/7124d203-a7a7-5896-a67e-a98738e9a37d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6919%252F20486919%252Finterior_boot-1774707529684.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6919/20486919/interior_boot-1774707529684.jpg saved to cache
2026-03-29 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7124d203-a7a7-5896-a67e-a98738e9a37d
2026-03-29 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3267/19413267/docs_service_history-1774705294010.jpg?ixlib=js-3.8.0&auto=format&s=4fa00ecb610879132ce5d782fb6f7c03> (referer: None)
2026-03-29 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7960/14497960/interior_front_seats-1774702968687.jpg> (referer: None)
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a93690>
2026-03-29 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3267%252F19413267%252Fdocs_service_history-1774705294010.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4fa00ecb610879132ce5d782fb6f7c03') HTTP/1.1" 204 0
2026-03-29 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3267/19413267/docs_service_history-1774705294010.jpg?ixlib=js-3.8.0&auto=format&s=4fa00ecb610879132ce5d782fb6f7c03 saved to cache
2026-03-29 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24852beb-41ab-5a6d-a2c5-1e2968a63637
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9055910>
2026-03-29 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7960%252F14497960%252Finterior_front_seats-1774702968687.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7960/14497960/interior_front_seats-1774702968687.jpg saved to cache
2026-03-29 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa
2026-03-29 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20477490.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=828&page=23&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3267/19413267/interior_dashboard-1774706520395.jpg> (referer: None)
2026-03-29 20:05:04 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4089/16614089/interior_rear_seats-1774702632463.jpeg>.
2026-03-29 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3267/19413267/instrument_cluster-1774706508334.jpg> (referer: None)
2026-03-29 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4089/16614089/interior_rear_seats-1774702632463.jpeg> (referer: None)
2026-03-29 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7960/14497960/interior_dashboard-1774704182417.jpg> (referer: None)
2026-03-29 20:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97f8a5c9-2066-5e05-ba5e-22158de5b190 with identifier: 20477490
2026-03-29 20:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f8a5c9-2066-5e05-ba5e-22158de5b190 with scrape type 1
2026-03-29 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97f8a5c9-2066-5e05-ba5e-22158de5b190
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7490%252F20477490%252Fexterior_front_driver-1774716031854.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_front_driver-1774716031854.jpg not downloaded yet
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7490%252F20477490%252Fexterior_rear_driver-1774716053969.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_rear_driver-1774716053969.jpg not downloaded yet
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7490%252F20477490%252Fexterior_front_passenger-1774716101450.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_front_passenger-1774716101450.jpg not downloaded yet
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 20345939
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 12444904
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 20479213
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 5678750
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 1379253
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 20147268
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720147268%27 HTTP/1.1" 200 None
2026-03-29 20:05:05 [motorway.uk] INFO: Scrape type for 20147268: 1
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9033390>
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3267%252F19413267%252Finterior_dashboard-1774706520395.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3267/19413267/interior_dashboard-1774706520395.jpg saved to cache
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24852beb-41ab-5a6d-a2c5-1e2968a63637
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89a2e90>
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3267%252F19413267%252Finstrument_cluster-1774706508334.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3267/19413267/instrument_cluster-1774706508334.jpg saved to cache
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24852beb-41ab-5a6d-a2c5-1e2968a63637
2026-03-29 20:05:05 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:05:05 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:05:05 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xa0O\x98\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07H`\x00\xa0E\x18\x00\x00\x00\x00'
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89a3e90>
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dac3edd-01eb-503d-9ba1-65f2c161144a/7dac3edd-01eb-503d-9ba1-65f2c161144a_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4089%252F16614089%252Finterior_rear_seats-1774702632463.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4089/16614089/interior_rear_seats-1774702632463.jpeg saved to cache
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7dac3edd-01eb-503d-9ba1-65f2c161144a
2026-03-29 20:05:05 [scrapy.extensions.logstats] INFO: Crawled 207 pages (at 39 pages/min), scraped 117 items (at 22 items/min)
2026-03-29 20:05:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 309MiB
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7490%252F20477490%252Fexterior_rear_passenger-1774716081679.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_rear_passenger-1774716081679.jpg not downloaded yet
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 20465867
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 18276171
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 20490982
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490982%27 HTTP/1.1" 200 None
2026-03-29 20:05:05 [motorway.uk] INFO: Scrape type for 20490982: 1
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f811a790>
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7960%252F14497960%252Finterior_dashboard-1774704182417.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7960/14497960/interior_dashboard-1774704182417.jpg saved to cache
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7490%252F20477490%252Finterior_front_seats-1774717723351.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7490/20477490/interior_front_seats-1774717723351.jpg not downloaded yet
2026-03-29 20:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 20494330
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 20486417
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 19705843
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719705843%27 HTTP/1.1" 200 None
2026-03-29 20:05:05 [motorway.uk] INFO: Scrape type for 19705843: 1
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7490%252F20477490%252Finterior_rear_seats-1774718187892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7490/20477490/interior_rear_seats-1774718187892.jpg not downloaded yet
2026-03-29 20:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486724.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 6409208
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 20049212
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 12893788
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 20129049
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 19812836
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 7025214
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277025214%27 HTTP/1.1" 200 None
2026-03-29 20:05:05 [motorway.uk] INFO: Scrape type for 7025214: 1
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7490%252F20477490%252Finterior_dashboard-1774717771808.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7490/20477490/interior_dashboard-1774717771808.jpg not downloaded yet
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 20458640
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 12548446
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712548446%27 HTTP/1.1" 200 None
2026-03-29 20:05:05 [motorway.uk] INFO: Scrape type for 12548446: 1
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7490%252F20477490%252Finstrument_cluster-1774718168996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7490/20477490/instrument_cluster-1774718168996.jpg not downloaded yet
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 20453033
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720453033%27 HTTP/1.1" 200 None
2026-03-29 20:05:05 [motorway.uk] INFO: Scrape type for 20453033: 1
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7490%252F20477490%252Finterior_boot-1774717778073.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7490/20477490/interior_boot-1774717778073.jpg not downloaded yet
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 20028099
2026-03-29 20:05:05 [motorway.uk] INFO: Found listing with ID: 20414917
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720414917%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [motorway.uk] INFO: Scrape type for 20414917: 1
2026-03-29 20:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71641161-ebda-5688-98ca-86677dadf49c with identifier: 20486724
2026-03-29 20:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71641161-ebda-5688-98ca-86677dadf49c with scrape type 1
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71641161-ebda-5688-98ca-86677dadf49c
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6724%252F20486724%252Fexterior_front_driver-1774773165407.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_front_driver-1774773165407.jpg not downloaded yet
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7490%252F20477490%252Fdocs_service_history-1774718360182.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6310dccb418f44d2c8a6debd633d0ec9%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7490/20477490/docs_service_history-1774718360182.jpg?ixlib=js-3.8.0&auto=format&s=6310dccb418f44d2c8a6debd633d0ec9 not downloaded yet
2026-03-29 20:05:06 [motorway.uk] INFO: Found listing with ID: 18114859
2026-03-29 20:05:06 [motorway.uk] INFO: Found listing with ID: 20498769
2026-03-29 20:05:06 [motorway.uk] INFO: Found listing with ID: 20401260
2026-03-29 20:05:06 [motorway.uk] INFO: Found listing with ID: 20421513
2026-03-29 20:05:06 [motorway.uk] INFO: Found listing with ID: 19128404
2026-03-29 20:05:06 [motorway.uk] INFO: Found listing with ID: 20306533
2026-03-29 20:05:06 [motorway.uk] INFO: Found listing with ID: 20304701
2026-03-29 20:05:06 [motorway.uk] INFO: Found listing with ID: 20378364
2026-03-29 20:05:06 [motorway.uk] INFO: Found listing with ID: 18272017
2026-03-29 20:05:06 [motorway.uk] INFO: Found listing with ID: 20445540
2026-03-29 20:05:06 [motorway.uk] INFO: Found listing with ID: 20500409
2026-03-29 20:05:06 [motorway.uk] INFO: Found listing with ID: 18253303
2026-03-29 20:05:06 [motorway.uk] INFO: Found listing with ID: 18656000
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6724%252F20486724%252Fexterior_rear_driver-1774773173418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_rear_driver-1774773173418.jpg not downloaded yet
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6724%252F20486724%252Fexterior_front_passenger-1774773198077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_front_passenger-1774773198077.jpg not downloaded yet
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6724%252F20486724%252Fexterior_rear_passenger-1774773181385.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_rear_passenger-1774773181385.jpg not downloaded yet
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6724%252F20486724%252Finterior_front_seats-1774783174851.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6724/20486724/interior_front_seats-1774783174851.jpg not downloaded yet
2026-03-29 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3267/19413267/exterior_rear_passenger-1774693469302.jpg> (referer: None)
2026-03-29 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7960/14497960/instrument_cluster-1774703063136.jpg> (referer: None)
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6724%252F20486724%252Finterior_rear_seats-1774783196278.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6724/20486724/interior_rear_seats-1774783196278.jpg not downloaded yet
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6724%252F20486724%252Finterior_dashboard-1774782997356.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6724/20486724/interior_dashboard-1774782997356.jpg not downloaded yet
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6724%252F20486724%252Finstrument_cluster-1774773524974.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6724/20486724/instrument_cluster-1774773524974.jpg not downloaded yet
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6724%252F20486724%252Finterior_boot-1774773524269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6724/20486724/interior_boot-1774773524269.jpg not downloaded yet
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6724%252F20486724%252Fdamage_scratches-1774773225824.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6724/20486724/damage_scratches-1774773225824.jpg not downloaded yet
2026-03-29 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20348979.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9202850>
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3267%252F19413267%252Fexterior_rear_passenger-1774693469302.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3267/19413267/exterior_rear_passenger-1774693469302.jpg saved to cache
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24852beb-41ab-5a6d-a2c5-1e2968a63637
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90c8b10>
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7960%252F14497960%252Finstrument_cluster-1774703063136.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7960/14497960/instrument_cluster-1774703063136.jpg saved to cache
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa
2026-03-29 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7960/14497960/interior_boot-1774703022160.jpg> (referer: None)
2026-03-29 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20337017.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7960/14497960/docs_service_history-1774703585282.jpg?ixlib=js-3.8.0&auto=format&s=bd341aa3adab89f196dd5558ad5e6c02> (referer: None)
2026-03-29 20:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb00de1e-9599-5aca-bf35-d40c57d8edc0 with identifier: 20348979
2026-03-29 20:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb00de1e-9599-5aca-bf35-d40c57d8edc0 with scrape type 1
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb00de1e-9599-5aca-bf35-d40c57d8edc0
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8979%252F20348979%252Fexterior_front_driver-1774547085898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_front_driver-1774547085898.jpg not downloaded yet
2026-03-29 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3267/19413267/exterior_front_passenger-1774706481110.jpg> (referer: None)
2026-03-29 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3267/19413267/interior_boot-1774704043188.jpg> (referer: None)
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8979%252F20348979%252Fexterior_rear_driver-1774547101447.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_rear_driver-1774547101447.jpg not downloaded yet
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8979%252F20348979%252Fexterior_front_passenger-1774547150504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_front_passenger-1774547150504.jpg not downloaded yet
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8979%252F20348979%252Fexterior_rear_passenger-1774547134826.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_rear_passenger-1774547134826.jpg not downloaded yet
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8979%252F20348979%252Finterior_front_seats-1774547756209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8979/20348979/interior_front_seats-1774547756209.jpg not downloaded yet
2026-03-29 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3267/19413267/interior_rear_seats-1774703996462.jpg> (referer: None)
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f03950>
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7960%252F14497960%252Finterior_boot-1774703022160.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7960/14497960/interior_boot-1774703022160.jpg saved to cache
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8979%252F20348979%252Finterior_rear_seats-1774547830841.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8979/20348979/interior_rear_seats-1774547830841.jpg not downloaded yet
2026-03-29 20:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_rear_passenger-1774716081679.jpg> (referer: None)
2026-03-29 20:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28 with identifier: 20337017
2026-03-29 20:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28 with scrape type 1
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7017%252F20337017%252Fexterior_front_driver-1774698371027.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_front_driver-1774698371027.jpg not downloaded yet
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82db110>
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7960%252F14497960%252Fdocs_service_history-1774703585282.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbd341aa3adab89f196dd5558ad5e6c02') HTTP/1.1" 204 0
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7960/14497960/docs_service_history-1774703585282.jpg?ixlib=js-3.8.0&auto=format&s=bd341aa3adab89f196dd5558ad5e6c02 saved to cache
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa
2026-03-29 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7960/14497960/interior_rear_seats-1774702980620.jpg> (referer: None)
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8979%252F20348979%252Finterior_dashboard-1774547884079.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8979/20348979/interior_dashboard-1774547884079.jpg not downloaded yet
2026-03-29 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20385482.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7017%252F20337017%252Fexterior_rear_driver-1774698377869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_rear_driver-1774698377869.jpg not downloaded yet
2026-03-29 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20462610.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8979%252F20348979%252Finterior_boot-1774547934730.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8979/20348979/interior_boot-1774547934730.jpg not downloaded yet
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9056f90>
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3267%252F19413267%252Fexterior_front_passenger-1774706481110.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3267/19413267/exterior_front_passenger-1774706481110.jpg saved to cache
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24852beb-41ab-5a6d-a2c5-1e2968a63637
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82c9b50>
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3267%252F19413267%252Finterior_boot-1774704043188.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3267/19413267/interior_boot-1774704043188.jpg saved to cache
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24852beb-41ab-5a6d-a2c5-1e2968a63637
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f919e990>
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3267%252F19413267%252Finterior_rear_seats-1774703996462.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3267/19413267/interior_rear_seats-1774703996462.jpg saved to cache
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24852beb-41ab-5a6d-a2c5-1e2968a63637
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faccc8d0>
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7490%252F20477490%252Fexterior_rear_passenger-1774716081679.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_rear_passenger-1774716081679.jpg saved to cache
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97f8a5c9-2066-5e05-ba5e-22158de5b190
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7017%252F20337017%252Fexterior_front_passenger-1774698380220.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_front_passenger-1774698380220.jpg not downloaded yet
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8979%252F20348979%252Fdocs_service_history-1774552471781.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df16eecf5c87579523869f737af35b36b%27 HTTP/1.1" 200 None
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8979/20348979/docs_service_history-1774552471781.jpg?ixlib=js-3.8.0&auto=format&s=f16eecf5c87579523869f737af35b36b not downloaded yet
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7017%252F20337017%252Fexterior_rear_passenger-1774698374812.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_rear_passenger-1774698374812.jpg not downloaded yet
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f85f90>
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7960%252F14497960%252Finterior_rear_seats-1774702980620.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7960/14497960/interior_rear_seats-1774702980620.jpg saved to cache
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa
2026-03-29 20:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4440e848-6e9f-58bc-8102-0cf891fdd23b with identifier: 20385482
2026-03-29 20:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4440e848-6e9f-58bc-8102-0cf891fdd23b with scrape type 1
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4440e848-6e9f-58bc-8102-0cf891fdd23b
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5482%252F20385482%252Fexterior_front_driver-1774704112742.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_front_driver-1774704112742.jpg not downloaded yet
2026-03-29 20:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a14a9b2-2e52-51f7-b314-7ffd24825683 with identifier: 20462610
2026-03-29 20:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a14a9b2-2e52-51f7-b314-7ffd24825683 with scrape type 1
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a14a9b2-2e52-51f7-b314-7ffd24825683
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2610%252F20462610%252Fexterior_front_driver-1774714374288.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_front_driver-1774714374288.jpg not downloaded yet
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8979%252F20348979%252Fdocs_service_history-1774552473347.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9d1f2771bcda52acdb2e69f58cc023ad%27 HTTP/1.1" 200 None
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8979/20348979/docs_service_history-1774552473347.jpg?ixlib=js-3.8.0&auto=format&s=9d1f2771bcda52acdb2e69f58cc023ad not downloaded yet
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7017%252F20337017%252Finterior_front_seats-1774699002484.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7017/20337017/interior_front_seats-1774699002484.jpg not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5482%252F20385482%252Fexterior_rear_driver-1774704129197.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_rear_driver-1774704129197.jpg not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2610%252F20462610%252Fexterior_rear_driver-1774714408810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_rear_driver-1774714408810.jpg not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7017%252F20337017%252Finterior_rear_seats-1774698954051.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7017/20337017/interior_rear_seats-1774698954051.jpg not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5482%252F20385482%252Fexterior_front_passenger-1774704151665.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_front_passenger-1774704151665.jpg not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2610%252F20462610%252Fexterior_front_passenger-1774714394124.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_front_passenger-1774714394124.jpg not downloaded yet
2026-03-29 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3267/19413267/interior_front_seats-1774703982705.jpg> (referer: None)
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7017%252F20337017%252Finterior_dashboard-1774699062532.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7017/20337017/interior_dashboard-1774699062532.jpg not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5482%252F20385482%252Fexterior_rear_passenger-1774704140198.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_rear_passenger-1774704140198.jpg not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2610%252F20462610%252Fexterior_rear_passenger-1774714402872.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_rear_passenger-1774714402872.jpg not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7017%252F20337017%252Finterior_boot-1774698948917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7017/20337017/interior_boot-1774698948917.jpg not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5482%252F20385482%252Finterior_front_seats-1774704586793.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5482/20385482/interior_front_seats-1774704586793.jpg not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2610%252F20462610%252Finterior_front_seats-1774714637111.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2610/20462610/interior_front_seats-1774714637111.jpg not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7017%252F20337017%252Fdocs_service_history-1774699420420.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df95cc9cacb113c4706b3fa9cd61d7413%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7017/20337017/docs_service_history-1774699420420.jpg?ixlib=js-3.8.0&auto=format&s=f95cc9cacb113c4706b3fa9cd61d7413 not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5482%252F20385482%252Finterior_rear_seats-1774704604994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5482/20385482/interior_rear_seats-1774704604994.jpg not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2610%252F20462610%252Finterior_rear_seats-1774714647403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2610/20462610/interior_rear_seats-1774714647403.jpg not downloaded yet
2026-03-29 20:05:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf318d0>
2026-03-29 20:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3267%252F19413267%252Finterior_front_seats-1774703982705.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3267/19413267/interior_front_seats-1774703982705.jpg saved to cache
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24852beb-41ab-5a6d-a2c5-1e2968a63637
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7017%252F20337017%252Fdocs_service_history-1774699487781.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7d7091e6d439537d3ffc295e33879571%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7017/20337017/docs_service_history-1774699487781.jpg?ixlib=js-3.8.0&auto=format&s=7d7091e6d439537d3ffc295e33879571 not downloaded yet
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5482%252F20385482%252Finterior_dashboard-1774704624803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5482/20385482/interior_dashboard-1774704624803.jpg not downloaded yet
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2610%252F20462610%252Finterior_dashboard-1774714666448.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2610/20462610/interior_dashboard-1774714666448.jpg not downloaded yet
2026-03-29 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6724/20486724/instrument_cluster-1774773524974.jpg> (referer: None)
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5482%252F20385482%252Finstrument_cluster-1774704698249.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5482/20385482/instrument_cluster-1774704698249.jpg not downloaded yet
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2610%252F20462610%252Finstrument_cluster-1774714819316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2610/20462610/instrument_cluster-1774714819316.jpg not downloaded yet
2026-03-29 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_rear_passenger-1774773181385.jpg> (referer: None)
2026-03-29 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8979/20348979/docs_service_history-1774552471781.jpg?ixlib=js-3.8.0&auto=format&s=f16eecf5c87579523869f737af35b36b> (referer: None)
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5482%252F20385482%252Finterior_boot-1774704624919.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5482/20385482/interior_boot-1774704624919.jpg not downloaded yet
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2610%252F20462610%252Finterior_boot-1774714666395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2610/20462610/interior_boot-1774714666395.jpg not downloaded yet
2026-03-29 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7490/20477490/interior_rear_seats-1774718187892.jpg> (referer: None)
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5482%252F20385482%252Fdocs_service_history-1774704696655.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D981dd4da7b2d870c73005e0d9f12a802%27 HTTP/1.1" 200 None
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5482/20385482/docs_service_history-1774704696655.jpg?ixlib=js-3.8.0&auto=format&s=981dd4da7b2d870c73005e0d9f12a802 not downloaded yet
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2610%252F20462610%252Fdocs_service_history-1774714731021.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D94f825a757810dcf363d8060271098e6%27 HTTP/1.1" 200 None
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2610/20462610/docs_service_history-1774714731021.jpg?ixlib=js-3.8.0&auto=format&s=94f825a757810dcf363d8060271098e6 not downloaded yet
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f937bcd0>
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6724%252F20486724%252Finstrument_cluster-1774773524974.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6724/20486724/instrument_cluster-1774773524974.jpg saved to cache
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71641161-ebda-5688-98ca-86677dadf49c
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95d6990>
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6724%252F20486724%252Fexterior_rear_passenger-1774773181385.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_rear_passenger-1774773181385.jpg saved to cache
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71641161-ebda-5688-98ca-86677dadf49c
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9275910>
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8979%252F20348979%252Fdocs_service_history-1774552471781.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df16eecf5c87579523869f737af35b36b') HTTP/1.1" 204 0
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8979/20348979/docs_service_history-1774552471781.jpg?ixlib=js-3.8.0&auto=format&s=f16eecf5c87579523869f737af35b36b saved to cache
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb00de1e-9599-5aca-bf35-d40c57d8edc0
2026-03-29 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_rear_passenger-1774698374812.jpg> (referer: None)
2026-03-29 20:05:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadd0390>
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7490%252F20477490%252Finterior_rear_seats-1774718187892.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7490/20477490/interior_rear_seats-1774718187892.jpg saved to cache
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97f8a5c9-2066-5e05-ba5e-22158de5b190
2026-03-29 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6724/20486724/interior_dashboard-1774782997356.jpg> (referer: None)
2026-03-29 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_rear_driver-1774704129197.jpg> (referer: None)
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94ab590>
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7017%252F20337017%252Fexterior_rear_passenger-1774698374812.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_rear_passenger-1774698374812.jpg saved to cache
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28
2026-03-29 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_front_driver-1774704112742.jpg> (referer: None)
2026-03-29 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8979/20348979/docs_service_history-1774552473347.jpg?ixlib=js-3.8.0&auto=format&s=9d1f2771bcda52acdb2e69f58cc023ad> (referer: None)
2026-03-29 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_rear_driver-1774714408810.jpg> (referer: None)
2026-03-29 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_front_driver-1774714374288.jpg> (referer: None)
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e3c7d0>
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6724%252F20486724%252Finterior_dashboard-1774782997356.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6724/20486724/interior_dashboard-1774782997356.jpg saved to cache
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71641161-ebda-5688-98ca-86677dadf49c
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a12550>
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5482%252F20385482%252Fexterior_rear_driver-1774704129197.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_rear_driver-1774704129197.jpg saved to cache
2026-03-29 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4440e848-6e9f-58bc-8102-0cf891fdd23b
2026-03-29 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2610/20462610/docs_service_history-1774714731021.jpg?ixlib=js-3.8.0&auto=format&s=94f825a757810dcf363d8060271098e6> (referer: None)
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0a5450>
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5482%252F20385482%252Fexterior_front_driver-1774704112742.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_front_driver-1774704112742.jpg saved to cache
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4440e848-6e9f-58bc-8102-0cf891fdd23b
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94ab590>
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8979%252F20348979%252Fdocs_service_history-1774552473347.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9d1f2771bcda52acdb2e69f58cc023ad') HTTP/1.1" 204 0
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8979/20348979/docs_service_history-1774552473347.jpg?ixlib=js-3.8.0&auto=format&s=9d1f2771bcda52acdb2e69f58cc023ad saved to cache
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb00de1e-9599-5aca-bf35-d40c57d8edc0
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ccf5d0>
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2610%252F20462610%252Fexterior_rear_driver-1774714408810.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_rear_driver-1774714408810.jpg saved to cache
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a14a9b2-2e52-51f7-b314-7ffd24825683
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a13e50>
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2610%252F20462610%252Fexterior_front_driver-1774714374288.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_front_driver-1774714374288.jpg saved to cache
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a14a9b2-2e52-51f7-b314-7ffd24825683
2026-03-29 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20147268.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010ddf10>
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2610%252F20462610%252Fdocs_service_history-1774714731021.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D94f825a757810dcf363d8060271098e6') HTTP/1.1" 204 0
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2610/20462610/docs_service_history-1774714731021.jpg?ixlib=js-3.8.0&auto=format&s=94f825a757810dcf363d8060271098e6 saved to cache
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a14a9b2-2e52-51f7-b314-7ffd24825683
2026-03-29 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5482/20385482/interior_dashboard-1774704624803.jpg> (referer: None)
2026-03-29 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6724/20486724/damage_scratches-1774773225824.jpg> (referer: None)
2026-03-29 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6724/20486724/interior_boot-1774773524269.jpg> (referer: None)
2026-03-29 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2610/20462610/interior_dashboard-1774714666448.jpg> (referer: None)
2026-03-29 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7017/20337017/interior_front_seats-1774699002484.jpg> (referer: None)
2026-03-29 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5482/20385482/instrument_cluster-1774704698249.jpg> (referer: None)
2026-03-29 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2610/20462610/instrument_cluster-1774714819316.jpg> (referer: None)
2026-03-29 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5482/20385482/interior_boot-1774704624919.jpg> (referer: None)
2026-03-29 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5482/20385482/docs_service_history-1774704696655.jpg?ixlib=js-3.8.0&auto=format&s=981dd4da7b2d870c73005e0d9f12a802> (referer: None)
2026-03-29 20:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5f3dfab-9e26-55db-9e88-4997c3262d7d with identifier: 20147268
2026-03-29 20:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5f3dfab-9e26-55db-9e88-4997c3262d7d with scrape type 1
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5f3dfab-9e26-55db-9e88-4997c3262d7d
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F20147268%252Fexterior_front_driver-1774688921904.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_front_driver-1774688921904.jpg not downloaded yet
2026-03-29 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7017/20337017/docs_service_history-1774699487781.jpg?ixlib=js-3.8.0&auto=format&s=7d7091e6d439537d3ffc295e33879571> (referer: None)
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F20147268%252Fexterior_rear_driver-1774688900992.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_rear_driver-1774688900992.jpg not downloaded yet
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F20147268%252Fexterior_front_passenger-1774688910489.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_front_passenger-1774688910489.jpg not downloaded yet
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F20147268%252Fexterior_rear_passenger-1774688880361.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_rear_passenger-1774688880361.jpg not downloaded yet
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0a75d0>
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5482%252F20385482%252Finterior_dashboard-1774704624803.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5482/20385482/interior_dashboard-1774704624803.jpg saved to cache
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4440e848-6e9f-58bc-8102-0cf891fdd23b
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7268%252F20147268%252Finterior_front_seats-1774689386368.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7268/20147268/interior_front_seats-1774689386368.jpg not downloaded yet
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8701175350>
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6724%252F20486724%252Fdamage_scratches-1774773225824.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6724/20486724/damage_scratches-1774773225824.jpg saved to cache
2026-03-29 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71641161-ebda-5688-98ca-86677dadf49c
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a714d0>
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6724%252F20486724%252Finterior_boot-1774773524269.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6724/20486724/interior_boot-1774773524269.jpg saved to cache
2026-03-29 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71641161-ebda-5688-98ca-86677dadf49c
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7268%252F20147268%252Finterior_rear_seats-1774689334182.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7268/20147268/interior_rear_seats-1774689334182.jpg not downloaded yet
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0f5bd0>
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2610%252F20462610%252Finterior_dashboard-1774714666448.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2610/20462610/interior_dashboard-1774714666448.jpg saved to cache
2026-03-29 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a14a9b2-2e52-51f7-b314-7ffd24825683
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xd0'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'moto g85 5G\x00'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x9c'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 174 - value: b'motorola\x00'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xcb'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 183 - value: b'2026:03:28 11:56:13\x00'
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac87590>
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7017%252F20337017%252Finterior_front_seats-1774699002484.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7017/20337017/interior_front_seats-1774699002484.jpg saved to cache
2026-03-29 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f824c750>
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5482%252F20385482%252Finstrument_cluster-1774704698249.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5482/20385482/instrument_cluster-1774704698249.jpg saved to cache
2026-03-29 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4440e848-6e9f-58bc-8102-0cf891fdd23b
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa007c50>
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2610%252F20462610%252Finstrument_cluster-1774714819316.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2610/20462610/instrument_cluster-1774714819316.jpg saved to cache
2026-03-29 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a14a9b2-2e52-51f7-b314-7ffd24825683
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac86490>
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5482%252F20385482%252Finterior_boot-1774704624919.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5482/20385482/interior_boot-1774704624919.jpg saved to cache
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4440e848-6e9f-58bc-8102-0cf891fdd23b
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f91e4910>
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5482%252F20385482%252Fdocs_service_history-1774704696655.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D981dd4da7b2d870c73005e0d9f12a802') HTTP/1.1" 204 0
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5482/20385482/docs_service_history-1774704696655.jpg?ixlib=js-3.8.0&auto=format&s=981dd4da7b2d870c73005e0d9f12a802 saved to cache
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4440e848-6e9f-58bc-8102-0cf891fdd23b
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xd0'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'moto g85 5G\x00'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x9c'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 174 - value: b'motorola\x00'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xcb'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 183 - value: b'2026:03:28 12:04:32\x00'
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f927d6d0>
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7017%252F20337017%252Fdocs_service_history-1774699487781.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7d7091e6d439537d3ffc295e33879571') HTTP/1.1" 204 0
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7017/20337017/docs_service_history-1774699487781.jpg?ixlib=js-3.8.0&auto=format&s=7d7091e6d439537d3ffc295e33879571 saved to cache
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F20147268%252Finterior_dashboard-1774689414218.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/20147268/interior_dashboard-1774689414218.jpg not downloaded yet
2026-03-29 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2610/20462610/interior_boot-1774714666395.jpg> (referer: None)
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F20147268%252Finstrument_cluster-1774689388017.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/20147268/instrument_cluster-1774689388017.jpg not downloaded yet
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7268%252F20147268%252Finterior_boot-1774689370791.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7268/20147268/interior_boot-1774689370791.jpg not downloaded yet
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7268%252F20147268%252Fdocs_service_history-1774689581016.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6fba98416fe6c43dfa0b5a45136f040c%27 HTTP/1.1" 200 None
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7268/20147268/docs_service_history-1774689581016.jpg?ixlib=js-3.8.0&auto=format&s=6fba98416fe6c43dfa0b5a45136f040c not downloaded yet
2026-03-29 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7017/20337017/docs_service_history-1774699420420.jpg?ixlib=js-3.8.0&auto=format&s=f95cc9cacb113c4706b3fa9cd61d7413> (referer: None)
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81e3750>
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2610%252F20462610%252Finterior_boot-1774714666395.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2610/20462610/interior_boot-1774714666395.jpg saved to cache
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a14a9b2-2e52-51f7-b314-7ffd24825683
2026-03-29 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2610/20462610/interior_front_seats-1774714637111.jpg> (referer: None)
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xd0'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'moto g85 5G\x00'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x9c'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 174 - value: b'motorola\x00'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xcb'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 183 - value: b'2026:03:28 12:03:11\x00'
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab9ccd0>
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7017%252F20337017%252Fdocs_service_history-1774699420420.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df95cc9cacb113c4706b3fa9cd61d7413') HTTP/1.1" 204 0
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7017/20337017/docs_service_history-1774699420420.jpg?ixlib=js-3.8.0&auto=format&s=f95cc9cacb113c4706b3fa9cd61d7413 saved to cache
2026-03-29 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28
2026-03-29 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5482/20385482/interior_rear_seats-1774704604994.jpg> (referer: None)
2026-03-29 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2610/20462610/interior_rear_seats-1774714647403.jpg> (referer: None)
2026-03-29 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5482/20385482/interior_front_seats-1774704586793.jpg> (referer: None)
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f927f310>
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2610%252F20462610%252Finterior_front_seats-1774714637111.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2610/20462610/interior_front_seats-1774714637111.jpg saved to cache
2026-03-29 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a14a9b2-2e52-51f7-b314-7ffd24825683
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8644e50>
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5482%252F20385482%252Finterior_rear_seats-1774704604994.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5482/20385482/interior_rear_seats-1774704604994.jpg saved to cache
2026-03-29 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4440e848-6e9f-58bc-8102-0cf891fdd23b
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a65d10>
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2610%252F20462610%252Finterior_rear_seats-1774714647403.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2610/20462610/interior_rear_seats-1774714647403.jpg saved to cache
2026-03-29 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a14a9b2-2e52-51f7-b314-7ffd24825683
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadb7d90>
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5482%252F20385482%252Finterior_front_seats-1774704586793.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5482/20385482/interior_front_seats-1774704586793.jpg saved to cache
2026-03-29 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4440e848-6e9f-58bc-8102-0cf891fdd23b
2026-03-29 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_front_driver-1774688921904.jpg> (referer: None)
2026-03-29 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7268/20147268/docs_service_history-1774689581016.jpg?ixlib=js-3.8.0&auto=format&s=6fba98416fe6c43dfa0b5a45136f040c> (referer: None)
2026-03-29 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7017/20337017/interior_boot-1774698948917.jpg> (referer: None)
2026-03-29 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7268/20147268/instrument_cluster-1774689388017.jpg> (referer: None)
2026-03-29 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_front_passenger-1774688910489.jpg> (referer: None)
2026-03-29 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_rear_passenger-1774688880361.jpg> (referer: None)
2026-03-29 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_rear_driver-1774688900992.jpg> (referer: None)
2026-03-29 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7268/20147268/interior_rear_seats-1774689334182.jpg> (referer: None)
2026-03-29 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7268/20147268/interior_front_seats-1774689386368.jpg> (referer: None)
2026-03-29 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7268/20147268/interior_dashboard-1774689414218.jpg> (referer: None)
2026-03-29 20:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7268/20147268/interior_boot-1774689370791.jpg> (referer: None)
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f751d0>
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F20147268%252Fexterior_front_driver-1774688921904.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_front_driver-1774688921904.jpg saved to cache
2026-03-29 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5f3dfab-9e26-55db-9e88-4997c3262d7d
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f920ba50>
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7268%252F20147268%252Fdocs_service_history-1774689581016.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6fba98416fe6c43dfa0b5a45136f040c') HTTP/1.1" 204 0
2026-03-29 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7268/20147268/docs_service_history-1774689581016.jpg?ixlib=js-3.8.0&auto=format&s=6fba98416fe6c43dfa0b5a45136f040c saved to cache
2026-03-29 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5f3dfab-9e26-55db-9e88-4997c3262d7d
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xd0'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'moto g85 5G\x00'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x9c'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 174 - value: b'motorola\x00'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xcb'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:13 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 183 - value: b'2026:03:28 11:55:09\x00'
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f870ea72c10>
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7017%252F20337017%252Finterior_boot-1774698948917.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7017/20337017/interior_boot-1774698948917.jpg saved to cache
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9309d90>
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F20147268%252Finstrument_cluster-1774689388017.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/20147268/instrument_cluster-1774689388017.jpg saved to cache
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5f3dfab-9e26-55db-9e88-4997c3262d7d
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadb4810>
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F20147268%252Fexterior_front_passenger-1774688910489.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_front_passenger-1774688910489.jpg saved to cache
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5f3dfab-9e26-55db-9e88-4997c3262d7d
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f74150>
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F20147268%252Fexterior_rear_passenger-1774688880361.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_rear_passenger-1774688880361.jpg saved to cache
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5f3dfab-9e26-55db-9e88-4997c3262d7d
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9474650>
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F20147268%252Fexterior_rear_driver-1774688900992.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_rear_driver-1774688900992.jpg saved to cache
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5f3dfab-9e26-55db-9e88-4997c3262d7d
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad4df90>
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7268%252F20147268%252Finterior_rear_seats-1774689334182.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7268/20147268/interior_rear_seats-1774689334182.jpg saved to cache
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5f3dfab-9e26-55db-9e88-4997c3262d7d
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadb62d0>
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7268%252F20147268%252Finterior_front_seats-1774689386368.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7268/20147268/interior_front_seats-1774689386368.jpg saved to cache
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5f3dfab-9e26-55db-9e88-4997c3262d7d
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa6a810>
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7268%252F20147268%252Finterior_dashboard-1774689414218.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7268/20147268/interior_dashboard-1774689414218.jpg saved to cache
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5f3dfab-9e26-55db-9e88-4997c3262d7d
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faecc350>
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7268%252F20147268%252Finterior_boot-1774689370791.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7268/20147268/interior_boot-1774689370791.jpg saved to cache
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5f3dfab-9e26-55db-9e88-4997c3262d7d
2026-03-29 20:05:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5f3dfab-9e26-55db-9e88-4997c3262d7d, skipping ID generation
2026-03-29 20:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5f3dfab-9e26-55db-9e88-4997c3262d7d with scrape type 1
2026-03-29 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5f3dfab-9e26-55db-9e88-4997c3262d7d sending to next pipeline
2026-03-29 20:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f5f3dfab-9e26-55db-9e88-4997c3262d7d, identifier: 20147268
2026-03-29 20:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f5f3dfab-9e26-55db-9e88-4997c3262d7d with identifier: 20147268
2026-03-29 20:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f5f3dfab-9e26-55db-9e88-4997c3262d7d with identifier: 20147268
2026-03-29 20:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f5f3dfab-9e26-55db-9e88-4997c3262d7d with identifier: 20147268 to the API
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7268/20147268/interior_boot-1774689370791.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f5f3dfab-9e26-55db-9e88-4997c3262d7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YY18 GYZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20147268',
'listing': 'auction',
'location': 'Kingston upon Hull Hull',
'make': 'Ford',
'model': 'C-MAX',
'odometer': 57837,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1380625,
'Height': 2831,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_front_driver-1774688921904.jpg',
'Width': 3775},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1678367,
'Height': 2657,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_rear_driver-1774688900992.jpg',
'Width': 3543},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1737339,
'Height': 2678,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_front_passenger-1774688910489.jpg',
'Width': 3571},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1817567,
'Height': 2558,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7268/20147268/exterior_rear_passenger-1774688880361.jpg',
'Width': 3410},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1966301,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7268/20147268/interior_front_seats-1774689386368.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1772624,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7268/20147268/interior_rear_seats-1774689334182.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2359973,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7268/20147268/interior_dashboard-1774689414218.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1691488,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7268/20147268/instrument_cluster-1774689388017.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2989992,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7268/20147268/interior_boot-1774689370791.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5f3dfab-9e26-55db-9e88-4997c3262d7d/f5f3dfab-9e26-55db-9e88-4997c3262d7d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1356692,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7268/20147268/docs_service_history-1774689581016.jpg?ixlib=js-3.8.0&auto=format&s=6fba98416fe6c43dfa0b5a45136f040c',
'Width': 3840}],
'price': 4343,
'price_includes_vat': False,
'registration_date': '2018-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Ford C-MAX Zetec Turbo',
'transmission': 'manual',
'trim': 'Zetec Turbo',
'vin': 'WF0VXXGCEVJS76111',
'year': 2018}
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720147268%27 HTTP/1.1" 200 None
2026-03-29 20:05:15 [motorway.uk] INFO: Saving data for 20147268: {'created_time': 1774814715.483212, 'last_price_update_time': 1774814715.483223, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20147268') HTTP/1.1" 204 0
2026-03-29 20:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_front_passenger-1774704151665.jpg> (referer: None)
2026-03-29 20:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_front_passenger-1774698380220.jpg> (referer: None)
2026-03-29 20:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_rear_passenger-1774714402872.jpg> (referer: None)
2026-03-29 20:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_rear_passenger-1774704140198.jpg> (referer: None)
2026-03-29 20:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_front_passenger-1774714394124.jpg> (referer: None)
2026-03-29 20:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7017/20337017/interior_dashboard-1774699062532.jpg> (referer: None)
2026-03-29 20:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7017/20337017/interior_rear_seats-1774698954051.jpg> (referer: None)
2026-03-29 20:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8fad810>
2026-03-29 20:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5482%252F20385482%252Fexterior_front_passenger-1774704151665.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_front_passenger-1774704151665.jpg saved to cache
2026-03-29 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4440e848-6e9f-58bc-8102-0cf891fdd23b
2026-03-29 20:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadee950>
2026-03-29 20:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7017%252F20337017%252Fexterior_front_passenger-1774698380220.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_front_passenger-1774698380220.jpg saved to cache
2026-03-29 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28
2026-03-29 20:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d80f90>
2026-03-29 20:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2610%252F20462610%252Fexterior_rear_passenger-1774714402872.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_rear_passenger-1774714402872.jpg saved to cache
2026-03-29 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a14a9b2-2e52-51f7-b314-7ffd24825683
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf05910>
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5482%252F20385482%252Fexterior_rear_passenger-1774704140198.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_rear_passenger-1774704140198.jpg saved to cache
2026-03-29 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4440e848-6e9f-58bc-8102-0cf891fdd23b
2026-03-29 20:05:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4440e848-6e9f-58bc-8102-0cf891fdd23b, skipping ID generation
2026-03-29 20:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4440e848-6e9f-58bc-8102-0cf891fdd23b with scrape type 1
2026-03-29 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4440e848-6e9f-58bc-8102-0cf891fdd23b sending to next pipeline
2026-03-29 20:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4440e848-6e9f-58bc-8102-0cf891fdd23b, identifier: 20385482
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8faea90>
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2610%252F20462610%252Fexterior_front_passenger-1774714394124.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_front_passenger-1774714394124.jpg saved to cache
2026-03-29 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a14a9b2-2e52-51f7-b314-7ffd24825683
2026-03-29 20:05:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a14a9b2-2e52-51f7-b314-7ffd24825683, skipping ID generation
2026-03-29 20:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a14a9b2-2e52-51f7-b314-7ffd24825683 with scrape type 1
2026-03-29 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a14a9b2-2e52-51f7-b314-7ffd24825683 sending to next pipeline
2026-03-29 20:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5a14a9b2-2e52-51f7-b314-7ffd24825683, identifier: 20462610
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xd0'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'moto g85 5G\x00'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x9c'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 174 - value: b'motorola\x00'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xcb'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 183 - value: b'2026:03:28 11:57:02\x00'
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf05910>
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7017%252F20337017%252Finterior_dashboard-1774699062532.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7017/20337017/interior_dashboard-1774699062532.jpg saved to cache
2026-03-29 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0c\xd0'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'moto g85 5G\x00'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\t\x9c'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 174 - value: b'motorola\x00'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xcb'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:16 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 183 - value: b'2026:03:28 11:54:24\x00'
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadedd90>
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7017%252F20337017%252Finterior_rear_seats-1774698954051.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7017/20337017/interior_rear_seats-1774698954051.jpg saved to cache
2026-03-29 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28
2026-03-29 20:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4440e848-6e9f-58bc-8102-0cf891fdd23b with identifier: 20385482
2026-03-29 20:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4440e848-6e9f-58bc-8102-0cf891fdd23b with identifier: 20385482
2026-03-29 20:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4440e848-6e9f-58bc-8102-0cf891fdd23b with identifier: 20385482 to the API
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_rear_passenger-1774704140198.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '4440e848-6e9f-58bc-8102-0cf891fdd23b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DL18 SYZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20385482',
'listing': 'auction',
'location': 'Suffolk Woodbridge',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 52500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1338678,
'Height': 2490,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_front_driver-1774704112742.jpg',
'Width': 3320},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1059156,
'Height': 2073,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_rear_driver-1774704129197.jpg',
'Width': 2764},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 920388,
'Height': 1982,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_front_passenger-1774704151665.jpg',
'Width': 2642},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1488775,
'Height': 2495,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5482/20385482/exterior_rear_passenger-1774704140198.jpg',
'Width': 3326},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3913732,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5482/20385482/interior_front_seats-1774704586793.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3829369,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5482/20385482/interior_rear_seats-1774704604994.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1942963,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5482/20385482/interior_dashboard-1774704624803.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2289615,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5482/20385482/instrument_cluster-1774704698249.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3790225,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5482/20385482/interior_boot-1774704624919.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4440e848-6e9f-58bc-8102-0cf891fdd23b/4440e848-6e9f-58bc-8102-0cf891fdd23b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3631747,
'Height': 3417,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5482/20385482/docs_service_history-1774704696655.jpg?ixlib=js-3.8.0&auto=format&s=981dd4da7b2d870c73005e0d9f12a802',
'Width': 2129}],
'price': 10107,
'price_includes_vat': False,
'registration_date': '2018-06-29',
'seats_number': None,
'seller_name': None,
'title': 'Toyota C-HR Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'vin': 'NMTKY3BX80R044465',
'year': 2018}
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720385482%27 HTTP/1.1" 200 None
2026-03-29 20:05:17 [motorway.uk] INFO: Saving data for 20385482: {'created_time': 1774814717.445801, 'last_price_update_time': 1774814717.445811, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20385482') HTTP/1.1" 204 0
2026-03-29 20:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5a14a9b2-2e52-51f7-b314-7ffd24825683 with identifier: 20462610
2026-03-29 20:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5a14a9b2-2e52-51f7-b314-7ffd24825683 with identifier: 20462610
2026-03-29 20:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5a14a9b2-2e52-51f7-b314-7ffd24825683 with identifier: 20462610 to the API
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_front_passenger-1774714394124.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '5a14a9b2-2e52-51f7-b314-7ffd24825683',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EJ70 HFU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20462610',
'listing': 'auction',
'location': 'Essex Wickford',
'make': 'BMW',
'model': '1 Series',
'odometer': 40800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1924986,
'Height': 2568,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_front_driver-1774714374288.jpg',
'Width': 3424},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1706673,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_rear_driver-1774714408810.jpg',
'Width': 3455},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1946045,
'Height': 2638,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_front_passenger-1774714394124.jpg',
'Width': 3517},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1630836,
'Height': 2453,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2610/20462610/exterior_rear_passenger-1774714402872.jpg',
'Width': 3270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3557445,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2610/20462610/interior_front_seats-1774714637111.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3925833,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2610/20462610/interior_rear_seats-1774714647403.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3077091,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2610/20462610/interior_dashboard-1774714666448.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3423309,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2610/20462610/instrument_cluster-1774714819316.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4607409,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2610/20462610/interior_boot-1774714666395.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a14a9b2-2e52-51f7-b314-7ffd24825683/5a14a9b2-2e52-51f7-b314-7ffd24825683_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191091,
'Height': 585,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2610/20462610/docs_service_history-1774714731021.jpg?ixlib=js-3.8.0&auto=format&s=94f825a757810dcf363d8060271098e6',
'Width': 708}],
'price': 13976,
'price_includes_vat': False,
'registration_date': '2020-12-09',
'seats_number': None,
'seller_name': None,
'title': 'BMW 118I M Sport',
'transmission': 'manual',
'trim': '118I M Sport',
'vin': 'WBA7K320105S62228',
'year': 2020}
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720462610%27 HTTP/1.1" 200 None
2026-03-29 20:05:17 [motorway.uk] INFO: Saving data for 20462610: {'created_time': 1774814717.834646, 'last_price_update_time': 1774814717.834659, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20462610') HTTP/1.1" 204 0
2026-03-29 20:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_front_driver-1774698371027.jpg> (referer: None)
2026-03-29 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_rear_driver-1774698377869.jpg> (referer: None)
2026-03-29 20:05:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_front_driver-1774547085898.jpg> (referer: None)
2026-03-29 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_front_passenger-1774547150504.jpg> (referer: None)
2026-03-29 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_rear_passenger-1774547134826.jpg> (referer: None)
2026-03-29 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_rear_driver-1774547101447.jpg> (referer: None)
2026-03-29 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_front_passenger-1774773198077.jpg> (referer: None)
2026-03-29 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6724/20486724/interior_rear_seats-1774783196278.jpg> (referer: None)
2026-03-29 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6724/20486724/interior_front_seats-1774783174851.jpg> (referer: None)
2026-03-29 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8979/20348979/interior_boot-1774547934730.jpg> (referer: None)
2026-03-29 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8979/20348979/interior_front_seats-1774547756209.jpg> (referer: None)
2026-03-29 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8979/20348979/interior_rear_seats-1774547830841.jpg> (referer: None)
2026-03-29 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8979/20348979/interior_dashboard-1774547884079.jpg> (referer: None)
2026-03-29 20:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84dd590>
2026-03-29 20:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7017%252F20337017%252Fexterior_front_driver-1774698371027.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_front_driver-1774698371027.jpg saved to cache
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f39c90>
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7017%252F20337017%252Fexterior_rear_driver-1774698377869.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_rear_driver-1774698377869.jpg saved to cache
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28
2026-03-29 20:05:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28, skipping ID generation
2026-03-29 20:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28 with scrape type 1
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28 sending to next pipeline
2026-03-29 20:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28, identifier: 20337017
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8131390>
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8979%252F20348979%252Fexterior_front_driver-1774547085898.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_front_driver-1774547085898.jpg saved to cache
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb00de1e-9599-5aca-bf35-d40c57d8edc0
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8918d90>
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8979%252F20348979%252Fexterior_front_passenger-1774547150504.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_front_passenger-1774547150504.jpg saved to cache
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb00de1e-9599-5aca-bf35-d40c57d8edc0
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f25dd0>
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8979%252F20348979%252Fexterior_rear_passenger-1774547134826.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_rear_passenger-1774547134826.jpg saved to cache
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb00de1e-9599-5aca-bf35-d40c57d8edc0
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8fb9cd0>
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8979%252F20348979%252Fexterior_rear_driver-1774547101447.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_rear_driver-1774547101447.jpg saved to cache
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb00de1e-9599-5aca-bf35-d40c57d8edc0
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f939c750>
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6724%252F20486724%252Fexterior_front_passenger-1774773198077.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_front_passenger-1774773198077.jpg saved to cache
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71641161-ebda-5688-98ca-86677dadf49c
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f891a8d0>
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6724%252F20486724%252Finterior_rear_seats-1774783196278.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6724/20486724/interior_rear_seats-1774783196278.jpg saved to cache
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71641161-ebda-5688-98ca-86677dadf49c
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f24350>
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6724%252F20486724%252Finterior_front_seats-1774783174851.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6724/20486724/interior_front_seats-1774783174851.jpg saved to cache
2026-03-29 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71641161-ebda-5688-98ca-86677dadf49c
2026-03-29 20:05:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84dd2d0>
2026-03-29 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8979%252F20348979%252Finterior_boot-1774547934730.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8979/20348979/interior_boot-1774547934730.jpg saved to cache
2026-03-29 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb00de1e-9599-5aca-bf35-d40c57d8edc0
2026-03-29 20:05:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa112250>
2026-03-29 20:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8979%252F20348979%252Finterior_front_seats-1774547756209.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8979/20348979/interior_front_seats-1774547756209.jpg saved to cache
2026-03-29 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb00de1e-9599-5aca-bf35-d40c57d8edc0
2026-03-29 20:05:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9208110>
2026-03-29 20:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8979%252F20348979%252Finterior_rear_seats-1774547830841.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8979/20348979/interior_rear_seats-1774547830841.jpg saved to cache
2026-03-29 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb00de1e-9599-5aca-bf35-d40c57d8edc0
2026-03-29 20:05:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89181d0>
2026-03-29 20:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8979%252F20348979%252Finterior_dashboard-1774547884079.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8979/20348979/interior_dashboard-1774547884079.jpg saved to cache
2026-03-29 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb00de1e-9599-5aca-bf35-d40c57d8edc0
2026-03-29 20:05:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb00de1e-9599-5aca-bf35-d40c57d8edc0, skipping ID generation
2026-03-29 20:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb00de1e-9599-5aca-bf35-d40c57d8edc0 with scrape type 1
2026-03-29 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb00de1e-9599-5aca-bf35-d40c57d8edc0 sending to next pipeline
2026-03-29 20:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bb00de1e-9599-5aca-bf35-d40c57d8edc0, identifier: 20348979
2026-03-29 20:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28 with identifier: 20337017
2026-03-29 20:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28 with identifier: 20337017
2026-03-29 20:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 50e5c687-cab1-5edf-9b62-7d6eeb9dcb28 with identifier: 20337017 to the API
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_rear_driver-1774698377869.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '50e5c687-cab1-5edf-9b62-7d6eeb9dcb28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LY66 EHZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20337017',
'listing': 'auction',
'location': 'Kent Margate',
'make': 'Toyota',
'model': 'Prius',
'odometer': 73125,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1012120,
'Height': 2366,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_front_driver-1774698371027.jpg',
'Width': 3154},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 825294,
'Height': 2134,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_rear_driver-1774698377869.jpg',
'Width': 2845},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 795924,
'Height': 1878,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_front_passenger-1774698380220.jpg',
'Width': 2504},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 903288,
'Height': 2043,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7017/20337017/exterior_rear_passenger-1774698374812.jpg',
'Width': 2724},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4536662,
'Height': 2460,
'OriginUrl': 'https://motorway-photos.imgix.net/7017/20337017/interior_front_seats-1774699002484.jpg',
'Width': 3280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4726215,
'Height': 2460,
'OriginUrl': 'https://motorway-photos.imgix.net/7017/20337017/interior_rear_seats-1774698954051.jpg',
'Width': 3280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3407573,
'Height': 2460,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7017/20337017/interior_dashboard-1774699062532.jpg',
'Width': 3280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4912040,
'Height': 2460,
'OriginUrl': 'https://motorway-photos.imgix.net/7017/20337017/interior_boot-1774698948917.jpg',
'Width': 3280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3176756,
'Height': 2460,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7017/20337017/docs_service_history-1774699420420.jpg?ixlib=js-3.8.0&auto=format&s=f95cc9cacb113c4706b3fa9cd61d7413',
'Width': 3280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50e5c687-cab1-5edf-9b62-7d6eeb9dcb28/50e5c687-cab1-5edf-9b62-7d6eeb9dcb28_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3832940,
'Height': 2460,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7017/20337017/docs_service_history-1774699487781.jpg?ixlib=js-3.8.0&auto=format&s=7d7091e6d439537d3ffc295e33879571',
'Width': 3280}],
'price': 9069,
'price_includes_vat': False,
'registration_date': '2016-12-16',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Prius Excel VVT-i CVT',
'transmission': 'automatic',
'trim': 'Excel VVT-i CVT',
'vin': 'JTDKB3FU403539976',
'year': 2016}
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720337017%27 HTTP/1.1" 200 None
2026-03-29 20:05:20 [motorway.uk] INFO: Saving data for 20337017: {'created_time': 1774814720.803709, 'last_price_update_time': 1774814720.803726, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20337017') HTTP/1.1" 204 0
2026-03-29 20:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bb00de1e-9599-5aca-bf35-d40c57d8edc0 with identifier: 20348979
2026-03-29 20:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bb00de1e-9599-5aca-bf35-d40c57d8edc0 with identifier: 20348979
2026-03-29 20:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bb00de1e-9599-5aca-bf35-d40c57d8edc0 with identifier: 20348979 to the API
2026-03-29 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8979/20348979/interior_dashboard-1774547884079.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bb00de1e-9599-5aca-bf35-d40c57d8edc0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SX11 AHU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20348979',
'listing': 'auction',
'location': 'Greater London Twickenham',
'make': 'Kia',
'model': 'Venga',
'odometer': 78000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2040980,
'Height': 2483,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_front_driver-1774547085898.jpg',
'Width': 3310},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1825117,
'Height': 2483,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_rear_driver-1774547101447.jpg',
'Width': 3310},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1700160,
'Height': 2386,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_front_passenger-1774547150504.jpg',
'Width': 3181},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1666041,
'Height': 2328,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8979/20348979/exterior_rear_passenger-1774547134826.jpg',
'Width': 3104},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3751925,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8979/20348979/interior_front_seats-1774547756209.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3797545,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8979/20348979/interior_rear_seats-1774547830841.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4280393,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8979/20348979/interior_dashboard-1774547884079.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3430114,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8979/20348979/interior_boot-1774547934730.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544501,
'Height': 1551,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8979/20348979/docs_service_history-1774552471781.jpg?ixlib=js-3.8.0&auto=format&s=f16eecf5c87579523869f737af35b36b',
'Width': 4072},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb00de1e-9599-5aca-bf35-d40c57d8edc0/bb00de1e-9599-5aca-bf35-d40c57d8edc0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1872795,
'Height': 2241,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8979/20348979/docs_service_history-1774552473347.jpg?ixlib=js-3.8.0&auto=format&s=9d1f2771bcda52acdb2e69f58cc023ad',
'Width': 3071}],
'price': 2920,
'price_includes_vat': False,
'registration_date': '2011-08-19',
'seats_number': None,
'seller_name': None,
'title': 'Kia Venga 3 Auto',
'transmission': 'automatic',
'trim': '3 Auto',
'vin': 'TMAEH812MBJ080347',
'year': 2011}
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720348979%27 HTTP/1.1" 200 None
2026-03-29 20:05:21 [motorway.uk] INFO: Saving data for 20348979: {'created_time': 1774814721.247792, 'last_price_update_time': 1774814721.247802, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20348979') HTTP/1.1" 204 0
2026-03-29 20:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7490/20477490/docs_service_history-1774718360182.jpg?ixlib=js-3.8.0&auto=format&s=6310dccb418f44d2c8a6debd633d0ec9> (referer: None)
2026-03-29 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_front_driver-1774773165407.jpg> (referer: None)
2026-03-29 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_rear_driver-1774773173418.jpg> (referer: None)
2026-03-29 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7490/20477490/interior_boot-1774717778073.jpg> (referer: None)
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94b6850>
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7490%252F20477490%252Fdocs_service_history-1774718360182.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6310dccb418f44d2c8a6debd633d0ec9') HTTP/1.1" 204 0
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7490/20477490/docs_service_history-1774718360182.jpg?ixlib=js-3.8.0&auto=format&s=6310dccb418f44d2c8a6debd633d0ec9 saved to cache
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 97f8a5c9-2066-5e05-ba5e-22158de5b190
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa68790>
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6724%252F20486724%252Fexterior_front_driver-1774773165407.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_front_driver-1774773165407.jpg saved to cache
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71641161-ebda-5688-98ca-86677dadf49c
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa110b10>
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6724%252F20486724%252Fexterior_rear_driver-1774773173418.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_rear_driver-1774773173418.jpg saved to cache
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71641161-ebda-5688-98ca-86677dadf49c
2026-03-29 20:05:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71641161-ebda-5688-98ca-86677dadf49c, skipping ID generation
2026-03-29 20:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71641161-ebda-5688-98ca-86677dadf49c with scrape type 1
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71641161-ebda-5688-98ca-86677dadf49c sending to next pipeline
2026-03-29 20:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 71641161-ebda-5688-98ca-86677dadf49c, identifier: 20486724
2026-03-29 20:05:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f920a910>
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7490%252F20477490%252Finterior_boot-1774717778073.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7490/20477490/interior_boot-1774717778073.jpg saved to cache
2026-03-29 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 97f8a5c9-2066-5e05-ba5e-22158de5b190
2026-03-29 20:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 71641161-ebda-5688-98ca-86677dadf49c with identifier: 20486724
2026-03-29 20:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 71641161-ebda-5688-98ca-86677dadf49c with identifier: 20486724
2026-03-29 20:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 71641161-ebda-5688-98ca-86677dadf49c with identifier: 20486724 to the API
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_rear_driver-1774773173418.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '71641161-ebda-5688-98ca-86677dadf49c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AH06 MCN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20486724',
'listing': 'auction',
'location': 'Aberdeenshire Inverurie',
'make': 'Land Rover',
'model': 'Discovery',
'odometer': 66300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1801321,
'Height': 2506,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_front_driver-1774773165407.jpg',
'Width': 3341},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2247360,
'Height': 2514,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_rear_driver-1774773173418.jpg',
'Width': 3352},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2291055,
'Height': 2655,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_front_passenger-1774773198077.jpg',
'Width': 3540},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2300227,
'Height': 2604,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6724/20486724/exterior_rear_passenger-1774773181385.jpg',
'Width': 3472},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3275826,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6724/20486724/interior_front_seats-1774783174851.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2391487,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6724/20486724/interior_rear_seats-1774783196278.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2063526,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6724/20486724/interior_dashboard-1774782997356.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1295881,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6724/20486724/instrument_cluster-1774773524974.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4500027,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6724/20486724/interior_boot-1774773524269.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71641161-ebda-5688-98ca-86677dadf49c/71641161-ebda-5688-98ca-86677dadf49c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4403771,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6724/20486724/damage_scratches-1774773225824.jpg',
'Width': 4032}],
'price': 18663,
'price_includes_vat': False,
'registration_date': '2019-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Discovery SE SDV6 Auto',
'transmission': 'automatic',
'trim': 'SE SDV6 Auto',
'vin': 'SALRA2AK5KA096424',
'year': 2019}
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486724%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [motorway.uk] INFO: Saving data for 20486724: {'created_time': 1774814722.392961, 'last_price_update_time': 1774814722.392972, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20486724') HTTP/1.1" 204 0
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=864&page=24&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_front_driver-1774716031854.jpg> (referer: None)
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3267/19413267/exterior_rear_driver-1774693457910.jpg> (referer: None)
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_rear_passenger-1774702535301.jpg> (referer: None)
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_rear_driver-1774716053969.jpg> (referer: None)
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_front_passenger-1774716101450.jpg> (referer: None)
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7490/20477490/instrument_cluster-1774718168996.jpg> (referer: None)
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7490/20477490/interior_front_seats-1774717723351.jpg> (referer: None)
2026-03-29 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7490/20477490/interior_dashboard-1774717771808.jpg> (referer: None)
2026-03-29 20:05:22 [motorway.uk] INFO: Found listing with ID: 1329664
2026-03-29 20:05:22 [motorway.uk] INFO: Found listing with ID: 20409002
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720409002%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [motorway.uk] INFO: Scrape type for 20409002: 1
2026-03-29 20:05:22 [motorway.uk] INFO: Found listing with ID: 18827226
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718827226%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [motorway.uk] INFO: Scrape type for 18827226: 1
2026-03-29 20:05:22 [motorway.uk] INFO: Found listing with ID: 20436077
2026-03-29 20:05:22 [motorway.uk] INFO: Found listing with ID: 16052794
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716052794%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [motorway.uk] INFO: Scrape type for 16052794: 1
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1133d0>
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7490%252F20477490%252Fexterior_front_driver-1774716031854.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_front_driver-1774716031854.jpg saved to cache
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97f8a5c9-2066-5e05-ba5e-22158de5b190
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae3f4d0>
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3267%252F19413267%252Fexterior_rear_driver-1774693457910.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3267/19413267/exterior_rear_driver-1774693457910.jpg saved to cache
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24852beb-41ab-5a6d-a2c5-1e2968a63637
2026-03-29 20:05:22 [motorway.uk] INFO: Found listing with ID: 20401398
2026-03-29 20:05:22 [motorway.uk] INFO: Found listing with ID: 20375710
2026-03-29 20:05:22 [motorway.uk] INFO: Found listing with ID: 17939747
2026-03-29 20:05:22 [motorway.uk] INFO: Found listing with ID: 20202196
2026-03-29 20:05:22 [motorway.uk] INFO: Found listing with ID: 18800703
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718800703%27 HTTP/1.1" 200 None
2026-03-29 20:05:22 [motorway.uk] INFO: Scrape type for 18800703: 1
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94aa310>
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7960%252F14497960%252Fexterior_rear_passenger-1774702535301.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_rear_passenger-1774702535301.jpg saved to cache
2026-03-29 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa113c90>
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7490%252F20477490%252Fexterior_rear_driver-1774716053969.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_rear_driver-1774716053969.jpg saved to cache
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97f8a5c9-2066-5e05-ba5e-22158de5b190
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81a5610>
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7490%252F20477490%252Fexterior_front_passenger-1774716101450.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_front_passenger-1774716101450.jpg saved to cache
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97f8a5c9-2066-5e05-ba5e-22158de5b190
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa07f9d0>
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7490%252F20477490%252Finstrument_cluster-1774718168996.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7490/20477490/instrument_cluster-1774718168996.jpg saved to cache
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97f8a5c9-2066-5e05-ba5e-22158de5b190
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81ee710>
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7490%252F20477490%252Finterior_front_seats-1774717723351.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7490/20477490/interior_front_seats-1774717723351.jpg saved to cache
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97f8a5c9-2066-5e05-ba5e-22158de5b190
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa110550>
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7490%252F20477490%252Finterior_dashboard-1774717771808.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7490/20477490/interior_dashboard-1774717771808.jpg saved to cache
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97f8a5c9-2066-5e05-ba5e-22158de5b190
2026-03-29 20:05:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97f8a5c9-2066-5e05-ba5e-22158de5b190, skipping ID generation
2026-03-29 20:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97f8a5c9-2066-5e05-ba5e-22158de5b190 with scrape type 1
2026-03-29 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97f8a5c9-2066-5e05-ba5e-22158de5b190 sending to next pipeline
2026-03-29 20:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 97f8a5c9-2066-5e05-ba5e-22158de5b190, identifier: 20477490
2026-03-29 20:05:23 [motorway.uk] INFO: Found listing with ID: 12120509
2026-03-29 20:05:23 [motorway.uk] INFO: Found listing with ID: 14548428
2026-03-29 20:05:23 [motorway.uk] INFO: Found listing with ID: 20386514
2026-03-29 20:05:23 [motorway.uk] INFO: Found listing with ID: 17979492
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717979492%27 HTTP/1.1" 200 None
2026-03-29 20:05:23 [motorway.uk] INFO: Scrape type for 17979492: 1
2026-03-29 20:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 97f8a5c9-2066-5e05-ba5e-22158de5b190 with identifier: 20477490
2026-03-29 20:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 97f8a5c9-2066-5e05-ba5e-22158de5b190 with identifier: 20477490
2026-03-29 20:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 97f8a5c9-2066-5e05-ba5e-22158de5b190 with identifier: 20477490 to the API
2026-03-29 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7490/20477490/interior_dashboard-1774717771808.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '97f8a5c9-2066-5e05-ba5e-22158de5b190',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'J111 HUR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20477490',
'listing': 'auction',
'location': 'Derbyshire Ashbourne',
'make': 'Fiat',
'model': '500X',
'odometer': 54000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1680332,
'Height': 2630,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_front_driver-1774716031854.jpg',
'Width': 3507},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1981168,
'Height': 2581,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_rear_driver-1774716053969.jpg',
'Width': 3441},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2132925,
'Height': 2819,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_front_passenger-1774716101450.jpg',
'Width': 3758},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2005735,
'Height': 2562,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7490/20477490/exterior_rear_passenger-1774716081679.jpg',
'Width': 3416},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3364569,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7490/20477490/interior_front_seats-1774717723351.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3251324,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7490/20477490/interior_rear_seats-1774718187892.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3877293,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7490/20477490/interior_dashboard-1774717771808.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2827710,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7490/20477490/instrument_cluster-1774718168996.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3974431,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7490/20477490/interior_boot-1774717778073.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97f8a5c9-2066-5e05-ba5e-22158de5b190/97f8a5c9-2066-5e05-ba5e-22158de5b190_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 773439,
'Height': 2599,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7490/20477490/docs_service_history-1774718360182.jpg?ixlib=js-3.8.0&auto=format&s=6310dccb418f44d2c8a6debd633d0ec9',
'Width': 3757}],
'price': 5084,
'price_includes_vat': False,
'registration_date': '2017-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Fiat 500X POP Star',
'transmission': 'manual',
'trim': 'POP Star',
'vin': 'ZFA3340000P547376',
'year': 2017}
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720477490%27 HTTP/1.1" 200 None
2026-03-29 20:05:24 [motorway.uk] INFO: Saving data for 20477490: {'created_time': 1774814724.1837, 'last_price_update_time': 1774814724.183712, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20477490') HTTP/1.1" 204 0
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 20435734
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 19226483
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719226483%27 HTTP/1.1" 200 None
2026-03-29 20:05:24 [motorway.uk] INFO: Scrape type for 19226483: 1
2026-03-29 20:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 20265624
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 7585646
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 19995676
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 16512497
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716512497%27 HTTP/1.1" 200 None
2026-03-29 20:05:24 [motorway.uk] INFO: Scrape type for 16512497: 1
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 20498788
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 6438177
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 20309766
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 20454787
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 20456993
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720456993%27 HTTP/1.1" 200 None
2026-03-29 20:05:24 [motorway.uk] INFO: Scrape type for 20456993: 1
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 20486739
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486739%27 HTTP/1.1" 200 None
2026-03-29 20:05:24 [motorway.uk] INFO: Scrape type for 20486739: 1
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 20130808
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 20423862
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 20283454
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 10973365
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 20392215
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720392215%27 HTTP/1.1" 200 None
2026-03-29 20:05:24 [motorway.uk] INFO: Scrape type for 20392215: 1
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 20496032
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 19667593
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 13151440
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713151440%27 HTTP/1.1" 200 None
2026-03-29 20:05:24 [motorway.uk] INFO: Scrape type for 13151440: 1
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 19970268
2026-03-29 20:05:24 [motorway.uk] INFO: Found listing with ID: 20240702
2026-03-29 20:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_front_passenger-1774702562916.jpg> (referer: None)
2026-03-29 20:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_rear_driver-1774702519085.jpg> (referer: None)
2026-03-29 20:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_front_driver-1774702495181.jpg> (referer: None)
2026-03-29 20:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3267/19413267/exterior_front_driver-1774693444181.jpg> (referer: None)
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa120750>
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7960%252F14497960%252Fexterior_front_passenger-1774702562916.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_front_passenger-1774702562916.jpg saved to cache
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadeef90>
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7960%252F14497960%252Fexterior_rear_driver-1774702519085.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_rear_driver-1774702519085.jpg saved to cache
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0c0c90>
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7960%252F14497960%252Fexterior_front_driver-1774702495181.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_front_driver-1774702495181.jpg saved to cache
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa
2026-03-29 20:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73fa9589-d96d-574c-b0bc-8f01bf96c6aa, skipping ID generation
2026-03-29 20:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa with scrape type 1
2026-03-29 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73fa9589-d96d-574c-b0bc-8f01bf96c6aa sending to next pipeline
2026-03-29 20:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 73fa9589-d96d-574c-b0bc-8f01bf96c6aa, identifier: 14497960
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8fafc90>
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3267%252F19413267%252Fexterior_front_driver-1774693444181.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3267/19413267/exterior_front_driver-1774693444181.jpg saved to cache
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24852beb-41ab-5a6d-a2c5-1e2968a63637
2026-03-29 20:05:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24852beb-41ab-5a6d-a2c5-1e2968a63637, skipping ID generation
2026-03-29 20:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24852beb-41ab-5a6d-a2c5-1e2968a63637 with scrape type 1
2026-03-29 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24852beb-41ab-5a6d-a2c5-1e2968a63637 sending to next pipeline
2026-03-29 20:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 24852beb-41ab-5a6d-a2c5-1e2968a63637, identifier: 19413267
2026-03-29 20:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 73fa9589-d96d-574c-b0bc-8f01bf96c6aa with identifier: 14497960
2026-03-29 20:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 73fa9589-d96d-574c-b0bc-8f01bf96c6aa with identifier: 14497960
2026-03-29 20:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 73fa9589-d96d-574c-b0bc-8f01bf96c6aa with identifier: 14497960 to the API
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_front_driver-1774702495181.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '73fa9589-d96d-574c-b0bc-8f01bf96c6aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LK19 JVZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14497960',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Mercedes',
'model': 'GLC',
'odometer': 19563,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2497384,
'Height': 3011,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_front_driver-1774702495181.jpg',
'Width': 4015},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2140114,
'Height': 2886,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_rear_driver-1774702519085.jpg',
'Width': 3848},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1891306,
'Height': 2901,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_front_passenger-1774702562916.jpg',
'Width': 3868},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1946411,
'Height': 2705,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7960/14497960/exterior_rear_passenger-1774702535301.jpg',
'Width': 3607},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4324042,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7960/14497960/interior_front_seats-1774702968687.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3203592,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7960/14497960/interior_rear_seats-1774702980620.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2404219,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7960/14497960/interior_dashboard-1774704182417.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3283095,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7960/14497960/instrument_cluster-1774703063136.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3232237,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7960/14497960/interior_boot-1774703022160.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73fa9589-d96d-574c-b0bc-8f01bf96c6aa/73fa9589-d96d-574c-b0bc-8f01bf96c6aa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8654174,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7960/14497960/docs_service_history-1774703585282.jpg?ixlib=js-3.8.0&auto=format&s=bd341aa3adab89f196dd5558ad5e6c02',
'Width': 4032}],
'price': 23725,
'price_includes_vat': False,
'registration_date': '2019-03-21',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLC 250 AMG Night Edition 4M A',
'transmission': 'automatic',
'trim': '250 AMG Night Edition 4M A',
'vin': 'WDC2539462V174336',
'year': 2019}
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714497960%27 HTTP/1.1" 200 None
2026-03-29 20:05:25 [motorway.uk] INFO: Saving data for 14497960: {'created_time': 1774814725.791746, 'last_price_update_time': 1774814725.791758, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14497960') HTTP/1.1" 204 0
2026-03-29 20:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 24852beb-41ab-5a6d-a2c5-1e2968a63637 with identifier: 19413267
2026-03-29 20:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 24852beb-41ab-5a6d-a2c5-1e2968a63637 with identifier: 19413267
2026-03-29 20:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 24852beb-41ab-5a6d-a2c5-1e2968a63637 with identifier: 19413267 to the API
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3267/19413267/exterior_front_driver-1774693444181.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '24852beb-41ab-5a6d-a2c5-1e2968a63637',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YH20 EXA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19413267',
'listing': 'auction',
'location': 'Cheshire East Knutsford',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 54132,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2274201,
'Height': 2756,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3267/19413267/exterior_front_driver-1774693444181.jpg',
'Width': 3675},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1367754,
'Height': 2201,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3267/19413267/exterior_rear_driver-1774693457910.jpg',
'Width': 2935},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2897280,
'Height': 2813,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3267/19413267/exterior_front_passenger-1774706481110.jpg',
'Width': 3751},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1297748,
'Height': 2097,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3267/19413267/exterior_rear_passenger-1774693469302.jpg',
'Width': 2796},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3920026,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3267/19413267/interior_front_seats-1774703982705.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3708708,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3267/19413267/interior_rear_seats-1774703996462.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1143438,
'Height': 1914,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3267/19413267/interior_dashboard-1774706520395.jpg',
'Width': 2553},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2060658,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3267/19413267/instrument_cluster-1774706508334.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4500113,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3267/19413267/interior_boot-1774704043188.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24852beb-41ab-5a6d-a2c5-1e2968a63637/24852beb-41ab-5a6d-a2c5-1e2968a63637_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348868,
'Height': 2556,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3267/19413267/docs_service_history-1774705294010.jpg?ixlib=js-3.8.0&auto=format&s=4fa00ecb610879132ce5d782fb6f7c03',
'Width': 1179}],
'price': 13842,
'price_includes_vat': False,
'registration_date': '2020-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 180 AMG Line Executive Auto',
'transmission': 'automatic',
'trim': 'A 180 AMG Line Executive Auto',
'vin': 'W1K1770842N165368',
'year': 2020}
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719413267%27 HTTP/1.1" 200 None
2026-03-29 20:05:26 [motorway.uk] INFO: Saving data for 19413267: {'created_time': 1774814726.29525, 'last_price_update_time': 1774814726.295262, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19413267') HTTP/1.1" 204 0
2026-03-29 20:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6062/20406062/interior_boot-1774694883648.jpg> (referer: None)
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f927fc50>
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dad55eb-b3e1-54f8-9435-5bc815d75381/7dad55eb-b3e1-54f8-9435-5bc815d75381_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6062%252F20406062%252Finterior_boot-1774694883648.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6062/20406062/interior_boot-1774694883648.jpg saved to cache
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7dad55eb-b3e1-54f8-9435-5bc815d75381
2026-03-29 20:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19705843.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12548446.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490982.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20414917.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fcacaea-9dc5-5b86-928d-c0ffa18ccc06 with identifier: 19705843
2026-03-29 20:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fcacaea-9dc5-5b86-928d-c0ffa18ccc06 with scrape type 1
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0fcacaea-9dc5-5b86-928d-c0ffa18ccc06
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5843%252F19705843%252Fexterior_front_driver-1774718563701.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5843/19705843/exterior_front_driver-1774718563701.jpg not downloaded yet
2026-03-29 20:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39c01f8a-c2ed-5260-911a-c9db326d11e4 with identifier: 12548446
2026-03-29 20:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c01f8a-c2ed-5260-911a-c9db326d11e4 with scrape type 1
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39c01f8a-c2ed-5260-911a-c9db326d11e4
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8446%252F12548446%252Fexterior_front_driver-1774784393926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8446/12548446/exterior_front_driver-1774784393926.jpg not downloaded yet
2026-03-29 20:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6232470a-dd24-5a3d-b7bf-d58cb9976b5a with identifier: 20490982
2026-03-29 20:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6232470a-dd24-5a3d-b7bf-d58cb9976b5a with scrape type 1
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6232470a-dd24-5a3d-b7bf-d58cb9976b5a
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0982%252F20490982%252Fexterior_front_driver-1774711840972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0982/20490982/exterior_front_driver-1774711840972.jpg not downloaded yet
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5843%252F19705843%252Fexterior_rear_driver-1774718551030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5843/19705843/exterior_rear_driver-1774718551030.jpg not downloaded yet
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8446%252F12548446%252Fexterior_rear_driver-1774784426173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8446/12548446/exterior_rear_driver-1774784426173.jpg not downloaded yet
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0982%252F20490982%252Fexterior_rear_driver-1774711942320.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0982/20490982/exterior_rear_driver-1774711942320.jpg not downloaded yet
2026-03-29 20:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20453033.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fab2e2f6-cecb-5877-be8a-af3870fb2860 with identifier: 20414917
2026-03-29 20:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fab2e2f6-cecb-5877-be8a-af3870fb2860 with scrape type 1
2026-03-29 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fab2e2f6-cecb-5877-be8a-af3870fb2860
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20414917%252Fexterior_front_driver-1774699103907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20414917/exterior_front_driver-1774699103907.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5843%252F19705843%252Fexterior_front_passenger-1774718494758.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5843/19705843/exterior_front_passenger-1774718494758.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8446%252F12548446%252Fexterior_front_passenger-1774784403486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8446/12548446/exterior_front_passenger-1774784403486.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0982%252F20490982%252Fexterior_front_passenger-1774711974487.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0982/20490982/exterior_front_passenger-1774711974487.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20414917%252Fexterior_rear_driver-1774699121654.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20414917/exterior_rear_driver-1774699121654.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5843%252F19705843%252Fexterior_rear_passenger-1774718474105.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5843/19705843/exterior_rear_passenger-1774718474105.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8446%252F12548446%252Fexterior_rear_passenger-1774784416488.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8446/12548446/exterior_rear_passenger-1774784416488.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0982%252F20490982%252Fexterior_rear_passenger-1774711956514.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0982/20490982/exterior_rear_passenger-1774711956514.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20414917%252Fexterior_front_passenger-1774699152958.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20414917/exterior_front_passenger-1774699152958.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5843%252F19705843%252Finterior_front_seats-1774708279451.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5843/19705843/interior_front_seats-1774708279451.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8446%252F12548446%252Finterior_front_seats-1774784466130.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8446/12548446/interior_front_seats-1774784466130.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0982%252F20490982%252Finterior_front_seats-1774712901290.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0982/20490982/interior_front_seats-1774712901290.jpg not downloaded yet
2026-03-29 20:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d71d7f1-831a-5afd-b38f-56418b53a763 with identifier: 20453033
2026-03-29 20:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d71d7f1-831a-5afd-b38f-56418b53a763 with scrape type 1
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d71d7f1-831a-5afd-b38f-56418b53a763
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3033%252F20453033%252Fexterior_front_driver-1774715506399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3033/20453033/exterior_front_driver-1774715506399.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20414917%252Fexterior_rear_passenger-1774699135140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20414917/exterior_rear_passenger-1774699135140.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5843%252F19705843%252Finterior_rear_seats-1774708193878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5843/19705843/interior_rear_seats-1774708193878.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8446%252F12548446%252Finterior_rear_seats-1774784608428.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8446/12548446/interior_rear_seats-1774784608428.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0982%252F20490982%252Finterior_rear_seats-1774713616720.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0982/20490982/interior_rear_seats-1774713616720.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3033%252F20453033%252Fexterior_rear_driver-1774715471384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3033/20453033/exterior_rear_driver-1774715471384.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4917%252F20414917%252Finterior_front_seats-1774699497174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4917/20414917/interior_front_seats-1774699497174.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5843%252F19705843%252Finterior_dashboard-1774713551894.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5843/19705843/interior_dashboard-1774713551894.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8446%252F12548446%252F12548446-interior_dashboard-modified-1774786369401.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8446/12548446/12548446-interior_dashboard-modified-1774786369401.jpeg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0982%252F20490982%252Finterior_dashboard-1774712966298.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0982/20490982/interior_dashboard-1774712966298.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3033%252F20453033%252Fexterior_front_passenger-1774715473368.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3033/20453033/exterior_front_passenger-1774715473368.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4917%252F20414917%252Finterior_rear_seats-1774699515687.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4917/20414917/interior_rear_seats-1774699515687.jpg not downloaded yet
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/7025214.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5843%252F19705843%252Finterior_boot-1774718432219.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5843/19705843/interior_boot-1774718432219.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8446%252F12548446%252Finterior_boot-1774784580804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8446/12548446/interior_boot-1774784580804.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0982%252F20490982%252Finstrument_cluster-1774713006770.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0982/20490982/instrument_cluster-1774713006770.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3033%252F20453033%252Fexterior_rear_passenger-1774773403249.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3033/20453033/exterior_rear_passenger-1774773403249.jpg not downloaded yet
2026-03-29 20:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20414917%252Finterior_dashboard-1774699548251.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20414917/interior_dashboard-1774699548251.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5843%252F19705843%252Fwheels_front_driver-1774707970874.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5843/19705843/wheels_front_driver-1774707970874.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8446%252F12548446%252Fdocs_service_history-1774784916376.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D745352b99e2909ae004ec7624ee3dcf1%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8446/12548446/docs_service_history-1774784916376.jpg?ixlib=js-3.8.0&auto=format&s=745352b99e2909ae004ec7624ee3dcf1 not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0982%252F20490982%252Finterior_boot-1774712974926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0982/20490982/interior_boot-1774712974926.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3033%252F20453033%252Finterior_front_seats-1774716500514.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3033/20453033/interior_front_seats-1774716500514.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4917%252F20414917%252Finstrument_cluster-1774699599652.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4917/20414917/instrument_cluster-1774699599652.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5843%252F19705843%252Fwheels_rear_driver-1774707979585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5843/19705843/wheels_rear_driver-1774707979585.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8446%252F12548446%252Fdocs_service_history-1774784968925.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daf91d147896abc9e189430dffad92b92%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8446/12548446/docs_service_history-1774784968925.jpg?ixlib=js-3.8.0&auto=format&s=af91d147896abc9e189430dffad92b92 not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0982%252F20490982%252Fdocs_service_history-1774714700458.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df962e10a9815ba59a93d7aec9b515ded%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0982/20490982/docs_service_history-1774714700458.jpg?ixlib=js-3.8.0&auto=format&s=f962e10a9815ba59a93d7aec9b515ded not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3033%252F20453033%252Finterior_rear_seats-1774716502118.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3033/20453033/interior_rear_seats-1774716502118.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4917%252F20414917%252Finterior_boot-1774699564805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4917/20414917/interior_boot-1774699564805.jpg not downloaded yet
2026-03-29 20:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57a2b2af-df35-5469-980e-46ad3ef7b041 with identifier: 7025214
2026-03-29 20:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57a2b2af-df35-5469-980e-46ad3ef7b041 with scrape type 1
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57a2b2af-df35-5469-980e-46ad3ef7b041
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5214%252F7025214%252Fexterior_front_driver-1774709775671.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5214/7025214/exterior_front_driver-1774709775671.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3033%252F20453033%252Finterior_dashboard-1774716521941.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3033/20453033/interior_dashboard-1774716521941.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4917%252F20414917%252Fdocs_service_history-1774699772567.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D58ea786e8af88889230e39ed6ff39f57%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4917/20414917/docs_service_history-1774699772567.jpg?ixlib=js-3.8.0&auto=format&s=58ea786e8af88889230e39ed6ff39f57 not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5214%252F7025214%252Fexterior_rear_driver-1774709813753.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5214/7025214/exterior_rear_driver-1774709813753.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3033%252F20453033%252Finstrument_cluster-1774716454741.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3033/20453033/instrument_cluster-1774716454741.jpg not downloaded yet
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5214%252F7025214%252Fexterior_front_passenger-1774709842372.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5214/7025214/exterior_front_passenger-1774709842372.jpg not downloaded yet
2026-03-29 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=900&page=25&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3033%252F20453033%252Finterior_boot-1774773726749.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3033/20453033/interior_boot-1774773726749.jpg not downloaded yet
2026-03-29 20:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5214%252F7025214%252Fexterior_rear_passenger-1774709829439.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5214/7025214/exterior_rear_passenger-1774709829439.jpg not downloaded yet
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3033%252F20453033%252Fdocs_service_history-1774717212584.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8cbe7b129a944b2f51ddf2f5e54bc81f%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3033/20453033/docs_service_history-1774717212584.jpg?ixlib=js-3.8.0&auto=format&s=8cbe7b129a944b2f51ddf2f5e54bc81f not downloaded yet
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5214%252F7025214%252Finterior_front_seats-1774710804696.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5214/7025214/interior_front_seats-1774710804696.jpg not downloaded yet
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5214%252F7025214%252Finterior_rear_seats-1774710610462.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5214/7025214/interior_rear_seats-1774710610462.jpg not downloaded yet
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 19778480
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20022290
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 13467302
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713467302%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [motorway.uk] INFO: Scrape type for 13467302: 1
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5214%252F7025214%252Finterior_dashboard-1774713602088.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5214/7025214/interior_dashboard-1774713602088.jpg not downloaded yet
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 19297070
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20020700
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 11255946
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711255946%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [motorway.uk] INFO: Scrape type for 11255946: 1
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5214%252F7025214%252Finstrument_cluster-1774713613976.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5214/7025214/instrument_cluster-1774713613976.jpg not downloaded yet
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 19632065
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719632065%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [motorway.uk] INFO: Scrape type for 19632065: 1
2026-03-29 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17979492.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5214%252F7025214%252Finterior_boot-1774710715085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5214/7025214/interior_boot-1774710715085.jpg not downloaded yet
2026-03-29 20:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 17285204
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 16536787
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 1653589
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20323347
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20483472
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 17018395
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717018395%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [motorway.uk] INFO: Scrape type for 17018395: 1
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5214%252F7025214%252Fdamage_scratches-1774709962970.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5214/7025214/damage_scratches-1774709962970.jpg not downloaded yet
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 4109910
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 19834070
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20450033
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20441111
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 15806242
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715806242%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [motorway.uk] INFO: Scrape type for 15806242: 2
2026-03-29 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0982/20490982/exterior_front_driver-1774711840972.jpg> (referer: None)
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20168276
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 13753529
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 15549773
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 15733189
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 14461251
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20474635
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720474635%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [motorway.uk] INFO: Scrape type for 20474635: 1
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 19400973
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20423010
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20470703
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 10736639
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20469304
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469304%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [motorway.uk] INFO: Scrape type for 20469304: 1
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 19886474
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 18670827
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 19915940
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719915940%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [motorway.uk] INFO: Scrape type for 19915940: 1
2026-03-29 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3033/20453033/exterior_front_passenger-1774715473368.jpg> (referer: None)
2026-03-29 20:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 550964a4-1a5f-56ed-a71a-4a9affbc230e with identifier: 17979492
2026-03-29 20:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 550964a4-1a5f-56ed-a71a-4a9affbc230e with scrape type 1
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 550964a4-1a5f-56ed-a71a-4a9affbc230e
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9492%252F17979492%252Fexterior_front_driver-1774715283064.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_front_driver-1774715283064.jpg not downloaded yet
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 14572470
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20268898
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720268898%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [motorway.uk] INFO: Scrape type for 20268898: 1
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9492%252F17979492%252Fexterior_rear_driver-1774715293703.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_rear_driver-1774715293703.jpg not downloaded yet
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20241032
2026-03-29 20:05:28 [motorway.uk] INFO: Found listing with ID: 20251701
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9492%252F17979492%252Fexterior_front_passenger-1774715332495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_front_passenger-1774715332495.jpg not downloaded yet
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab9c550>
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6232470a-dd24-5a3d-b7bf-d58cb9976b5a/6232470a-dd24-5a3d-b7bf-d58cb9976b5a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0982%252F20490982%252Fexterior_front_driver-1774711840972.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0982/20490982/exterior_front_driver-1774711840972.jpg saved to cache
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6232470a-dd24-5a3d-b7bf-d58cb9976b5a
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9492%252F17979492%252Fexterior_rear_passenger-1774715304124.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_rear_passenger-1774715304124.jpg not downloaded yet
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9492%252F17979492%252Finterior_front_seats-1774715535684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9492/17979492/interior_front_seats-1774715535684.jpg not downloaded yet
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8813590>
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d71d7f1-831a-5afd-b38f-56418b53a763/5d71d7f1-831a-5afd-b38f-56418b53a763_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3033%252F20453033%252Fexterior_front_passenger-1774715473368.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3033/20453033/exterior_front_passenger-1774715473368.jpg saved to cache
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d71d7f1-831a-5afd-b38f-56418b53a763
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9492%252F17979492%252Finterior_rear_seats-1774715549324.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9492/17979492/interior_rear_seats-1774715549324.jpg not downloaded yet
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9492%252F17979492%252Finterior_dashboard-1774783196909.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9492/17979492/interior_dashboard-1774783196909.jpg not downloaded yet
2026-03-29 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5214/7025214/instrument_cluster-1774713613976.jpg> (referer: None)
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9492%252F17979492%252Finstrument_cluster-1774715765924.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9492/17979492/instrument_cluster-1774715765924.jpg not downloaded yet
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9492%252F17979492%252Finterior_boot-1774715616894.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9492/17979492/interior_boot-1774715616894.jpg not downloaded yet
2026-03-29 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1418/10521418/interior_boot-1774702593978.jpg> (referer: None)
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9492%252F17979492%252Fwheels_front_driver-1774715357731.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9492/17979492/wheels_front_driver-1774715357731.jpg not downloaded yet
2026-03-29 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16052794.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5214/7025214/exterior_front_passenger-1774709842372.jpg> (referer: None)
2026-03-29 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7838/19797838/damage_scratches-1771670774097.jpg> (referer: None)
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ca6e90>
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a2b2af-df35-5469-980e-46ad3ef7b041/57a2b2af-df35-5469-980e-46ad3ef7b041_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5214%252F7025214%252Finstrument_cluster-1774713613976.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5214/7025214/instrument_cluster-1774713613976.jpg saved to cache
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57a2b2af-df35-5469-980e-46ad3ef7b041
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88f6190>
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dcbb1842-9020-5357-b439-bd54fe97f8cb/dcbb1842-9020-5357-b439-bd54fe97f8cb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1418%252F10521418%252Finterior_boot-1774702593978.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1418/10521418/interior_boot-1774702593978.jpg saved to cache
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dcbb1842-9020-5357-b439-bd54fe97f8cb
2026-03-29 20:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73a1d099-e0b0-5b4d-b781-62b4d3580180 with identifier: 16052794
2026-03-29 20:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73a1d099-e0b0-5b4d-b781-62b4d3580180 with scrape type 1
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73a1d099-e0b0-5b4d-b781-62b4d3580180
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2794%252F16052794%252Fexterior_front_driver-1774624717797.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_front_driver-1774624717797.jpeg not downloaded yet
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfd7a90>
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a2b2af-df35-5469-980e-46ad3ef7b041/57a2b2af-df35-5469-980e-46ad3ef7b041_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5214%252F7025214%252Fexterior_front_passenger-1774709842372.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5214/7025214/exterior_front_passenger-1774709842372.jpg saved to cache
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57a2b2af-df35-5469-980e-46ad3ef7b041
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S931B\x00'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S931BXXS7BYLR\x00'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:02:21 10:45:55\x00'
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad4de90>
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94101075-92fa-524c-96bc-ebcbf1ec1a28/94101075-92fa-524c-96bc-ebcbf1ec1a28_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7838%252F19797838%252Fdamage_scratches-1771670774097.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7838/19797838/damage_scratches-1771670774097.jpg saved to cache
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94101075-92fa-524c-96bc-ebcbf1ec1a28
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2794%252F16052794%252Fexterior_rear_driver-1774625186787.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_rear_driver-1774625186787.jpeg not downloaded yet
2026-03-29 20:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18827226.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2794%252F16052794%252Fexterior_front_passenger-1774624702303.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_front_passenger-1774624702303.jpeg not downloaded yet
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2794%252F16052794%252Fexterior_rear_passenger-1774624751410.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_rear_passenger-1774624751410.jpeg not downloaded yet
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2794%252F16052794%252Finterior_front_seats-1774625130064.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2794/16052794/interior_front_seats-1774625130064.jpeg not downloaded yet
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2794%252F16052794%252Finterior_rear_seats-1774625134350.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2794/16052794/interior_rear_seats-1774625134350.jpeg not downloaded yet
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2794%252F16052794%252Finterior_dashboard-1774625143701.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2794/16052794/interior_dashboard-1774625143701.jpeg not downloaded yet
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2794%252F16052794%252Finstrument_cluster-1774625122870.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2794/16052794/instrument_cluster-1774625122870.jpeg not downloaded yet
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2794%252F16052794%252Finterior_boot-1774706440176.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2794/16052794/interior_boot-1774706440176.jpeg not downloaded yet
2026-03-29 20:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 362824db-37b0-50bb-9362-83f68d4145af with identifier: 18827226
2026-03-29 20:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 362824db-37b0-50bb-9362-83f68d4145af with scrape type 1
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 362824db-37b0-50bb-9362-83f68d4145af
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7226%252F18827226%252Fexterior_front_driver-1769263232397.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_front_driver-1769263232397.jpg not downloaded yet
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2794%252F16052794%252Fdamage_scratches-1774706556394.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2794/16052794/damage_scratches-1774706556394.jpeg not downloaded yet
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7226%252F18827226%252Fexterior_rear_driver-1769263246114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_rear_driver-1769263246114.jpg not downloaded yet
2026-03-29 20:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18800703.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7226%252F18827226%252Fexterior_front_passenger-1769263273447.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_front_passenger-1769263273447.jpg not downloaded yet
2026-03-29 20:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7226%252F18827226%252Fexterior_rear_passenger-1769263255544.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_rear_passenger-1769263255544.jpg not downloaded yet
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7226%252F18827226%252Finterior_front_seats-1769263688859.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7226/18827226/interior_front_seats-1769263688859.jpg not downloaded yet
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7226%252F18827226%252Finterior_rear_seats-1769263709305.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7226/18827226/interior_rear_seats-1769263709305.jpg not downloaded yet
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7226%252F18827226%252Finterior_dashboard-1769265595971.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7226/18827226/interior_dashboard-1769265595971.jpg not downloaded yet
2026-03-29 20:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 387fc7e4-a776-53e8-8ac4-5facc8406fda with identifier: 18800703
2026-03-29 20:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 387fc7e4-a776-53e8-8ac4-5facc8406fda with scrape type 1
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 387fc7e4-a776-53e8-8ac4-5facc8406fda
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F18800703%252Fexterior_front_driver-1773415924987.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_front_driver-1773415924987.jpg not downloaded yet
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7226%252F18827226%252Finstrument_cluster-1769263652875.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7226/18827226/instrument_cluster-1769263652875.jpg not downloaded yet
2026-03-29 20:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_front_driver-1774624717797.jpeg> (referer: None)
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F18800703%252Fexterior_rear_driver-1773415940369.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_rear_driver-1773415940369.jpg not downloaded yet
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7226%252F18827226%252Finterior_boot-1769263721147.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7226/18827226/interior_boot-1769263721147.jpg not downloaded yet
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F18800703%252Fexterior_front_passenger-1773415925363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_front_passenger-1773415925363.jpg not downloaded yet
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F7226%252F18827226%252Fdocs_service_history-1769264088295.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0914f654b8330bfc85d261a9dfd4dbb2%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/7226/18827226/docs_service_history-1769264088295.jpg?ixlib=js-3.8.0&auto=format&s=0914f654b8330bfc85d261a9dfd4dbb2 not downloaded yet
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F18800703%252Fexterior_rear_passenger-1773415937658.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_rear_passenger-1773415937658.jpg not downloaded yet
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_rear_driver-1774625186787.jpeg> (referer: None)
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0703%252F18800703%252Finterior_front_seats-1774702008670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0703/18800703/interior_front_seats-1774702008670.jpg not downloaded yet
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8aa08d0>
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2794%252F16052794%252Fexterior_front_driver-1774624717797.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_front_driver-1774624717797.jpeg saved to cache
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73a1d099-e0b0-5b4d-b781-62b4d3580180
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0703%252F18800703%252Finterior_rear_seats-1774702022405.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0703/18800703/interior_rear_seats-1774702022405.jpg not downloaded yet
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9492/17979492/interior_dashboard-1774783196909.jpg> (referer: None)
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F18800703%252Finterior_dashboard-1774702065084.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/18800703/interior_dashboard-1774702065084.jpg not downloaded yet
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8aa0350>
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2794%252F16052794%252Fexterior_rear_driver-1774625186787.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_rear_driver-1774625186787.jpeg saved to cache
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73a1d099-e0b0-5b4d-b781-62b4d3580180
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0703%252F18800703%252Finterior_boot-1773415954410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0703/18800703/interior_boot-1773415954410.jpg not downloaded yet
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_front_driver-1773415924987.jpg> (referer: None)
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0703%252F18800703%252F18800703-docs_service_history-modified-1774703930174.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7c35b13f2f3fd83f9bca2f2701b4b864%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0703/18800703/18800703-docs_service_history-modified-1774703930174.jpeg?ixlib=js-3.8.0&auto=format&s=7c35b13f2f3fd83f9bca2f2701b4b864 not downloaded yet
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0703%252F18800703%252F18800703-docs_service_history-modified-1774703790416.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da025825ea6935eb8d8474f9902480c13%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0703/18800703/18800703-docs_service_history-modified-1774703790416.jpeg?ixlib=js-3.8.0&auto=format&s=a025825ea6935eb8d8474f9902480c13 not downloaded yet
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20409002.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82289d0>
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9492%252F17979492%252Finterior_dashboard-1774783196909.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9492/17979492/interior_dashboard-1774783196909.jpg saved to cache
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 550964a4-1a5f-56ed-a71a-4a9affbc230e
2026-03-29 20:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_rear_driver-1769263246114.jpg> (referer: None)
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13151440.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_rear_passenger-1773415937658.jpg> (referer: None)
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85eb490>
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F18800703%252Fexterior_front_driver-1773415924987.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_front_driver-1773415924987.jpg saved to cache
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 387fc7e4-a776-53e8-8ac4-5facc8406fda
2026-03-29 20:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb75a336-7daf-566f-9778-77d7f8ba13fa with identifier: 20409002
2026-03-29 20:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb75a336-7daf-566f-9778-77d7f8ba13fa with scrape type 1
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb75a336-7daf-566f-9778-77d7f8ba13fa
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9002%252F20409002%252Fexterior_front_driver-1774282140077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_front_driver-1774282140077.jpg not downloaded yet
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9002%252F20409002%252Fexterior_rear_driver-1774282133811.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_rear_driver-1774282133811.jpg not downloaded yet
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20456993.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20392215.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad8de50>
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7226%252F18827226%252Fexterior_rear_driver-1769263246114.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_rear_driver-1769263246114.jpg saved to cache
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 362824db-37b0-50bb-9362-83f68d4145af
2026-03-29 20:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0760ac2-9f9a-54a4-9c20-7e4c22444634 with identifier: 13151440
2026-03-29 20:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0760ac2-9f9a-54a4-9c20-7e4c22444634 with scrape type 1
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0760ac2-9f9a-54a4-9c20-7e4c22444634
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1440%252F13151440%252Fexterior_front_driver-1774692682397.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_front_driver-1774692682397.jpg not downloaded yet
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f813af10>
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F18800703%252Fexterior_rear_passenger-1773415937658.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_rear_passenger-1773415937658.jpg saved to cache
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 387fc7e4-a776-53e8-8ac4-5facc8406fda
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9002%252F20409002%252Fexterior_front_passenger-1774282127073.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_front_passenger-1774282127073.jpg not downloaded yet
2026-03-29 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1440%252F13151440%252Fexterior_rear_driver-1774692711132.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_rear_driver-1774692711132.jpg not downloaded yet
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9492/17979492/wheels_front_driver-1774715357731.jpg> (referer: None)
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9002%252F20409002%252Fexterior_rear_passenger-1774282145092.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_rear_passenger-1774282145092.jpg not downloaded yet
2026-03-29 20:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d67d214e-341f-5814-b9c4-4bc458da3e27 with identifier: 20456993
2026-03-29 20:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d67d214e-341f-5814-b9c4-4bc458da3e27 with scrape type 1
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d67d214e-341f-5814-b9c4-4bc458da3e27
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6993%252F20456993%252Fexterior_front_driver-1774707346427.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_front_driver-1774707346427.jpg not downloaded yet
2026-03-29 20:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d07fefbd-80ef-5e8b-8b28-f21d337e08ca with identifier: 20392215
2026-03-29 20:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca with scrape type 1
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2215%252F20392215%252Fexterior_front_driver-1774626872346.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_front_driver-1774626872346.jpg not downloaded yet
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/0703/18800703/18800703-docs_service_history-modified-1774703790416.jpeg?ixlib=js-3.8.0&auto=format&s=a025825ea6935eb8d8474f9902480c13> (referer: None)
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1440%252F13151440%252Fexterior_front_passenger-1774692784129.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_front_passenger-1774692784129.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9002%252F20409002%252Finterior_front_seats-1774282729323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9002/20409002/interior_front_seats-1774282729323.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6993%252F20456993%252Fexterior_rear_driver-1774707365510.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_rear_driver-1774707365510.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2215%252F20392215%252Fexterior_rear_driver-1774626887276.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_rear_driver-1774626887276.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1440%252F13151440%252Fexterior_rear_passenger-1774692821603.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_rear_passenger-1774692821603.jpg not downloaded yet
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0703/18800703/interior_boot-1773415954410.jpg> (referer: None)
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9002%252F20409002%252Finterior_rear_seats-1774282711315.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9002/20409002/interior_rear_seats-1774282711315.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6993%252F20456993%252Fexterior_front_passenger-1774707394836.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_front_passenger-1774707394836.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2215%252F20392215%252Fexterior_front_passenger-1774626909912.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_front_passenger-1774626909912.jpg not downloaded yet
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94c9bd0>
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9492%252F17979492%252Fwheels_front_driver-1774715357731.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9492/17979492/wheels_front_driver-1774715357731.jpg saved to cache
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 550964a4-1a5f-56ed-a71a-4a9affbc230e
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/0703/18800703/18800703-docs_service_history-modified-1774703930174.jpeg?ixlib=js-3.8.0&auto=format&s=7c35b13f2f3fd83f9bca2f2701b4b864> (referer: None)
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1440%252F13151440%252Finterior_front_seats-1774693363943.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1440/13151440/interior_front_seats-1774693363943.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9002%252F20409002%252Finterior_dashboard-1774282832496.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9002/20409002/interior_dashboard-1774282832496.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6993%252F20456993%252Fexterior_rear_passenger-1774707380727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_rear_passenger-1774707380727.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2215%252F20392215%252Fexterior_rear_passenger-1774626899430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_rear_passenger-1774626899430.jpg not downloaded yet
2026-03-29 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486739.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9695610>
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0703%252F18800703%252F18800703-docs_service_history-modified-1774703790416.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da025825ea6935eb8d8474f9902480c13') HTTP/1.1" 204 0
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0703/18800703/18800703-docs_service_history-modified-1774703790416.jpeg?ixlib=js-3.8.0&auto=format&s=a025825ea6935eb8d8474f9902480c13 saved to cache
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 387fc7e4-a776-53e8-8ac4-5facc8406fda
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1440%252F13151440%252Finterior_rear_seats-1774693442616.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1440/13151440/interior_rear_seats-1774693442616.jpg not downloaded yet
2026-03-29 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8265790>
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0703%252F18800703%252Finterior_boot-1773415954410.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0703/18800703/interior_boot-1773415954410.jpg saved to cache
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 387fc7e4-a776-53e8-8ac4-5facc8406fda
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9002%252F20409002%252Finstrument_cluster-1774282588258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9002/20409002/instrument_cluster-1774282588258.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6993%252F20456993%252Finterior_front_seats-1774707958285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6993/20456993/interior_front_seats-1774707958285.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2215%252F20392215%252Finterior_front_seats-1774627646761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2215/20392215/interior_front_seats-1774627646761.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1440%252F13151440%252Finterior_dashboard-1774693424377.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1440/13151440/interior_dashboard-1774693424377.jpg not downloaded yet
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f91257d0>
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0703%252F18800703%252F18800703-docs_service_history-modified-1774703930174.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7c35b13f2f3fd83f9bca2f2701b4b864') HTTP/1.1" 204 0
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0703/18800703/18800703-docs_service_history-modified-1774703930174.jpeg?ixlib=js-3.8.0&auto=format&s=7c35b13f2f3fd83f9bca2f2701b4b864 saved to cache
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 387fc7e4-a776-53e8-8ac4-5facc8406fda
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9002%252F20409002%252Finterior_boot-1774282722230.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9002/20409002/interior_boot-1774282722230.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6993%252F20456993%252Finterior_rear_seats-1774708014275.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6993/20456993/interior_rear_seats-1774708014275.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2215%252F20392215%252Finterior_rear_seats-1774627675817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2215/20392215/interior_rear_seats-1774627675817.jpg not downloaded yet
2026-03-29 20:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db5b9cbd-386e-592e-a039-d240038c298b with identifier: 20486739
2026-03-29 20:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db5b9cbd-386e-592e-a039-d240038c298b with scrape type 1
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db5b9cbd-386e-592e-a039-d240038c298b
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6739%252F20486739%252Fexterior_front_driver-1774699039657.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6739/20486739/exterior_front_driver-1774699039657.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1440%252F13151440%252Finstrument_cluster-1774693371835.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1440/13151440/instrument_cluster-1774693371835.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9002%252F20409002%252Fdocs_service_history-1774621553826.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1fd27380cdada08d84a339a0d0364683%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9002/20409002/docs_service_history-1774621553826.jpg?ixlib=js-3.8.0&auto=format&s=1fd27380cdada08d84a339a0d0364683 not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6993%252F20456993%252Finterior_dashboard-1774708049316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6993/20456993/interior_dashboard-1774708049316.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2215%252F20392215%252Finterior_dashboard-1774691903459.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2215/20392215/interior_dashboard-1774691903459.jpg not downloaded yet
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6739%252F20486739%252Fexterior_rear_driver-1774700943050.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6739/20486739/exterior_rear_driver-1774700943050.jpg not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1440%252F13151440%252Finterior_boot-1774693427071.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1440/13151440/interior_boot-1774693427071.jpg not downloaded yet
2026-03-29 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9492/17979492/instrument_cluster-1774715765924.jpg> (referer: None)
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6993%252F20456993%252Finstrument_cluster-1774708049424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6993/20456993/instrument_cluster-1774708049424.jpg not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2215%252F20392215%252Finstrument_cluster-1774691891486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2215/20392215/instrument_cluster-1774691891486.jpg not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6739%252F20486739%252Fexterior_front_passenger-1774699240758.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6739/20486739/exterior_front_passenger-1774699240758.jpg not downloaded yet
2026-03-29 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19226483.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1440%252F13151440%252Fdocs_service_history-1774706925685.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D948692d05e969298226d2efd7c3b8309%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1440/13151440/docs_service_history-1774706925685.jpg?ixlib=js-3.8.0&auto=format&s=948692d05e969298226d2efd7c3b8309 not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6993%252F20456993%252Finterior_boot-1774708111857.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6993/20456993/interior_boot-1774708111857.jpg not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2215%252F20392215%252Finterior_boot-1774627765362.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2215/20392215/interior_boot-1774627765362.jpg not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6739%252F20486739%252Fexterior_rear_passenger-1774699234424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6739/20486739/exterior_rear_passenger-1774699234424.jpg not downloaded yet
2026-03-29 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_front_driver-1774282140077.jpg> (referer: None)
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6993%252F20456993%252Fdocs_service_history-1774789244890.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0ddacc8ac6ba5503d3b4db21bf0cdeed%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6993/20456993/docs_service_history-1774789244890.jpg?ixlib=js-3.8.0&auto=format&s=0ddacc8ac6ba5503d3b4db21bf0cdeed not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2215%252F20392215%252Fdocs_service_history-1774627951547.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0154724d235483cdc00fec1c3c9b7d51%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2215/20392215/docs_service_history-1774627951547.jpg?ixlib=js-3.8.0&auto=format&s=0154724d235483cdc00fec1c3c9b7d51 not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6739%252F20486739%252Finterior_front_seats-1774699462872.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6739/20486739/interior_front_seats-1774699462872.jpg not downloaded yet
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f911c0d0>
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9492%252F17979492%252Finstrument_cluster-1774715765924.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9492/17979492/instrument_cluster-1774715765924.jpg saved to cache
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 550964a4-1a5f-56ed-a71a-4a9affbc230e
2026-03-29 20:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b39d73fd-bd57-5a91-a13f-00127c497574 with identifier: 19226483
2026-03-29 20:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b39d73fd-bd57-5a91-a13f-00127c497574 with scrape type 1
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b39d73fd-bd57-5a91-a13f-00127c497574
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6483%252F19226483%252Fexterior_front_driver-1774714734762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_front_driver-1774714734762.jpg not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6739%252F20486739%252Finterior_rear_seats-1774699470661.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6739/20486739/interior_rear_seats-1774699470661.jpg not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6483%252F19226483%252Fexterior_rear_driver-1774714766370.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_rear_driver-1774714766370.jpg not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6739%252F20486739%252Finterior_dashboard-1774699670161.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6739/20486739/interior_dashboard-1774699670161.jpg not downloaded yet
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf33e50>
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9002%252F20409002%252Fexterior_front_driver-1774282140077.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_front_driver-1774282140077.jpg saved to cache
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb75a336-7daf-566f-9778-77d7f8ba13fa
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6483%252F19226483%252Fexterior_front_passenger-1774714744887.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_front_passenger-1774714744887.jpg not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6739%252F20486739%252Finterior_boot-1774699642949.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6739/20486739/interior_boot-1774699642949.jpg not downloaded yet
2026-03-29 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_rear_passenger-1774692821603.jpg> (referer: None)
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6483%252F19226483%252Fexterior_rear_passenger-1774714756586.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_rear_passenger-1774714756586.jpg not downloaded yet
2026-03-29 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9492/17979492/interior_boot-1774715616894.jpg> (referer: None)
2026-03-29 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_rear_driver-1774282133811.jpg> (referer: None)
2026-03-29 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_rear_driver-1774692711132.jpg> (referer: None)
2026-03-29 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_front_passenger-1774282127073.jpg> (referer: None)
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6739%252F20486739%252Fdocs_service_history-1774699988143.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4e5f9c0380c3c7bb1d0b7a12c2ec7336%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6739/20486739/docs_service_history-1774699988143.jpg?ixlib=js-3.8.0&auto=format&s=4e5f9c0380c3c7bb1d0b7a12c2ec7336 not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6483%252F19226483%252Finterior_front_seats-1774773551668.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6483/19226483/interior_front_seats-1774773551668.jpg not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6739%252F20486739%252Fdocs_service_history-1774700141857.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De2d299e30fee49bc4be002029cc7765a%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6739/20486739/docs_service_history-1774700141857.jpg?ixlib=js-3.8.0&auto=format&s=e2d299e30fee49bc4be002029cc7765a not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6483%252F19226483%252Finterior_rear_seats-1774773564927.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6483/19226483/interior_rear_seats-1774773564927.jpg not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6483%252F19226483%252F19226483-interior_dashboard-modified-1774774397626.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6483/19226483/19226483-interior_dashboard-modified-1774774397626.jpeg not downloaded yet
2026-03-29 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0703/18800703/interior_rear_seats-1774702022405.jpg> (referer: None)
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6483%252F19226483%252Finstrument_cluster-1774773662555.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6483/19226483/instrument_cluster-1774773662555.jpg not downloaded yet
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6483%252F19226483%252Finterior_boot-1774773598651.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6483/19226483/interior_boot-1774773598651.jpg not downloaded yet
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa02d910>
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1440%252F13151440%252Fexterior_rear_passenger-1774692821603.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_rear_passenger-1774692821603.jpg saved to cache
2026-03-29 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0760ac2-9f9a-54a4-9c20-7e4c22444634
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8987550>
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9492%252F17979492%252Finterior_boot-1774715616894.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9492/17979492/interior_boot-1774715616894.jpg saved to cache
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 550964a4-1a5f-56ed-a71a-4a9affbc230e
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9354a90>
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9002%252F20409002%252Fexterior_rear_driver-1774282133811.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_rear_driver-1774282133811.jpg saved to cache
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb75a336-7daf-566f-9778-77d7f8ba13fa
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81a5dd0>
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1440%252F13151440%252Fexterior_rear_driver-1774692711132.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_rear_driver-1774692711132.jpg saved to cache
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0760ac2-9f9a-54a4-9c20-7e4c22444634
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa7e210>
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9002%252F20409002%252Fexterior_front_passenger-1774282127073.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_front_passenger-1774282127073.jpg saved to cache
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb75a336-7daf-566f-9778-77d7f8ba13fa
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6483%252F19226483%252Fdocs_service_history-1774774076589.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D528d030d02aa9071dc06c1c9095ca890%27 HTTP/1.1" 200 None
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6483/19226483/docs_service_history-1774774076589.jpg?ixlib=js-3.8.0&auto=format&s=528d030d02aa9071dc06c1c9095ca890 not downloaded yet
2026-03-29 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20469304.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81e0910>
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0703%252F18800703%252Finterior_rear_seats-1774702022405.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0703/18800703/interior_rear_seats-1774702022405.jpg saved to cache
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 387fc7e4-a776-53e8-8ac4-5facc8406fda
2026-03-29 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_rear_driver-1774626887276.jpg> (referer: None)
2026-03-29 20:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 445c05a9-2fc3-573a-b9aa-5f31ecda8441 with identifier: 20469304
2026-03-29 20:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441 with scrape type 1
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20469304%252Fexterior_front_driver-1774608132818.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_front_driver-1774608132818.jpg not downloaded yet
2026-03-29 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0703/18800703/interior_dashboard-1774702065084.jpg> (referer: None)
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20469304%252Fexterior_rear_driver-1774608134602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_rear_driver-1774608134602.jpg not downloaded yet
2026-03-29 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15806242.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16512497.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f32390>
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2215%252F20392215%252Fexterior_rear_driver-1774626887276.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_rear_driver-1774626887276.jpg saved to cache
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca
2026-03-29 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_front_driver-1774714734762.jpg> (referer: None)
2026-03-29 20:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_front_passenger-1774714744887.jpg> (referer: None)
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20469304%252Fexterior_front_passenger-1774608136323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_front_passenger-1774608136323.jpg not downloaded yet
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20469304%252Fexterior_rear_passenger-1774608133025.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_rear_passenger-1774608133025.jpg not downloaded yet
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9304%252F20469304%252Finterior_front_seats-1774609873468.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9304/20469304/interior_front_seats-1774609873468.jpg not downloaded yet
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0c1090>
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F18800703%252Finterior_dashboard-1774702065084.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/18800703/interior_dashboard-1774702065084.jpg saved to cache
2026-03-29 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 387fc7e4-a776-53e8-8ac4-5facc8406fda
2026-03-29 20:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8e90ef3-e8d1-56b9-ba7b-f1d9cb2a39eb with identifier: 15806242
2026-03-29 20:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8e90ef3-e8d1-56b9-ba7b-f1d9cb2a39eb with scrape type 2
2026-03-29 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8e90ef3-e8d1-56b9-ba7b-f1d9cb2a39eb with scrape type 2
2026-03-29 20:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e8e90ef3-e8d1-56b9-ba7b-f1d9cb2a39eb, identifier: 15806242
2026-03-29 20:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a94b093e-3ff9-54bc-8a98-bfaa8c537463 with identifier: 16512497
2026-03-29 20:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a94b093e-3ff9-54bc-8a98-bfaa8c537463 with scrape type 1
2026-03-29 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a94b093e-3ff9-54bc-8a98-bfaa8c537463
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2497%252F16512497%252Fexterior_front_driver-1774547965900.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_front_driver-1774547965900.jpeg not downloaded yet
2026-03-29 20:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e8e90ef3-e8d1-56b9-ba7b-f1d9cb2a39eb with identifier: 15806242
2026-03-29 20:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e8e90ef3-e8d1-56b9-ba7b-f1d9cb2a39eb with identifier: 15806242
2026-03-29 20:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e8e90ef3-e8d1-56b9-ba7b-f1d9cb2a39eb with identifier: 15806242 to the API
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15806242.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e8e90ef3-e8d1-56b9-ba7b-f1d9cb2a39eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GR19 GDZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15806242',
'listing': 'auction',
'location': 'East Sussex Eastbourne',
'make': 'BMW',
'model': '2 Series',
'odometer': 68500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 10028,
'price_includes_vat': False,
'registration_date': '2019-07-27',
'seats_number': None,
'seller_name': None,
'title': 'BMW 218i M Sport Auto',
'transmission': 'automatic',
'trim': '218i M Sport Auto',
'vin': 'WBA2H320X07E51153',
'year': 2019}
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715806242%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [motorway.uk] INFO: Saving data for 15806242: {'auction_closing_time': 1774884600.0, 'created_time': 1774555667.562092, 'last_price_update_time': 1774814735.109172}
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15806242') HTTP/1.1" 204 0
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9304%252F20469304%252Finterior_rear_seats-1774609872842.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9304/20469304/interior_rear_seats-1774609872842.jpg not downloaded yet
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2497%252F16512497%252Fexterior_rear_driver-1774548030555.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_rear_driver-1774548030555.jpeg not downloaded yet
2026-03-29 20:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0703/18800703/interior_front_seats-1774702008670.jpg> (referer: None)
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20469304%252Finterior_dashboard-1774609893936.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20469304/interior_dashboard-1774609893936.jpg not downloaded yet
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2497%252F16512497%252Fexterior_front_passenger-1774547985705.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_front_passenger-1774547985705.jpeg not downloaded yet
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c83550>
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6483%252F19226483%252Fexterior_front_driver-1774714734762.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_front_driver-1774714734762.jpg saved to cache
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b39d73fd-bd57-5a91-a13f-00127c497574
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0a4690>
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6483%252F19226483%252Fexterior_front_passenger-1774714744887.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_front_passenger-1774714744887.jpg saved to cache
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b39d73fd-bd57-5a91-a13f-00127c497574
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20469304%252Finstrument_cluster-1774609847291.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20469304/instrument_cluster-1774609847291.jpg not downloaded yet
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2497%252F16512497%252Fexterior_rear_passenger-1774548033781.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_rear_passenger-1774548033781.jpeg not downloaded yet
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9304%252F20469304%252Finterior_boot-1774609875149.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9304/20469304/interior_boot-1774609875149.jpg not downloaded yet
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2497%252F16512497%252Finterior_front_seats-1774547869881.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2497/16512497/interior_front_seats-1774547869881.jpeg not downloaded yet
2026-03-29 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94aa4d0>
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0703%252F18800703%252Finterior_front_seats-1774702008670.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0703/18800703/interior_front_seats-1774702008670.jpg saved to cache
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 387fc7e4-a776-53e8-8ac4-5facc8406fda
2026-03-29 20:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1440/13151440/interior_front_seats-1774693363943.jpg> (referer: None)
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9304%252F20469304%252Fdocs_service_history-1774610292402.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D492f0920593e29d67077fd7d79849e50%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9304/20469304/docs_service_history-1774610292402.jpg?ixlib=js-3.8.0&auto=format&s=492f0920593e29d67077fd7d79849e50 not downloaded yet
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2497%252F16512497%252Finterior_rear_seats-1774547812260.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2497/16512497/interior_rear_seats-1774547812260.jpeg not downloaded yet
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2497%252F16512497%252Finterior_dashboard-1774547907386.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2497/16512497/interior_dashboard-1774547907386.jpeg not downloaded yet
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2497%252F16512497%252Finstrument_cluster-1774547863697.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2497/16512497/instrument_cluster-1774547863697.jpeg not downloaded yet
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2497%252F16512497%252Finterior_boot-1774547919822.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2497/16512497/interior_boot-1774547919822.jpeg not downloaded yet
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2497%252F16512497%252Fdocs_service_history-1774547127045.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D922391e86b50ec5be23d183625dd24ff%27 HTTP/1.1" 200 None
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2497/16512497/docs_service_history-1774547127045.jpeg?ixlib=js-3.8.0&auto=format&s=922391e86b50ec5be23d183625dd24ff not downloaded yet
2026-03-29 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fc54d0>
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1440%252F13151440%252Finterior_front_seats-1774693363943.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1440/13151440/interior_front_seats-1774693363943.jpg saved to cache
2026-03-29 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0760ac2-9f9a-54a4-9c20-7e4c22444634
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6483/19226483/docs_service_history-1774774076589.jpg?ixlib=js-3.8.0&auto=format&s=528d030d02aa9071dc06c1c9095ca890> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6483/19226483/interior_rear_seats-1774773564927.jpg> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6483/19226483/interior_front_seats-1774773551668.jpg> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6483/19226483/instrument_cluster-1774773662555.jpg> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6483/19226483/interior_boot-1774773598651.jpg> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6483/19226483/19226483-interior_dashboard-modified-1774774397626.jpeg> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6739/20486739/interior_rear_seats-1774699470661.jpg> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6739/20486739/interior_front_seats-1774699462872.jpg> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_front_passenger-1774547985705.jpeg> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6739/20486739/docs_service_history-1774700141857.jpg?ixlib=js-3.8.0&auto=format&s=e2d299e30fee49bc4be002029cc7765a> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9304/20469304/interior_dashboard-1774609893936.jpg> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9304/20469304/interior_rear_seats-1774609872842.jpg> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9304/20469304/instrument_cluster-1774609847291.jpg> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_rear_driver-1774548030555.jpeg> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2497/16512497/docs_service_history-1774547127045.jpeg?ixlib=js-3.8.0&auto=format&s=922391e86b50ec5be23d183625dd24ff> (referer: None)
2026-03-29 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_rear_passenger-1774548033781.jpeg> (referer: None)
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf29a90>
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6483%252F19226483%252Fdocs_service_history-1774774076589.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D528d030d02aa9071dc06c1c9095ca890') HTTP/1.1" 204 0
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6483/19226483/docs_service_history-1774774076589.jpg?ixlib=js-3.8.0&auto=format&s=528d030d02aa9071dc06c1c9095ca890 saved to cache
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b39d73fd-bd57-5a91-a13f-00127c497574
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f901ce90>
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6483%252F19226483%252Finterior_rear_seats-1774773564927.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6483/19226483/interior_rear_seats-1774773564927.jpg saved to cache
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b39d73fd-bd57-5a91-a13f-00127c497574
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad4d590>
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6483%252F19226483%252Finterior_front_seats-1774773551668.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6483/19226483/interior_front_seats-1774773551668.jpg saved to cache
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b39d73fd-bd57-5a91-a13f-00127c497574
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafbb310>
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6483%252F19226483%252Finstrument_cluster-1774773662555.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6483/19226483/instrument_cluster-1774773662555.jpg saved to cache
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b39d73fd-bd57-5a91-a13f-00127c497574
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafba310>
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6483%252F19226483%252Finterior_boot-1774773598651.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6483/19226483/interior_boot-1774773598651.jpg saved to cache
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b39d73fd-bd57-5a91-a13f-00127c497574
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94ab590>
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6483%252F19226483%252F19226483-interior_dashboard-modified-1774774397626.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6483/19226483/19226483-interior_dashboard-modified-1774774397626.jpeg saved to cache
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b39d73fd-bd57-5a91-a13f-00127c497574
2026-03-29 20:05:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe35d50>
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6739%252F20486739%252Finterior_rear_seats-1774699470661.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6739/20486739/interior_rear_seats-1774699470661.jpg saved to cache
2026-03-29 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db5b9cbd-386e-592e-a039-d240038c298b
2026-03-29 20:05:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94a8350>
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6739%252F20486739%252Finterior_front_seats-1774699462872.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6739/20486739/interior_front_seats-1774699462872.jpg saved to cache
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db5b9cbd-386e-592e-a039-d240038c298b
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94a8d50>
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2497%252F16512497%252Fexterior_front_passenger-1774547985705.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_front_passenger-1774547985705.jpeg saved to cache
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a94b093e-3ff9-54bc-8a98-bfaa8c537463
2026-03-29 20:05:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf29c50>
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6739%252F20486739%252Fdocs_service_history-1774700141857.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De2d299e30fee49bc4be002029cc7765a') HTTP/1.1" 204 0
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6739/20486739/docs_service_history-1774700141857.jpg?ixlib=js-3.8.0&auto=format&s=e2d299e30fee49bc4be002029cc7765a saved to cache
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db5b9cbd-386e-592e-a039-d240038c298b
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe35a90>
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20469304%252Finterior_dashboard-1774609893936.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20469304/interior_dashboard-1774609893936.jpg saved to cache
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae3d190>
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9304%252F20469304%252Finterior_rear_seats-1774609872842.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9304/20469304/interior_rear_seats-1774609872842.jpg saved to cache
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9494e50>
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20469304%252Finstrument_cluster-1774609847291.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20469304/instrument_cluster-1774609847291.jpg saved to cache
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae3f150>
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2497%252F16512497%252Fexterior_rear_driver-1774548030555.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_rear_driver-1774548030555.jpeg saved to cache
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a94b093e-3ff9-54bc-8a98-bfaa8c537463
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe35050>
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2497%252F16512497%252Fdocs_service_history-1774547127045.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D922391e86b50ec5be23d183625dd24ff') HTTP/1.1" 204 0
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2497/16512497/docs_service_history-1774547127045.jpeg?ixlib=js-3.8.0&auto=format&s=922391e86b50ec5be23d183625dd24ff saved to cache
2026-03-29 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a94b093e-3ff9-54bc-8a98-bfaa8c537463
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8466f90>
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2497%252F16512497%252Fexterior_rear_passenger-1774548033781.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_rear_passenger-1774548033781.jpeg saved to cache
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a94b093e-3ff9-54bc-8a98-bfaa8c537463
2026-03-29 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2497/16512497/interior_rear_seats-1774547812260.jpeg> (referer: None)
2026-03-29 20:05:38 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:05:38 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:05:38 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00$+H\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xa9^\x00$!n\x00\x00\x00\x00'
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a68150>
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2497%252F16512497%252Finterior_rear_seats-1774547812260.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2497/16512497/interior_rear_seats-1774547812260.jpeg saved to cache
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a94b093e-3ff9-54bc-8a98-bfaa8c537463
2026-03-29 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_front_driver-1774608132818.jpg> (referer: None)
2026-03-29 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9304/20469304/interior_boot-1774609875149.jpg> (referer: None)
2026-03-29 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_rear_passenger-1774714756586.jpg> (referer: None)
2026-03-29 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_front_passenger-1774608136323.jpg> (referer: None)
2026-03-29 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9304/20469304/docs_service_history-1774610292402.jpg?ixlib=js-3.8.0&auto=format&s=492f0920593e29d67077fd7d79849e50> (referer: None)
2026-03-29 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_rear_passenger-1774608133025.jpg> (referer: None)
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cb0350>
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20469304%252Fexterior_front_driver-1774608132818.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_front_driver-1774608132818.jpg saved to cache
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90bb410>
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9304%252F20469304%252Finterior_boot-1774609875149.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9304/20469304/interior_boot-1774609875149.jpg saved to cache
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8eae550>
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6483%252F19226483%252Fexterior_rear_passenger-1774714756586.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_rear_passenger-1774714756586.jpg saved to cache
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b39d73fd-bd57-5a91-a13f-00127c497574
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010d7650>
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20469304%252Fexterior_front_passenger-1774608136323.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_front_passenger-1774608136323.jpg saved to cache
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8eadc90>
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9304%252F20469304%252Fdocs_service_history-1774610292402.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D492f0920593e29d67077fd7d79849e50') HTTP/1.1" 204 0
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9304/20469304/docs_service_history-1774610292402.jpg?ixlib=js-3.8.0&auto=format&s=492f0920593e29d67077fd7d79849e50 saved to cache
2026-03-29 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f92665d0>
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20469304%252Fexterior_rear_passenger-1774608133025.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_rear_passenger-1774608133025.jpg saved to cache
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6739/20486739/docs_service_history-1774699988143.jpg?ixlib=js-3.8.0&auto=format&s=4e5f9c0380c3c7bb1d0b7a12c2ec7336> (referer: None)
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6993/20456993/docs_service_history-1774789244890.jpg?ixlib=js-3.8.0&auto=format&s=0ddacc8ac6ba5503d3b4db21bf0cdeed> (referer: None)
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_front_driver-1774547965900.jpeg> (referer: None)
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2497/16512497/interior_dashboard-1774547907386.jpeg> (referer: None)
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_rear_driver-1774714766370.jpg> (referer: None)
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_rear_driver-1774608134602.jpg> (referer: None)
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6739/20486739/interior_dashboard-1774699670161.jpg> (referer: None)
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2215/20392215/docs_service_history-1774627951547.jpg?ixlib=js-3.8.0&auto=format&s=0154724d235483cdc00fec1c3c9b7d51> (referer: None)
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2497/16512497/interior_boot-1774547919822.jpeg> (referer: None)
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2497/16512497/interior_front_seats-1774547869881.jpeg> (referer: None)
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6739/20486739/interior_boot-1774699642949.jpg> (referer: None)
2026-03-29 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1440/13151440/docs_service_history-1774706925685.jpg?ixlib=js-3.8.0&auto=format&s=948692d05e969298226d2efd7c3b8309> (referer: None)
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f904ab90>
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6739%252F20486739%252Fdocs_service_history-1774699988143.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4e5f9c0380c3c7bb1d0b7a12c2ec7336') HTTP/1.1" 204 0
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6739/20486739/docs_service_history-1774699988143.jpg?ixlib=js-3.8.0&auto=format&s=4e5f9c0380c3c7bb1d0b7a12c2ec7336 saved to cache
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db5b9cbd-386e-592e-a039-d240038c298b
2026-03-29 20:05:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96003d0>
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6993%252F20456993%252Fdocs_service_history-1774789244890.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0ddacc8ac6ba5503d3b4db21bf0cdeed') HTTP/1.1" 204 0
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6993/20456993/docs_service_history-1774789244890.jpg?ixlib=js-3.8.0&auto=format&s=0ddacc8ac6ba5503d3b4db21bf0cdeed saved to cache
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d67d214e-341f-5814-b9c4-4bc458da3e27
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9074490>
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2497%252F16512497%252Fexterior_front_driver-1774547965900.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_front_driver-1774547965900.jpeg saved to cache
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a94b093e-3ff9-54bc-8a98-bfaa8c537463
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f934b150>
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2497%252F16512497%252Finterior_dashboard-1774547907386.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2497/16512497/interior_dashboard-1774547907386.jpeg saved to cache
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a94b093e-3ff9-54bc-8a98-bfaa8c537463
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf32650>
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6483%252F19226483%252Fexterior_rear_driver-1774714766370.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_rear_driver-1774714766370.jpg saved to cache
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b39d73fd-bd57-5a91-a13f-00127c497574
2026-03-29 20:05:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b39d73fd-bd57-5a91-a13f-00127c497574, skipping ID generation
2026-03-29 20:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b39d73fd-bd57-5a91-a13f-00127c497574 with scrape type 1
2026-03-29 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b39d73fd-bd57-5a91-a13f-00127c497574 sending to next pipeline
2026-03-29 20:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b39d73fd-bd57-5a91-a13f-00127c497574, identifier: 19226483
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cb2bd0>
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9304%252F20469304%252Fexterior_rear_driver-1774608134602.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_rear_driver-1774608134602.jpg saved to cache
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca3c10>
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6739%252F20486739%252Finterior_dashboard-1774699670161.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6739/20486739/interior_dashboard-1774699670161.jpg saved to cache
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db5b9cbd-386e-592e-a039-d240038c298b
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81d62d0>
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2215%252F20392215%252Fdocs_service_history-1774627951547.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0154724d235483cdc00fec1c3c9b7d51') HTTP/1.1" 204 0
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2215/20392215/docs_service_history-1774627951547.jpg?ixlib=js-3.8.0&auto=format&s=0154724d235483cdc00fec1c3c9b7d51 saved to cache
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1e\xdb\x04\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xebJ\x00\x1e\xd1*\x00\x00\x00\x00'
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fc68d0>
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2497%252F16512497%252Finterior_boot-1774547919822.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2497/16512497/interior_boot-1774547919822.jpeg saved to cache
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a94b093e-3ff9-54bc-8a98-bfaa8c537463
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*sP\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02G-\x00*iv\x00\x00\x00\x00'
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf30110>
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2497%252F16512497%252Finterior_front_seats-1774547869881.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2497/16512497/interior_front_seats-1774547869881.jpeg saved to cache
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a94b093e-3ff9-54bc-8a98-bfaa8c537463
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cf2010>
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6739%252F20486739%252Finterior_boot-1774699642949.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6739/20486739/interior_boot-1774699642949.jpg saved to cache
2026-03-29 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db5b9cbd-386e-592e-a039-d240038c298b
2026-03-29 20:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b39d73fd-bd57-5a91-a13f-00127c497574 with identifier: 19226483
2026-03-29 20:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b39d73fd-bd57-5a91-a13f-00127c497574 with identifier: 19226483
2026-03-29 20:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b39d73fd-bd57-5a91-a13f-00127c497574 with identifier: 19226483 to the API
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_rear_driver-1774714766370.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'b39d73fd-bd57-5a91-a13f-00127c497574',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ET19 EVX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19226483',
'listing': 'auction',
'location': 'Suffolk Ipswich',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 50460,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 749478,
'Height': 1770,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_front_driver-1774714734762.jpg',
'Width': 2360},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505583,
'Height': 1550,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_rear_driver-1774714766370.jpg',
'Width': 2067},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 728777,
'Height': 1730,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_front_passenger-1774714744887.jpg',
'Width': 2306},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425012,
'Height': 1367,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6483/19226483/exterior_rear_passenger-1774714756586.jpg',
'Width': 1823},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2175120,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/6483/19226483/interior_front_seats-1774773551668.jpg',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2147861,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/6483/19226483/interior_rear_seats-1774773564927.jpg',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2280577,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6483/19226483/19226483-interior_dashboard-modified-1774774397626.jpeg',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1968401,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6483/19226483/instrument_cluster-1774773662555.jpg',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2404699,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/6483/19226483/interior_boot-1774773598651.jpg',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b39d73fd-bd57-5a91-a13f-00127c497574/b39d73fd-bd57-5a91-a13f-00127c497574_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1488708,
'Height': 3072,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6483/19226483/docs_service_history-1774774076589.jpg?ixlib=js-3.8.0&auto=format&s=528d030d02aa9071dc06c1c9095ca890',
'Width': 4096}],
'price': 10217,
'price_includes_vat': False,
'registration_date': '2019-05-15',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Tucson Premium T-GDi 2WD',
'transmission': 'manual',
'trim': 'Premium T-GDi 2WD',
'vin': 'TMAJ3812LKJ718620',
'year': 2019}
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719226483%27 HTTP/1.1" 200 None
2026-03-29 20:05:40 [motorway.uk] INFO: Saving data for 19226483: {'created_time': 1774814740.962104, 'last_price_update_time': 1774814740.962115, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19226483') HTTP/1.1" 204 0
2026-03-29 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9304/20469304/interior_front_seats-1774609873468.jpg> (referer: None)
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa13de10>
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1440%252F13151440%252Fdocs_service_history-1774706925685.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D948692d05e969298226d2efd7c3b8309') HTTP/1.1" 204 0
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1440/13151440/docs_service_history-1774706925685.jpg?ixlib=js-3.8.0&auto=format&s=948692d05e969298226d2efd7c3b8309 saved to cache
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0760ac2-9f9a-54a4-9c20-7e4c22444634
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa13e490>
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9304%252F20469304%252Finterior_front_seats-1774609873468.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9304/20469304/interior_front_seats-1774609873468.jpg saved to cache
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441
2026-03-29 20:05:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 445c05a9-2fc3-573a-b9aa-5f31ecda8441, skipping ID generation
2026-03-29 20:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441 with scrape type 1
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 445c05a9-2fc3-573a-b9aa-5f31ecda8441 sending to next pipeline
2026-03-29 20:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 445c05a9-2fc3-573a-b9aa-5f31ecda8441, identifier: 20469304
2026-03-29 20:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 445c05a9-2fc3-573a-b9aa-5f31ecda8441 with identifier: 20469304
2026-03-29 20:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 445c05a9-2fc3-573a-b9aa-5f31ecda8441 with identifier: 20469304
2026-03-29 20:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 445c05a9-2fc3-573a-b9aa-5f31ecda8441 with identifier: 20469304 to the API
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9304/20469304/interior_front_seats-1774609873468.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '445c05a9-2fc3-573a-b9aa-5f31ecda8441',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LG13 MKK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20469304',
'listing': 'auction',
'location': 'Greater London Sutton',
'make': 'Vauxhall',
'model': 'Corsa',
'odometer': 21491,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1334476,
'Height': 2473,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_front_driver-1774608132818.jpg',
'Width': 3297},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1064068,
'Height': 2460,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_rear_driver-1774608134602.jpg',
'Width': 3280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 949816,
'Height': 2336,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_front_passenger-1774608136323.jpg',
'Width': 3114},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 748929,
'Height': 2071,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9304/20469304/exterior_rear_passenger-1774608133025.jpg',
'Width': 2761},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2781293,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9304/20469304/interior_front_seats-1774609873468.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3302909,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9304/20469304/interior_rear_seats-1774609872842.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1631412,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9304/20469304/interior_dashboard-1774609893936.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1575001,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9304/20469304/instrument_cluster-1774609847291.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2473754,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9304/20469304/interior_boot-1774609875149.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_445c05a9-2fc3-573a-b9aa-5f31ecda8441/445c05a9-2fc3-573a-b9aa-5f31ecda8441_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1216628,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9304/20469304/docs_service_history-1774610292402.jpg?ixlib=js-3.8.0&auto=format&s=492f0920593e29d67077fd7d79849e50',
'Width': 2161}],
'price': 2138,
'price_includes_vat': False,
'registration_date': '2013-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Corsa S ecoFLEX',
'transmission': 'manual',
'trim': 'S ecoFLEX',
'vin': 'W0L0SDL08D4153859',
'year': 2013}
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469304%27 HTTP/1.1" 200 None
2026-03-29 20:05:41 [motorway.uk] INFO: Saving data for 20469304: {'created_time': 1774814741.680412, 'last_price_update_time': 1774814741.680424, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20469304') HTTP/1.1" 204 0
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9002/20409002/docs_service_history-1774621553826.jpg?ixlib=js-3.8.0&auto=format&s=1fd27380cdada08d84a339a0d0364683> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6739/20486739/exterior_front_passenger-1774699240758.jpg> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2497/16512497/instrument_cluster-1774547863697.jpeg> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2215/20392215/instrument_cluster-1774691891486.jpg> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6739/20486739/exterior_rear_passenger-1774699234424.jpg> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6739/20486739/exterior_front_driver-1774699039657.jpg> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6739/20486739/exterior_rear_driver-1774700943050.jpg> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6993/20456993/instrument_cluster-1774708049424.jpg> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6993/20456993/interior_dashboard-1774708049316.jpg> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1440/13151440/interior_boot-1774693427071.jpg> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1440/13151440/instrument_cluster-1774693371835.jpg> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2215/20392215/interior_rear_seats-1774627675817.jpg> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6993/20456993/interior_boot-1774708111857.jpg> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6993/20456993/interior_rear_seats-1774708014275.jpg> (referer: None)
2026-03-29 20:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2215/20392215/interior_boot-1774627765362.jpg> (referer: None)
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae15910>
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9002%252F20409002%252Fdocs_service_history-1774621553826.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1fd27380cdada08d84a339a0d0364683') HTTP/1.1" 204 0
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9002/20409002/docs_service_history-1774621553826.jpg?ixlib=js-3.8.0&auto=format&s=1fd27380cdada08d84a339a0d0364683 saved to cache
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb75a336-7daf-566f-9778-77d7f8ba13fa
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa034c90>
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6739%252F20486739%252Fexterior_front_passenger-1774699240758.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6739/20486739/exterior_front_passenger-1774699240758.jpg saved to cache
2026-03-29 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db5b9cbd-386e-592e-a039-d240038c298b
2026-03-29 20:05:41 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:05:41 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:05:41 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x005\x1cb\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xe3\x18\x005\x12\x88\x00\x00\x00\x00'
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabb7690>
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2497%252F16512497%252Finstrument_cluster-1774547863697.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2497/16512497/instrument_cluster-1774547863697.jpeg saved to cache
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a94b093e-3ff9-54bc-8a98-bfaa8c537463
2026-03-29 20:05:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a94b093e-3ff9-54bc-8a98-bfaa8c537463, skipping ID generation
2026-03-29 20:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a94b093e-3ff9-54bc-8a98-bfaa8c537463 with scrape type 1
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a94b093e-3ff9-54bc-8a98-bfaa8c537463 sending to next pipeline
2026-03-29 20:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a94b093e-3ff9-54bc-8a98-bfaa8c537463, identifier: 16512497
2026-03-29 20:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a94b093e-3ff9-54bc-8a98-bfaa8c537463 with identifier: 16512497
2026-03-29 20:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a94b093e-3ff9-54bc-8a98-bfaa8c537463 with identifier: 16512497
2026-03-29 20:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a94b093e-3ff9-54bc-8a98-bfaa8c537463 with identifier: 16512497 to the API
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2497/16512497/instrument_cluster-1774547863697.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a94b093e-3ff9-54bc-8a98-bfaa8c537463',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YN68 PYY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16512497',
'listing': 'auction',
'location': 'Berkshire Bracknell',
'make': 'BMW',
'model': 'M2',
'odometer': 65591,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1075845,
'Height': 2407,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_front_driver-1774547965900.jpeg',
'Width': 3209},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1255038,
'Height': 2718,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_rear_driver-1774548030555.jpeg',
'Width': 3624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1738522,
'Height': 2537,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_front_passenger-1774547985705.jpeg',
'Width': 3382},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1736439,
'Height': 2708,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2497/16512497/exterior_rear_passenger-1774548033781.jpeg',
'Width': 3610},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2931325,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2497/16512497/interior_front_seats-1774547869881.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2479270,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2497/16512497/interior_rear_seats-1774547812260.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1511898,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2497/16512497/interior_dashboard-1774547907386.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3604346,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2497/16512497/instrument_cluster-1774547863697.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2147918,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2497/16512497/interior_boot-1774547919822.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a94b093e-3ff9-54bc-8a98-bfaa8c537463/a94b093e-3ff9-54bc-8a98-bfaa8c537463_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163587,
'Height': 2532,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2497/16512497/docs_service_history-1774547127045.jpeg?ixlib=js-3.8.0&auto=format&s=922391e86b50ec5be23d183625dd24ff',
'Width': 1170}],
'price': 14770,
'price_includes_vat': False,
'registration_date': '2018-11-01',
'seats_number': None,
'seller_name': None,
'title': 'BMW M240i Auto',
'transmission': 'automatic',
'trim': '40i Auto',
'vin': 'WBA2J52010VD72384',
'year': 2018}
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716512497%27 HTTP/1.1" 200 None
2026-03-29 20:05:42 [motorway.uk] INFO: Saving data for 16512497: {'created_time': 1774814742.636851, 'last_price_update_time': 1774814742.636863, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16512497') HTTP/1.1" 204 0
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9033250>
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2215%252F20392215%252Finstrument_cluster-1774691891486.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2215/20392215/instrument_cluster-1774691891486.jpg saved to cache
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf50c50>
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6739%252F20486739%252Fexterior_rear_passenger-1774699234424.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6739/20486739/exterior_rear_passenger-1774699234424.jpg saved to cache
2026-03-29 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db5b9cbd-386e-592e-a039-d240038c298b
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9356850>
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6739%252F20486739%252Fexterior_front_driver-1774699039657.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6739/20486739/exterior_front_driver-1774699039657.jpg saved to cache
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db5b9cbd-386e-592e-a039-d240038c298b
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81a62d0>
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6739%252F20486739%252Fexterior_rear_driver-1774700943050.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6739/20486739/exterior_rear_driver-1774700943050.jpg saved to cache
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db5b9cbd-386e-592e-a039-d240038c298b
2026-03-29 20:05:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db5b9cbd-386e-592e-a039-d240038c298b, skipping ID generation
2026-03-29 20:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db5b9cbd-386e-592e-a039-d240038c298b with scrape type 1
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db5b9cbd-386e-592e-a039-d240038c298b sending to next pipeline
2026-03-29 20:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: db5b9cbd-386e-592e-a039-d240038c298b, identifier: 20486739
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81a4cd0>
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6993%252F20456993%252Finstrument_cluster-1774708049424.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6993/20456993/instrument_cluster-1774708049424.jpg saved to cache
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d67d214e-341f-5814-b9c4-4bc458da3e27
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa037450>
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6993%252F20456993%252Finterior_dashboard-1774708049316.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6993/20456993/interior_dashboard-1774708049316.jpg saved to cache
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d67d214e-341f-5814-b9c4-4bc458da3e27
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9355990>
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1440%252F13151440%252Finterior_boot-1774693427071.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1440/13151440/interior_boot-1774693427071.jpg saved to cache
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0760ac2-9f9a-54a4-9c20-7e4c22444634
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81a4310>
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1440%252F13151440%252Finstrument_cluster-1774693371835.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1440/13151440/instrument_cluster-1774693371835.jpg saved to cache
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0760ac2-9f9a-54a4-9c20-7e4c22444634
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf288d0>
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2215%252F20392215%252Finterior_rear_seats-1774627675817.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2215/20392215/interior_rear_seats-1774627675817.jpg saved to cache
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9115610>
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6993%252F20456993%252Finterior_boot-1774708111857.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6993/20456993/interior_boot-1774708111857.jpg saved to cache
2026-03-29 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d67d214e-341f-5814-b9c4-4bc458da3e27
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89845d0>
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6993%252F20456993%252Finterior_rear_seats-1774708014275.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6993/20456993/interior_rear_seats-1774708014275.jpg saved to cache
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d67d214e-341f-5814-b9c4-4bc458da3e27
2026-03-29 20:05:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf28ad0>
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2215%252F20392215%252Finterior_boot-1774627765362.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2215/20392215/interior_boot-1774627765362.jpg saved to cache
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca
2026-03-29 20:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: db5b9cbd-386e-592e-a039-d240038c298b with identifier: 20486739
2026-03-29 20:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: db5b9cbd-386e-592e-a039-d240038c298b with identifier: 20486739
2026-03-29 20:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: db5b9cbd-386e-592e-a039-d240038c298b with identifier: 20486739 to the API
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/6739/20486739/exterior_rear_driver-1774700943050.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'db5b9cbd-386e-592e-a039-d240038c298b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'D20 GWK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20486739',
'listing': 'auction',
'location': 'Wiltshire Swindon',
'make': 'Mercedes',
'model': 'AMG',
'odometer': 33000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1303273,
'Height': 2235,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6739/20486739/exterior_front_driver-1774699039657.jpg',
'Width': 2980},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2471985,
'Height': 2683,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6739/20486739/exterior_rear_driver-1774700943050.jpg',
'Width': 3577},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1203856,
'Height': 2250,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6739/20486739/exterior_front_passenger-1774699240758.jpg',
'Width': 3000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1823478,
'Height': 2567,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6739/20486739/exterior_rear_passenger-1774699234424.jpg',
'Width': 3422},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3560823,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6739/20486739/interior_front_seats-1774699462872.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3432111,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6739/20486739/interior_rear_seats-1774699470661.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1450580,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6739/20486739/interior_dashboard-1774699670161.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3365461,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6739/20486739/interior_boot-1774699642949.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496676,
'Height': 3364,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6739/20486739/docs_service_history-1774699988143.jpg?ixlib=js-3.8.0&auto=format&s=4e5f9c0380c3c7bb1d0b7a12c2ec7336',
'Width': 2230},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5b9cbd-386e-592e-a039-d240038c298b/db5b9cbd-386e-592e-a039-d240038c298b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3374362,
'Height': 3748,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6739/20486739/docs_service_history-1774700141857.jpg?ixlib=js-3.8.0&auto=format&s=e2d299e30fee49bc4be002029cc7765a',
'Width': 2227}],
'price': 32725,
'price_includes_vat': False,
'registration_date': '2021-08-04',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes AMG CLA 45 S 4MATIC+ Auto',
'transmission': 'automatic',
'trim': 'CLA 45 S 4MATIC+ Auto',
'vin': 'W1K1183542N238459',
'year': 2021}
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486739%27 HTTP/1.1" 200 None
2026-03-29 20:05:44 [motorway.uk] INFO: Saving data for 20486739: {'created_time': 1774814744.634213, 'last_price_update_time': 1774814744.634225, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20486739') HTTP/1.1" 204 0
2026-03-29 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1440/13151440/interior_dashboard-1774693424377.jpg> (referer: None)
2026-03-29 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9002/20409002/interior_boot-1774282722230.jpg> (referer: None)
2026-03-29 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2215/20392215/interior_dashboard-1774691903459.jpg> (referer: None)
2026-03-29 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2215/20392215/interior_front_seats-1774627646761.jpg> (referer: None)
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe35450>
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1440%252F13151440%252Finterior_dashboard-1774693424377.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1440/13151440/interior_dashboard-1774693424377.jpg saved to cache
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0760ac2-9f9a-54a4-9c20-7e4c22444634
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a13f90>
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9002%252F20409002%252Finterior_boot-1774282722230.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9002/20409002/interior_boot-1774282722230.jpg saved to cache
2026-03-29 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb75a336-7daf-566f-9778-77d7f8ba13fa
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90bb750>
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2215%252F20392215%252Finterior_dashboard-1774691903459.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2215/20392215/interior_dashboard-1774691903459.jpg saved to cache
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca
2026-03-29 20:05:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf2aad0>
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2215%252F20392215%252Finterior_front_seats-1774627646761.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2215/20392215/interior_front_seats-1774627646761.jpg saved to cache
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca
2026-03-29 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9002/20409002/interior_front_seats-1774282729323.jpg> (referer: None)
2026-03-29 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9002/20409002/instrument_cluster-1774282588258.jpg> (referer: None)
2026-03-29 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9002/20409002/interior_rear_seats-1774282711315.jpg> (referer: None)
2026-03-29 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_front_driver-1774626872346.jpg> (referer: None)
2026-03-29 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_front_passenger-1774692784129.jpg> (referer: None)
2026-03-29 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9002/20409002/interior_dashboard-1774282832496.jpg> (referer: None)
2026-03-29 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1440/13151440/interior_rear_seats-1774693442616.jpg> (referer: None)
2026-03-29 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_rear_passenger-1774626899430.jpg> (referer: None)
2026-03-29 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_front_passenger-1774626909912.jpg> (referer: None)
2026-03-29 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_rear_driver-1774707365510.jpg> (referer: None)
2026-03-29 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_front_passenger-1773415925363.jpg> (referer: None)
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cf3e50>
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9002%252F20409002%252Finterior_front_seats-1774282729323.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9002/20409002/interior_front_seats-1774282729323.jpg saved to cache
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb75a336-7daf-566f-9778-77d7f8ba13fa
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f947aed0>
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9002%252F20409002%252Finstrument_cluster-1774282588258.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9002/20409002/instrument_cluster-1774282588258.jpg saved to cache
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb75a336-7daf-566f-9778-77d7f8ba13fa
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9198890>
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9002%252F20409002%252Finterior_rear_seats-1774282711315.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9002/20409002/interior_rear_seats-1774282711315.jpg saved to cache
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb75a336-7daf-566f-9778-77d7f8ba13fa
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f895cd10>
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2215%252F20392215%252Fexterior_front_driver-1774626872346.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_front_driver-1774626872346.jpg saved to cache
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f919abd0>
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1440%252F13151440%252Fexterior_front_passenger-1774692784129.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_front_passenger-1774692784129.jpg saved to cache
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0760ac2-9f9a-54a4-9c20-7e4c22444634
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96770d0>
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9002%252F20409002%252Finterior_dashboard-1774282832496.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9002/20409002/interior_dashboard-1774282832496.jpg saved to cache
2026-03-29 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb75a336-7daf-566f-9778-77d7f8ba13fa
2026-03-29 20:05:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f895d150>
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1440%252F13151440%252Finterior_rear_seats-1774693442616.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1440/13151440/interior_rear_seats-1774693442616.jpg saved to cache
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0760ac2-9f9a-54a4-9c20-7e4c22444634
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9494710>
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2215%252F20392215%252Fexterior_rear_passenger-1774626899430.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_rear_passenger-1774626899430.jpg saved to cache
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84f4f90>
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2215%252F20392215%252Fexterior_front_passenger-1774626909912.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_front_passenger-1774626909912.jpg saved to cache
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca
2026-03-29 20:05:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d07fefbd-80ef-5e8b-8b28-f21d337e08ca, skipping ID generation
2026-03-29 20:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca with scrape type 1
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d07fefbd-80ef-5e8b-8b28-f21d337e08ca sending to next pipeline
2026-03-29 20:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d07fefbd-80ef-5e8b-8b28-f21d337e08ca, identifier: 20392215
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a10ed0>
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6993%252F20456993%252Fexterior_rear_driver-1774707365510.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_rear_driver-1774707365510.jpg saved to cache
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d67d214e-341f-5814-b9c4-4bc458da3e27
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81a4550>
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F18800703%252Fexterior_front_passenger-1773415925363.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_front_passenger-1773415925363.jpg saved to cache
2026-03-29 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 387fc7e4-a776-53e8-8ac4-5facc8406fda
2026-03-29 20:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d07fefbd-80ef-5e8b-8b28-f21d337e08ca with identifier: 20392215
2026-03-29 20:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d07fefbd-80ef-5e8b-8b28-f21d337e08ca with identifier: 20392215
2026-03-29 20:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d07fefbd-80ef-5e8b-8b28-f21d337e08ca with identifier: 20392215 to the API
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_front_passenger-1774626909912.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'd07fefbd-80ef-5e8b-8b28-f21d337e08ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HX16 NUB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20392215',
'listing': 'auction',
'location': 'Hampshire Lee-on-the-Solent',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 49000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2345462,
'Height': 2843,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_front_driver-1774626872346.jpg',
'Width': 3791},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2221603,
'Height': 2691,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_rear_driver-1774626887276.jpg',
'Width': 3588},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2407504,
'Height': 2841,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_front_passenger-1774626909912.jpg',
'Width': 3788},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2269454,
'Height': 2651,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2215/20392215/exterior_rear_passenger-1774626899430.jpg',
'Width': 3534},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3648975,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2215/20392215/interior_front_seats-1774627646761.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3025627,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2215/20392215/interior_rear_seats-1774627675817.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2944278,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2215/20392215/interior_dashboard-1774691903459.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1748941,
'Height': 2339,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2215/20392215/instrument_cluster-1774691891486.jpg',
'Width': 3119},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3815428,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2215/20392215/interior_boot-1774627765362.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d07fefbd-80ef-5e8b-8b28-f21d337e08ca/d07fefbd-80ef-5e8b-8b28-f21d337e08ca_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1964841,
'Height': 3035,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2215/20392215/docs_service_history-1774627951547.jpg?ixlib=js-3.8.0&auto=format&s=0154724d235483cdc00fec1c3c9b7d51',
'Width': 2011}],
'price': 8042,
'price_includes_vat': False,
'registration_date': '2016-03-19',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Yaris Excel Hybrid VVT-i CVT',
'transmission': 'automatic',
'trim': 'Excel Hybrid VVT-i CVT',
'vin': 'VNKKD3D300A229170',
'year': 2016}
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720392215%27 HTTP/1.1" 200 None
2026-03-29 20:05:46 [motorway.uk] INFO: Saving data for 20392215: {'created_time': 1774814746.901411, 'last_price_update_time': 1774814746.901422, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20392215') HTTP/1.1" 204 0
2026-03-29 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_front_driver-1774692682397.jpg> (referer: None)
2026-03-29 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_front_passenger-1774707394836.jpg> (referer: None)
2026-03-29 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_rear_passenger-1774707380727.jpg> (referer: None)
2026-03-29 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_rear_passenger-1774282145092.jpg> (referer: None)
2026-03-29 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_front_driver-1774707346427.jpg> (referer: None)
2026-03-29 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6993/20456993/interior_front_seats-1774707958285.jpg> (referer: None)
2026-03-29 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7226/18827226/interior_boot-1769263721147.jpg> (referer: None)
2026-03-29 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_rear_driver-1773415940369.jpg> (referer: None)
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f916bdd0>
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1440%252F13151440%252Fexterior_front_driver-1774692682397.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_front_driver-1774692682397.jpg saved to cache
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0760ac2-9f9a-54a4-9c20-7e4c22444634
2026-03-29 20:05:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0760ac2-9f9a-54a4-9c20-7e4c22444634, skipping ID generation
2026-03-29 20:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0760ac2-9f9a-54a4-9c20-7e4c22444634 with scrape type 1
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0760ac2-9f9a-54a4-9c20-7e4c22444634 sending to next pipeline
2026-03-29 20:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a0760ac2-9f9a-54a4-9c20-7e4c22444634, identifier: 13151440
2026-03-29 20:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a0760ac2-9f9a-54a4-9c20-7e4c22444634 with identifier: 13151440
2026-03-29 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a0760ac2-9f9a-54a4-9c20-7e4c22444634 with identifier: 13151440
2026-03-29 20:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a0760ac2-9f9a-54a4-9c20-7e4c22444634 with identifier: 13151440 to the API
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_front_driver-1774692682397.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'a0760ac2-9f9a-54a4-9c20-7e4c22444634',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WM23 LXG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13151440',
'listing': 'auction',
'location': 'South Gloucestershire Bristol',
'make': 'Kia',
'model': 'Niro',
'odometer': 21024,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1806657,
'Height': 2721,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_front_driver-1774692682397.jpg',
'Width': 3628},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1335957,
'Height': 2568,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_rear_driver-1774692711132.jpg',
'Width': 3424},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1791916,
'Height': 2823,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_front_passenger-1774692784129.jpg',
'Width': 3764},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1105436,
'Height': 2361,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1440/13151440/exterior_rear_passenger-1774692821603.jpg',
'Width': 3148},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3291438,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1440/13151440/interior_front_seats-1774693363943.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3311237,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1440/13151440/interior_rear_seats-1774693442616.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1654013,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1440/13151440/interior_dashboard-1774693424377.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2921827,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1440/13151440/instrument_cluster-1774693371835.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3030504,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1440/13151440/interior_boot-1774693427071.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0760ac2-9f9a-54a4-9c20-7e4c22444634/a0760ac2-9f9a-54a4-9c20-7e4c22444634_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304762,
'Height': 1478,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1440/13151440/docs_service_history-1774706925685.jpg?ixlib=js-3.8.0&auto=format&s=948692d05e969298226d2efd7c3b8309',
'Width': 3275}],
'price': 21797,
'price_includes_vat': False,
'registration_date': '2023-07-11',
'seats_number': None,
'seller_name': None,
'title': 'Kia Niro 4 HEV S-A',
'transmission': 'automatic',
'trim': '4 HEV S-A',
'vin': 'KNACT81EVR5105825',
'year': 2023}
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713151440%27 HTTP/1.1" 200 None
2026-03-29 20:05:47 [motorway.uk] INFO: Saving data for 13151440: {'created_time': 1774814747.67985, 'last_price_update_time': 1774814747.679861, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13151440') HTTP/1.1" 204 0
2026-03-29 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_front_passenger-1769263273447.jpg> (referer: None)
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f963d150>
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6993%252F20456993%252Fexterior_front_passenger-1774707394836.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_front_passenger-1774707394836.jpg saved to cache
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d67d214e-341f-5814-b9c4-4bc458da3e27
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa6dad0>
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6993%252F20456993%252Fexterior_rear_passenger-1774707380727.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_rear_passenger-1774707380727.jpg saved to cache
2026-03-29 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d67d214e-341f-5814-b9c4-4bc458da3e27
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad93850>
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9002%252F20409002%252Fexterior_rear_passenger-1774282145092.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_rear_passenger-1774282145092.jpg saved to cache
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb75a336-7daf-566f-9778-77d7f8ba13fa
2026-03-29 20:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb75a336-7daf-566f-9778-77d7f8ba13fa, skipping ID generation
2026-03-29 20:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb75a336-7daf-566f-9778-77d7f8ba13fa with scrape type 1
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb75a336-7daf-566f-9778-77d7f8ba13fa sending to next pipeline
2026-03-29 20:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cb75a336-7daf-566f-9778-77d7f8ba13fa, identifier: 20409002
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cf0b10>
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6993%252F20456993%252Fexterior_front_driver-1774707346427.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_front_driver-1774707346427.jpg saved to cache
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d67d214e-341f-5814-b9c4-4bc458da3e27
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa6de90>
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6993%252F20456993%252Finterior_front_seats-1774707958285.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6993/20456993/interior_front_seats-1774707958285.jpg saved to cache
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d67d214e-341f-5814-b9c4-4bc458da3e27
2026-03-29 20:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d67d214e-341f-5814-b9c4-4bc458da3e27, skipping ID generation
2026-03-29 20:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d67d214e-341f-5814-b9c4-4bc458da3e27 with scrape type 1
2026-03-29 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d67d214e-341f-5814-b9c4-4bc458da3e27 sending to next pipeline
2026-03-29 20:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d67d214e-341f-5814-b9c4-4bc458da3e27, identifier: 20456993
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad921d0>
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7226%252F18827226%252Finterior_boot-1769263721147.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7226/18827226/interior_boot-1769263721147.jpg saved to cache
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 362824db-37b0-50bb-9362-83f68d4145af
2026-03-29 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f92573d0>
2026-03-29 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0703%252F18800703%252Fexterior_rear_driver-1773415940369.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_rear_driver-1773415940369.jpg saved to cache
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 387fc7e4-a776-53e8-8ac4-5facc8406fda
2026-03-29 20:05:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 387fc7e4-a776-53e8-8ac4-5facc8406fda, skipping ID generation
2026-03-29 20:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 387fc7e4-a776-53e8-8ac4-5facc8406fda with scrape type 1
2026-03-29 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 387fc7e4-a776-53e8-8ac4-5facc8406fda sending to next pipeline
2026-03-29 20:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 387fc7e4-a776-53e8-8ac4-5facc8406fda, identifier: 18800703
2026-03-29 20:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cb75a336-7daf-566f-9778-77d7f8ba13fa with identifier: 20409002
2026-03-29 20:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cb75a336-7daf-566f-9778-77d7f8ba13fa with identifier: 20409002
2026-03-29 20:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cb75a336-7daf-566f-9778-77d7f8ba13fa with identifier: 20409002 to the API
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_rear_passenger-1774282145092.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'cb75a336-7daf-566f-9778-77d7f8ba13fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WU23 UVX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20409002',
'listing': 'auction',
'location': 'Somerset Bridgwater',
'make': 'Skoda',
'model': 'Kamiq',
'odometer': 26549,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1167622,
'Height': 2579,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_front_driver-1774282140077.jpg',
'Width': 3438},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1358434,
'Height': 2861,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_rear_driver-1774282133811.jpg',
'Width': 3815},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1367403,
'Height': 2849,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_front_passenger-1774282127073.jpg',
'Width': 3798},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1158229,
'Height': 2439,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9002/20409002/exterior_rear_passenger-1774282145092.jpg',
'Width': 3252},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1442741,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9002/20409002/interior_front_seats-1774282729323.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1624970,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9002/20409002/interior_rear_seats-1774282711315.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1969804,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9002/20409002/interior_dashboard-1774282832496.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1470149,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9002/20409002/instrument_cluster-1774282588258.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1944699,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9002/20409002/interior_boot-1774282722230.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb75a336-7daf-566f-9778-77d7f8ba13fa/cb75a336-7daf-566f-9778-77d7f8ba13fa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56738,
'Height': 2048,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9002/20409002/docs_service_history-1774621553826.jpg?ixlib=js-3.8.0&auto=format&s=1fd27380cdada08d84a339a0d0364683',
'Width': 921}],
'price': 14953,
'price_includes_vat': False,
'registration_date': '2023-06-26',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Kamiq Monte Carlo TSI',
'transmission': 'manual',
'trim': 'Monte Carlo TSI',
'vin': 'TMBHK6NW7P3135272',
'year': 2023}
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720409002%27 HTTP/1.1" 200 None
2026-03-29 20:05:49 [motorway.uk] INFO: Saving data for 20409002: {'created_time': 1774814749.554145, 'last_price_update_time': 1774814749.554157, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20409002') HTTP/1.1" 204 0
2026-03-29 20:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d67d214e-341f-5814-b9c4-4bc458da3e27 with identifier: 20456993
2026-03-29 20:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d67d214e-341f-5814-b9c4-4bc458da3e27 with identifier: 20456993
2026-03-29 20:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d67d214e-341f-5814-b9c4-4bc458da3e27 with identifier: 20456993 to the API
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6993/20456993/interior_front_seats-1774707958285.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd67d214e-341f-5814-b9c4-4bc458da3e27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FD17 YFT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20456993',
'listing': 'auction',
'location': 'Hertfordshire Hertford',
'make': 'BMW',
'model': '3 Series',
'odometer': 85914,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2053709,
'Height': 2577,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_front_driver-1774707346427.jpg',
'Width': 3436},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2711952,
'Height': 2955,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_rear_driver-1774707365510.jpg',
'Width': 3940},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2596108,
'Height': 3002,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_front_passenger-1774707394836.jpg',
'Width': 4002},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2560092,
'Height': 2956,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6993/20456993/exterior_rear_passenger-1774707380727.jpg',
'Width': 3941},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4184409,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6993/20456993/interior_front_seats-1774707958285.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3142277,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6993/20456993/interior_rear_seats-1774708014275.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2067797,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6993/20456993/interior_dashboard-1774708049316.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2574723,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6993/20456993/instrument_cluster-1774708049424.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3712195,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6993/20456993/interior_boot-1774708111857.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d67d214e-341f-5814-b9c4-4bc458da3e27/d67d214e-341f-5814-b9c4-4bc458da3e27_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113419,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6993/20456993/docs_service_history-1774789244890.jpg?ixlib=js-3.8.0&auto=format&s=0ddacc8ac6ba5503d3b4db21bf0cdeed',
'Width': 595}],
'price': 13246,
'price_includes_vat': False,
'registration_date': '2017-05-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW 335D xDrive M Sport Auto',
'transmission': 'automatic',
'trim': '335D xDrive M Sport Auto',
'vin': 'WBA8F72080K821498',
'year': 2017}
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720456993%27 HTTP/1.1" 200 None
2026-03-29 20:05:50 [motorway.uk] INFO: Saving data for 20456993: {'created_time': 1774814750.026558, 'last_price_update_time': 1774814750.026568, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20456993') HTTP/1.1" 204 0
2026-03-29 20:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 387fc7e4-a776-53e8-8ac4-5facc8406fda with identifier: 18800703
2026-03-29 20:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 387fc7e4-a776-53e8-8ac4-5facc8406fda with identifier: 18800703
2026-03-29 20:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 387fc7e4-a776-53e8-8ac4-5facc8406fda with identifier: 18800703 to the API
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_rear_driver-1773415940369.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '387fc7e4-a776-53e8-8ac4-5facc8406fda',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EX71 YCS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18800703',
'listing': 'auction',
'location': 'West Sussex Chichester',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 38665,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265895,
'Height': 965,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_front_driver-1773415924987.jpg',
'Width': 1287},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192316,
'Height': 878,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_rear_driver-1773415940369.jpg',
'Width': 1170},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248511,
'Height': 955,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_front_passenger-1773415925363.jpg',
'Width': 1273},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191803,
'Height': 827,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0703/18800703/exterior_rear_passenger-1773415937658.jpg',
'Width': 1103},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3483717,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0703/18800703/interior_front_seats-1774702008670.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2481961,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0703/18800703/interior_rear_seats-1774702022405.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3242835,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0703/18800703/interior_dashboard-1774702065084.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434508,
'Height': 2048,
'OriginUrl': 'https://motorway-photos.imgix.net/0703/18800703/interior_boot-1773415954410.jpg',
'Width': 1536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260738,
'Height': 3047,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/0703/18800703/18800703-docs_service_history-modified-1774703930174.jpeg?ixlib=js-3.8.0&auto=format&s=7c35b13f2f3fd83f9bca2f2701b4b864',
'Width': 2285},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_387fc7e4-a776-53e8-8ac4-5facc8406fda/387fc7e4-a776-53e8-8ac4-5facc8406fda_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51050,
'Height': 1921,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/0703/18800703/18800703-docs_service_history-modified-1774703790416.jpeg?ixlib=js-3.8.0&auto=format&s=a025825ea6935eb8d8474f9902480c13',
'Width': 1441}],
'price': 13539,
'price_includes_vat': False,
'registration_date': '2021-09-07',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Yaris Excel HEV CVT',
'transmission': 'automatic',
'trim': 'Excel HEV CVT',
'vin': 'VNKKBAC300A189295',
'year': 2021}
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718800703%27 HTTP/1.1" 200 None
2026-03-29 20:05:50 [motorway.uk] INFO: Saving data for 18800703: {'created_time': 1774814750.449436, 'last_price_update_time': 1774814750.449448, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18800703') HTTP/1.1" 204 0
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_rear_passenger-1769263255544.jpg> (referer: None)
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f3f9d0>
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7226%252F18827226%252Fexterior_front_passenger-1769263273447.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_front_passenger-1769263273447.jpg saved to cache
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 362824db-37b0-50bb-9362-83f68d4145af
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_front_driver-1769263232397.jpg> (referer: None)
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a7e290>
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7226%252F18827226%252Fexterior_rear_passenger-1769263255544.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_rear_passenger-1769263255544.jpg saved to cache
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 362824db-37b0-50bb-9362-83f68d4145af
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ac5a90>
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7226%252F18827226%252Fexterior_front_driver-1769263232397.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_front_driver-1769263232397.jpg saved to cache
2026-03-29 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 362824db-37b0-50bb-9362-83f68d4145af
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7226/18827226/interior_dashboard-1769265595971.jpg> (referer: None)
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7226/18827226/instrument_cluster-1769263652875.jpg> (referer: None)
2026-03-29 20:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2794/16052794/damage_scratches-1774706556394.jpeg> (referer: None)
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7226/18827226/interior_front_seats-1769263688859.jpg> (referer: None)
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/7226/18827226/docs_service_history-1769264088295.jpg?ixlib=js-3.8.0&auto=format&s=0914f654b8330bfc85d261a9dfd4dbb2> (referer: None)
2026-03-29 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7226/18827226/interior_rear_seats-1769263709305.jpg> (referer: None)
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8456b90>
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7226%252F18827226%252Finterior_dashboard-1769265595971.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7226/18827226/interior_dashboard-1769265595971.jpg saved to cache
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 362824db-37b0-50bb-9362-83f68d4145af
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96bce50>
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7226%252F18827226%252Finstrument_cluster-1769263652875.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7226/18827226/instrument_cluster-1769263652875.jpg saved to cache
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 362824db-37b0-50bb-9362-83f68d4145af
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00!\xc4\x80\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01;y\x00!\xba\x06\x00\x00\x00\x00'
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9258e10>
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2794%252F16052794%252Fdamage_scratches-1774706556394.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2794/16052794/damage_scratches-1774706556394.jpeg saved to cache
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73a1d099-e0b0-5b4d-b781-62b4d3580180
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa54bd0>
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7226%252F18827226%252Finterior_front_seats-1769263688859.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7226/18827226/interior_front_seats-1769263688859.jpg saved to cache
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 362824db-37b0-50bb-9362-83f68d4145af
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f925a290>
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F7226%252F18827226%252Fdocs_service_history-1769264088295.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0914f654b8330bfc85d261a9dfd4dbb2') HTTP/1.1" 204 0
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/7226/18827226/docs_service_history-1769264088295.jpg?ixlib=js-3.8.0&auto=format&s=0914f654b8330bfc85d261a9dfd4dbb2 saved to cache
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 362824db-37b0-50bb-9362-83f68d4145af
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c76610>
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7226%252F18827226%252Finterior_rear_seats-1769263709305.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7226/18827226/interior_rear_seats-1769263709305.jpg saved to cache
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 362824db-37b0-50bb-9362-83f68d4145af
2026-03-29 20:05:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 362824db-37b0-50bb-9362-83f68d4145af, skipping ID generation
2026-03-29 20:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 362824db-37b0-50bb-9362-83f68d4145af with scrape type 1
2026-03-29 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 362824db-37b0-50bb-9362-83f68d4145af sending to next pipeline
2026-03-29 20:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 362824db-37b0-50bb-9362-83f68d4145af, identifier: 18827226
2026-03-29 20:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 362824db-37b0-50bb-9362-83f68d4145af with identifier: 18827226
2026-03-29 20:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 362824db-37b0-50bb-9362-83f68d4145af with identifier: 18827226
2026-03-29 20:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 362824db-37b0-50bb-9362-83f68d4145af with identifier: 18827226 to the API
2026-03-29 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7226/18827226/interior_rear_seats-1769263709305.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '362824db-37b0-50bb-9362-83f68d4145af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EA20 AEB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18827226',
'listing': 'auction',
'location': 'Greater London London',
'make': 'BMW',
'model': 'M3',
'odometer': 77000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1264364,
'Height': 2165,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_front_driver-1769263232397.jpg',
'Width': 2886},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1478667,
'Height': 2347,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_rear_driver-1769263246114.jpg',
'Width': 3129},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1834507,
'Height': 2383,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_front_passenger-1769263273447.jpg',
'Width': 3177},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1186910,
'Height': 2424,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7226/18827226/exterior_rear_passenger-1769263255544.jpg',
'Width': 3232},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3605187,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7226/18827226/interior_front_seats-1769263688859.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3501452,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7226/18827226/interior_rear_seats-1769263709305.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2673529,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7226/18827226/interior_dashboard-1769265595971.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2124229,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7226/18827226/instrument_cluster-1769263652875.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2995987,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7226/18827226/interior_boot-1769263721147.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_362824db-37b0-50bb-9362-83f68d4145af/362824db-37b0-50bb-9362-83f68d4145af_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8281719,
'Height': 4284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/7226/18827226/docs_service_history-1769264088295.jpg?ixlib=js-3.8.0&auto=format&s=0914f654b8330bfc85d261a9dfd4dbb2',
'Width': 5712}],
'price': 26341,
'price_includes_vat': False,
'registration_date': '2020-07-18',
'seats_number': None,
'seller_name': None,
'title': 'BMW M340I xDrive Auto',
'transmission': 'automatic',
'trim': '40I xDrive Auto',
'vin': 'WBA6N12040FJ98655',
'year': 2020}
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718827226%27 HTTP/1.1" 200 None
2026-03-29 20:05:52 [motorway.uk] INFO: Saving data for 18827226: {'created_time': 1774814752.281311, 'last_price_update_time': 1774814752.281321, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18827226') HTTP/1.1" 204 0
2026-03-29 20:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_front_passenger-1774715332495.jpg> (referer: None)
2026-03-29 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_front_passenger-1774624702303.jpeg> (referer: None)
2026-03-29 20:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_rear_passenger-1774624751410.jpeg> (referer: None)
2026-03-29 20:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2794/16052794/interior_dashboard-1774625143701.jpeg> (referer: None)
2026-03-29 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_rear_passenger-1774715304124.jpg> (referer: None)
2026-03-29 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9492/17979492/interior_rear_seats-1774715549324.jpg> (referer: None)
2026-03-29 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2794/16052794/instrument_cluster-1774625122870.jpeg> (referer: None)
2026-03-29 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9492/17979492/interior_front_seats-1774715535684.jpg> (referer: None)
2026-03-29 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2794/16052794/interior_rear_seats-1774625134350.jpeg> (referer: None)
2026-03-29 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2794/16052794/interior_front_seats-1774625130064.jpeg> (referer: None)
2026-03-29 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_front_driver-1774715283064.jpg> (referer: None)
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9300a90>
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9492%252F17979492%252Fexterior_front_passenger-1774715332495.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_front_passenger-1774715332495.jpg saved to cache
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 550964a4-1a5f-56ed-a71a-4a9affbc230e
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cb03d0>
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2794%252F16052794%252Fexterior_front_passenger-1774624702303.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_front_passenger-1774624702303.jpeg saved to cache
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73a1d099-e0b0-5b4d-b781-62b4d3580180
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93db750>
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2794%252F16052794%252Fexterior_rear_passenger-1774624751410.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_rear_passenger-1774624751410.jpeg saved to cache
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73a1d099-e0b0-5b4d-b781-62b4d3580180
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9300f90>
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2794%252F16052794%252Finterior_dashboard-1774625143701.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2794/16052794/interior_dashboard-1774625143701.jpeg saved to cache
2026-03-29 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73a1d099-e0b0-5b4d-b781-62b4d3580180
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f01290>
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9492%252F17979492%252Fexterior_rear_passenger-1774715304124.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_rear_passenger-1774715304124.jpg saved to cache
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 550964a4-1a5f-56ed-a71a-4a9affbc230e
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facc2c50>
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9492%252F17979492%252Finterior_rear_seats-1774715549324.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9492/17979492/interior_rear_seats-1774715549324.jpg saved to cache
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 550964a4-1a5f-56ed-a71a-4a9affbc230e
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00&\xbc;\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xecS\x00&\xb1\xc1\x00\x00\x00\x00'
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81d5fd0>
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2794%252F16052794%252Finstrument_cluster-1774625122870.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2794/16052794/instrument_cluster-1774625122870.jpeg saved to cache
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73a1d099-e0b0-5b4d-b781-62b4d3580180
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f929cad0>
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9492%252F17979492%252Finterior_front_seats-1774715535684.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9492/17979492/interior_front_seats-1774715535684.jpg saved to cache
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 550964a4-1a5f-56ed-a71a-4a9affbc230e
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00.mB\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x034)\x00.b\xc8\x00\x00\x00\x00'
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f00c50>
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2794%252F16052794%252Finterior_rear_seats-1774625134350.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2794/16052794/interior_rear_seats-1774625134350.jpeg saved to cache
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73a1d099-e0b0-5b4d-b781-62b4d3580180
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000\x13\x13\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xe9Z\x000\x08\x99\x00\x00\x00\x00'
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a3d690>
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2794%252F16052794%252Finterior_front_seats-1774625130064.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2794/16052794/interior_front_seats-1774625130064.jpeg saved to cache
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73a1d099-e0b0-5b4d-b781-62b4d3580180
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfeca10>
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9492%252F17979492%252Fexterior_front_driver-1774715283064.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_front_driver-1774715283064.jpg saved to cache
2026-03-29 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 550964a4-1a5f-56ed-a71a-4a9affbc230e
2026-03-29 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=936&page=26&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_rear_driver-1774715293703.jpg> (referer: None)
2026-03-29 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5214/7025214/damage_scratches-1774709962970.jpg> (referer: None)
2026-03-29 20:05:53 [motorway.uk] INFO: Found listing with ID: 8035510
2026-03-29 20:05:53 [motorway.uk] INFO: Found listing with ID: 20487217
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487217%27 HTTP/1.1" 200 None
2026-03-29 20:05:53 [motorway.uk] INFO: Scrape type for 20487217: 1
2026-03-29 20:05:53 [motorway.uk] INFO: Found listing with ID: 9709671
2026-03-29 20:05:53 [motorway.uk] INFO: Found listing with ID: 18815814
2026-03-29 20:05:53 [motorway.uk] INFO: Found listing with ID: 20223018
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720223018%27 HTTP/1.1" 200 None
2026-03-29 20:05:53 [motorway.uk] INFO: Scrape type for 20223018: 1
2026-03-29 20:05:53 [motorway.uk] INFO: Found listing with ID: 20483589
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483589%27 HTTP/1.1" 200 None
2026-03-29 20:05:53 [motorway.uk] INFO: Scrape type for 20483589: 1
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf91c50>
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9492%252F17979492%252Fexterior_rear_driver-1774715293703.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_rear_driver-1774715293703.jpg saved to cache
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 550964a4-1a5f-56ed-a71a-4a9affbc230e
2026-03-29 20:05:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 550964a4-1a5f-56ed-a71a-4a9affbc230e, skipping ID generation
2026-03-29 20:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 550964a4-1a5f-56ed-a71a-4a9affbc230e with scrape type 1
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 550964a4-1a5f-56ed-a71a-4a9affbc230e sending to next pipeline
2026-03-29 20:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 550964a4-1a5f-56ed-a71a-4a9affbc230e, identifier: 17979492
2026-03-29 20:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 550964a4-1a5f-56ed-a71a-4a9affbc230e with identifier: 17979492
2026-03-29 20:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 550964a4-1a5f-56ed-a71a-4a9affbc230e with identifier: 17979492
2026-03-29 20:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 550964a4-1a5f-56ed-a71a-4a9affbc230e with identifier: 17979492 to the API
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_rear_driver-1774715293703.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '550964a4-1a5f-56ed-a71a-4a9affbc230e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EA24 VOC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17979492',
'listing': 'auction',
'location': 'Nottinghamshire Nottingham',
'make': 'Ford',
'model': 'Puma',
'odometer': 26500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2261390,
'Height': 2939,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_front_driver-1774715283064.jpg',
'Width': 3919},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1808082,
'Height': 2783,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_rear_driver-1774715293703.jpg',
'Width': 3711},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2237969,
'Height': 3005,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_front_passenger-1774715332495.jpg',
'Width': 4007},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1652563,
'Height': 2753,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9492/17979492/exterior_rear_passenger-1774715304124.jpg',
'Width': 3670},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3381497,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9492/17979492/interior_front_seats-1774715535684.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3234815,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9492/17979492/interior_rear_seats-1774715549324.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2627815,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9492/17979492/interior_dashboard-1774783196909.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2681230,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9492/17979492/instrument_cluster-1774715765924.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4596386,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9492/17979492/interior_boot-1774715616894.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_550964a4-1a5f-56ed-a71a-4a9affbc230e/550964a4-1a5f-56ed-a71a-4a9affbc230e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1833680,
'Height': 2790,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9492/17979492/wheels_front_driver-1774715357731.jpg',
'Width': 3720}],
'price': 15626,
'price_includes_vat': False,
'registration_date': '2024-05-13',
'seats_number': None,
'seller_name': None,
'title': 'Ford Puma ST-LINE X MHEV Auto',
'transmission': 'automatic',
'trim': 'ST-LINE X MHEV Auto',
'vin': 'WF02XXERK2RR03807',
'year': 2024}
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717979492%27 HTTP/1.1" 200 None
2026-03-29 20:05:54 [motorway.uk] INFO: Saving data for 17979492: {'created_time': 1774814754.643732, 'last_price_update_time': 1774814754.643742, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17979492') HTTP/1.1" 204 0
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 12179919
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20468816
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20377393
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 17155088
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717155088%27 HTTP/1.1" 200 None
2026-03-29 20:05:54 [motorway.uk] INFO: Scrape type for 17155088: 1
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fc5cd0>
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a2b2af-df35-5469-980e-46ad3ef7b041/57a2b2af-df35-5469-980e-46ad3ef7b041_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5214%252F7025214%252Fdamage_scratches-1774709962970.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5214/7025214/damage_scratches-1774709962970.jpg saved to cache
2026-03-29 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57a2b2af-df35-5469-980e-46ad3ef7b041
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20267868
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 3064694
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 19938092
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20502804
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 19713153
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719713153%27 HTTP/1.1" 200 None
2026-03-29 20:05:54 [motorway.uk] INFO: Scrape type for 19713153: 1
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 19838319
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20050031
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 16344729
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20490281
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 16868488
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 19871523
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20412314
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20415492
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 17316820
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20175981
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720175981%27 HTTP/1.1" 200 None
2026-03-29 20:05:54 [motorway.uk] INFO: Scrape type for 20175981: 1
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20453641
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20478408
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720478408%27 HTTP/1.1" 200 None
2026-03-29 20:05:54 [motorway.uk] INFO: Scrape type for 20478408: 1
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20469298
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20319525
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 16548854
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20052855
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20374311
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 17186648
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 17160787
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717160787%27 HTTP/1.1" 200 None
2026-03-29 20:05:54 [motorway.uk] INFO: Scrape type for 17160787: 1
2026-03-29 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19915940.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20384196
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720384196%27 HTTP/1.1" 200 None
2026-03-29 20:05:54 [motorway.uk] INFO: Scrape type for 20384196: 1
2026-03-29 20:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:54 [motorway.uk] INFO: Found listing with ID: 20037779
2026-03-29 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2794/16052794/interior_boot-1774706440176.jpeg> (referer: None)
2026-03-29 20:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3033/20453033/interior_boot-1774773726749.jpg> (referer: None)
2026-03-29 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3033/20453033/docs_service_history-1774717212584.jpg?ixlib=js-3.8.0&auto=format&s=8cbe7b129a944b2f51ddf2f5e54bc81f> (referer: None)
2026-03-29 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5214/7025214/interior_dashboard-1774713602088.jpg> (referer: None)
2026-03-29 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3033/20453033/instrument_cluster-1774716454741.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5214/7025214/exterior_rear_passenger-1774709829439.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5214/7025214/interior_rear_seats-1774710610462.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5214/7025214/interior_boot-1774710715085.jpg> (referer: None)
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5214/7025214/interior_front_seats-1774710804696.jpg> (referer: None)
2026-03-29 20:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bacfcf4-f8c4-59cf-8ce0-d5079394a67b with identifier: 19915940
2026-03-29 20:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bacfcf4-f8c4-59cf-8ce0-d5079394a67b with scrape type 1
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7bacfcf4-f8c4-59cf-8ce0-d5079394a67b
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5940%252F19915940%252Fexterior_front_driver-1774774299088.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5940/19915940/exterior_front_driver-1774774299088.jpg not downloaded yet
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5940%252F19915940%252Fexterior_rear_driver-1774715354032.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5940/19915940/exterior_rear_driver-1774715354032.jpg not downloaded yet
2026-03-29 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20268898.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5940%252F19915940%252Fexterior_front_passenger-1774774316005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5940/19915940/exterior_front_passenger-1774774316005.jpg not downloaded yet
2026-03-29 20:05:55 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:05:55 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:05:55 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x006PJ\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x9c\xa9\x006E\xd0\x00\x00\x00\x00'
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa035c10>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2794%252F16052794%252Finterior_boot-1774706440176.jpeg') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2794/16052794/interior_boot-1774706440176.jpeg saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73a1d099-e0b0-5b4d-b781-62b4d3580180
2026-03-29 20:05:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73a1d099-e0b0-5b4d-b781-62b4d3580180, skipping ID generation
2026-03-29 20:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73a1d099-e0b0-5b4d-b781-62b4d3580180 with scrape type 1
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73a1d099-e0b0-5b4d-b781-62b4d3580180 sending to next pipeline
2026-03-29 20:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 73a1d099-e0b0-5b4d-b781-62b4d3580180, identifier: 16052794
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a80410>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d71d7f1-831a-5afd-b38f-56418b53a763/5d71d7f1-831a-5afd-b38f-56418b53a763_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3033%252F20453033%252Finterior_boot-1774773726749.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3033/20453033/interior_boot-1774773726749.jpg saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d71d7f1-831a-5afd-b38f-56418b53a763
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf9c790>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d71d7f1-831a-5afd-b38f-56418b53a763/5d71d7f1-831a-5afd-b38f-56418b53a763_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3033%252F20453033%252Fdocs_service_history-1774717212584.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8cbe7b129a944b2f51ddf2f5e54bc81f') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3033/20453033/docs_service_history-1774717212584.jpg?ixlib=js-3.8.0&auto=format&s=8cbe7b129a944b2f51ddf2f5e54bc81f saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d71d7f1-831a-5afd-b38f-56418b53a763
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f86467d0>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a2b2af-df35-5469-980e-46ad3ef7b041/57a2b2af-df35-5469-980e-46ad3ef7b041_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5214%252F7025214%252Finterior_dashboard-1774713602088.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5214/7025214/interior_dashboard-1774713602088.jpg saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57a2b2af-df35-5469-980e-46ad3ef7b041
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfba310>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d71d7f1-831a-5afd-b38f-56418b53a763/5d71d7f1-831a-5afd-b38f-56418b53a763_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3033%252F20453033%252Finstrument_cluster-1774716454741.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3033/20453033/instrument_cluster-1774716454741.jpg saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d71d7f1-831a-5afd-b38f-56418b53a763
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9389690>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a2b2af-df35-5469-980e-46ad3ef7b041/57a2b2af-df35-5469-980e-46ad3ef7b041_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5214%252F7025214%252Fexterior_rear_passenger-1774709829439.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5214/7025214/exterior_rear_passenger-1774709829439.jpg saved to cache
2026-03-29 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57a2b2af-df35-5469-980e-46ad3ef7b041
2026-03-29 20:05:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f911d810>
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a2b2af-df35-5469-980e-46ad3ef7b041/57a2b2af-df35-5469-980e-46ad3ef7b041_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5214%252F7025214%252Finterior_rear_seats-1774710610462.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5214/7025214/interior_rear_seats-1774710610462.jpg saved to cache
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57a2b2af-df35-5469-980e-46ad3ef7b041
2026-03-29 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfb9190>
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a2b2af-df35-5469-980e-46ad3ef7b041/57a2b2af-df35-5469-980e-46ad3ef7b041_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5214%252F7025214%252Finterior_boot-1774710715085.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5214/7025214/interior_boot-1774710715085.jpg saved to cache
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57a2b2af-df35-5469-980e-46ad3ef7b041
2026-03-29 20:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 73a1d099-e0b0-5b4d-b781-62b4d3580180 with identifier: 16052794
2026-03-29 20:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 73a1d099-e0b0-5b4d-b781-62b4d3580180 with identifier: 16052794
2026-03-29 20:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 73a1d099-e0b0-5b4d-b781-62b4d3580180 with identifier: 16052794 to the API
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2794/16052794/interior_boot-1774706440176.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '73a1d099-e0b0-5b4d-b781-62b4d3580180',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LY11 FLV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16052794',
'listing': 'auction',
'location': 'Kent Dartford',
'make': 'Audi',
'model': 'A1',
'odometer': 99000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1272673,
'Height': 2797,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_front_driver-1774624717797.jpeg',
'Width': 3729},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1288553,
'Height': 2542,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_rear_driver-1774625186787.jpeg',
'Width': 3389},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1267077,
'Height': 2572,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_front_passenger-1774624702303.jpeg',
'Width': 3429},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1433536,
'Height': 2831,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2794/16052794/exterior_rear_passenger-1774624751410.jpeg',
'Width': 3775},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3275885,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2794/16052794/interior_front_seats-1774625130064.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3252587,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2794/16052794/interior_rear_seats-1774625134350.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1720144,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2794/16052794/interior_dashboard-1774625143701.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2664590,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2794/16052794/instrument_cluster-1774625122870.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3730675,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2794/16052794/interior_boot-1774706440176.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73a1d099-e0b0-5b4d-b781-62b4d3580180/73a1d099-e0b0-5b4d-b781-62b4d3580180_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2293753,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2794/16052794/damage_scratches-1774706556394.jpeg',
'Width': 4032}],
'price': 2384,
'price_includes_vat': False,
'registration_date': '2011-08-19',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 Sport TFSI',
'transmission': 'manual',
'trim': 'Sport TFSI',
'vin': 'WAUZZZ8X4BB098943',
'year': 2011}
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716052794%27 HTTP/1.1" 200 None
2026-03-29 20:05:56 [motorway.uk] INFO: Saving data for 16052794: {'created_time': 1774814756.719586, 'last_price_update_time': 1774814756.719596, 'auction_closing_time': 1774884600.0}
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16052794') HTTP/1.1" 204 0
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5940%252F19915940%252Fexterior_rear_passenger-1774774322290.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5940/19915940/exterior_rear_passenger-1774774322290.jpg not downloaded yet
2026-03-29 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f911cb90>
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57a2b2af-df35-5469-980e-46ad3ef7b041/57a2b2af-df35-5469-980e-46ad3ef7b041_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5214%252F7025214%252Finterior_front_seats-1774710804696.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5214/7025214/interior_front_seats-1774710804696.jpg saved to cache
2026-03-29 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57a2b2af-df35-5469-980e-46ad3ef7b041
2026-03-29 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5940%252F19915940%252Finterior_front_seats-1774716112382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5940/19915940/interior_front_seats-1774716112382.jpg not downloaded yet
2026-03-29 20:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ee45be2-b606-5755-85fd-bb4a6293d902 with identifier: 20268898
2026-03-29 20:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ee45be2-b606-5755-85fd-bb4a6293d902 with scrape type 1
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ee45be2-b606-5755-85fd-bb4a6293d902
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8898%252F20268898%252Fexterior_front_driver-1774712178982.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8898/20268898/exterior_front_driver-1774712178982.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5940%252F19915940%252Finterior_rear_seats-1774716113734.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5940/19915940/interior_rear_seats-1774716113734.jpg not downloaded yet
2026-03-29 20:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8898%252F20268898%252Fexterior_rear_driver-1774712202913.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8898/20268898/exterior_rear_driver-1774712202913.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5940%252F19915940%252Finterior_dashboard-1774774344114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5940/19915940/interior_dashboard-1774774344114.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8898%252F20268898%252Fexterior_front_passenger-1774179197281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8898/20268898/exterior_front_passenger-1774179197281.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5940%252F19915940%252Finterior_boot-1774716117177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5940/19915940/interior_boot-1774716117177.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8898%252F20268898%252Fexterior_rear_passenger-1774179205968.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8898/20268898/exterior_rear_passenger-1774179205968.jpg not downloaded yet
2026-03-29 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17018395.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5940%252F19915940%252Fdocs_service_history-1774773956868.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbc15db245c30a5849ae83d9b674d981a%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5940/19915940/docs_service_history-1774773956868.jpg?ixlib=js-3.8.0&auto=format&s=bc15db245c30a5849ae83d9b674d981a not downloaded yet
2026-03-29 20:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20474635.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8898%252F20268898%252Finterior_front_seats-1774179469810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8898/20268898/interior_front_seats-1774179469810.jpg not downloaded yet
2026-03-29 20:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5940%252F19915940%252Fdocs_service_history-1774773970477.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D22015d3f63934db2741372f9929711d3%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5940/19915940/docs_service_history-1774773970477.jpg?ixlib=js-3.8.0&auto=format&s=22015d3f63934db2741372f9929711d3 not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8898%252F20268898%252Finterior_rear_seats-1774179485158.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8898/20268898/interior_rear_seats-1774179485158.jpg not downloaded yet
2026-03-29 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13467302.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11255946.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8898%252F20268898%252Finterior_dashboard-1774712253416.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8898/20268898/interior_dashboard-1774712253416.jpg not downloaded yet
2026-03-29 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19632065.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8898%252F20268898%252Finstrument_cluster-1774179569861.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8898/20268898/instrument_cluster-1774179569861.jpg not downloaded yet
2026-03-29 20:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0b918e7-01d7-5749-a12a-6584359397fd with identifier: 17018395
2026-03-29 20:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0b918e7-01d7-5749-a12a-6584359397fd with scrape type 1
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0b918e7-01d7-5749-a12a-6584359397fd
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8395%252F17018395%252Fexterior_front_driver-1774625311307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8395/17018395/exterior_front_driver-1774625311307.jpg not downloaded yet
2026-03-29 20:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b6424fd-22ee-51fc-a372-5a654542f86b with identifier: 20474635
2026-03-29 20:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b6424fd-22ee-51fc-a372-5a654542f86b with scrape type 1
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b6424fd-22ee-51fc-a372-5a654542f86b
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4635%252F20474635%252Fexterior_front_driver-1774705828174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4635/20474635/exterior_front_driver-1774705828174.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8898%252F20268898%252Finterior_boot-1774179548949.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8898/20268898/interior_boot-1774179548949.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8395%252F17018395%252Fexterior_rear_driver-1774625308179.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8395/17018395/exterior_rear_driver-1774625308179.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4635%252F20474635%252Fexterior_rear_driver-1774705829328.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4635/20474635/exterior_rear_driver-1774705829328.jpg not downloaded yet
2026-03-29 20:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f97402a7-d661-5079-9f3a-e2a5f7f7f57c with identifier: 13467302
2026-03-29 20:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f97402a7-d661-5079-9f3a-e2a5f7f7f57c with scrape type 1
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f97402a7-d661-5079-9f3a-e2a5f7f7f57c
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7302%252F13467302%252Fexterior_front_driver-1774100719923.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7302/13467302/exterior_front_driver-1774100719923.jpeg not downloaded yet
2026-03-29 20:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbabe5f4-f473-570a-b24b-e440fb98f18c with identifier: 11255946
2026-03-29 20:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbabe5f4-f473-570a-b24b-e440fb98f18c with scrape type 1
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbabe5f4-f473-570a-b24b-e440fb98f18c
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5946%252F11255946%252Fexterior_front_driver-1774617465263.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5946/11255946/exterior_front_driver-1774617465263.jpg not downloaded yet
2026-03-29 20:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e32b93f6-e893-54cb-8329-64984efa9038 with identifier: 19632065
2026-03-29 20:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e32b93f6-e893-54cb-8329-64984efa9038 with scrape type 1
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e32b93f6-e893-54cb-8329-64984efa9038
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2065%252F19632065%252Fexterior_front_driver-1774700646079.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2065/19632065/exterior_front_driver-1774700646079.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8898%252F20268898%252Fdamage_scratches-1774179226459.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8898/20268898/damage_scratches-1774179226459.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8395%252F17018395%252Fexterior_front_passenger-1774625315288.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8395/17018395/exterior_front_passenger-1774625315288.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4635%252F20474635%252Fexterior_front_passenger-1774705832702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4635/20474635/exterior_front_passenger-1774705832702.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7302%252F13467302%252Fexterior_rear_driver-1774100701174.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7302/13467302/exterior_rear_driver-1774100701174.jpeg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5946%252F11255946%252Fexterior_rear_driver-1774617476160.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5946/11255946/exterior_rear_driver-1774617476160.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2065%252F19632065%252Fexterior_rear_driver-1774700654198.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2065/19632065/exterior_rear_driver-1774700654198.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8395%252F17018395%252Fexterior_rear_passenger-1774625312081.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8395/17018395/exterior_rear_passenger-1774625312081.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4635%252F20474635%252Fexterior_rear_passenger-1774705832003.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4635/20474635/exterior_rear_passenger-1774705832003.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7302%252F13467302%252Fexterior_front_passenger-1774100714670.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7302/13467302/exterior_front_passenger-1774100714670.jpeg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5946%252F11255946%252Fexterior_front_passenger-1774617497972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5946/11255946/exterior_front_passenger-1774617497972.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2065%252F19632065%252Fexterior_front_passenger-1774700683323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2065/19632065/exterior_front_passenger-1774700683323.jpg not downloaded yet
2026-03-29 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5940/19915940/docs_service_history-1774773970477.jpg?ixlib=js-3.8.0&auto=format&s=22015d3f63934db2741372f9929711d3> (referer: None)
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8395%252F17018395%252Finterior_front_seats-1774625820698.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8395/17018395/interior_front_seats-1774625820698.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4635%252F20474635%252Finterior_front_seats-1774706175546.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4635/20474635/interior_front_seats-1774706175546.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7302%252F13467302%252Fexterior_rear_passenger-1774100721978.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7302/13467302/exterior_rear_passenger-1774100721978.jpeg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5946%252F11255946%252Fexterior_rear_passenger-1774617488925.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5946/11255946/exterior_rear_passenger-1774617488925.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2065%252F19632065%252Fexterior_rear_passenger-1774700670650.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2065/19632065/exterior_rear_passenger-1774700670650.jpg not downloaded yet
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8395%252F17018395%252Finterior_rear_seats-1774625745026.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8395/17018395/interior_rear_seats-1774625745026.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4635%252F20474635%252Finterior_rear_seats-1774706179714.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4635/20474635/interior_rear_seats-1774706179714.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7302%252F13467302%252Finterior_front_seats-1774100841478.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7302/13467302/interior_front_seats-1774100841478.jpeg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5946%252F11255946%252Finterior_front_seats-1774617918597.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5946/11255946/interior_front_seats-1774617918597.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2065%252F19632065%252Finterior_front_seats-1774701128511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2065/19632065/interior_front_seats-1774701128511.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8395%252F17018395%252Finterior_dashboard-1774625691603.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8395/17018395/interior_dashboard-1774625691603.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4635%252F20474635%252Finterior_dashboard-1774706196523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4635/20474635/interior_dashboard-1774706196523.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7302%252F13467302%252Finterior_rear_seats-1774100941715.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7302/13467302/interior_rear_seats-1774100941715.jpeg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5946%252F11255946%252Finterior_rear_seats-1774625092150.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5946/11255946/interior_rear_seats-1774625092150.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2065%252F19632065%252Finterior_rear_seats-1774701144720.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2065/19632065/interior_rear_seats-1774701144720.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8395%252F17018395%252Finterior_boot-1774625678321.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8395/17018395/interior_boot-1774625678321.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4635%252F20474635%252Finstrument_cluster-1774706212773.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4635/20474635/instrument_cluster-1774706212773.jpg not downloaded yet
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad80150>
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bacfcf4-f8c4-59cf-8ce0-d5079394a67b/7bacfcf4-f8c4-59cf-8ce0-d5079394a67b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5940%252F19915940%252Fdocs_service_history-1774773970477.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D22015d3f63934db2741372f9929711d3') HTTP/1.1" 204 0
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5940/19915940/docs_service_history-1774773970477.jpg?ixlib=js-3.8.0&auto=format&s=22015d3f63934db2741372f9929711d3 saved to cache
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7bacfcf4-f8c4-59cf-8ce0-d5079394a67b
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7302%252F13467302%252Finterior_dashboard-1774100895496.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7302/13467302/interior_dashboard-1774100895496.jpeg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5946%252F11255946%252Finterior_dashboard-1774617952235.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5946/11255946/interior_dashboard-1774617952235.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2065%252F19632065%252F19632065-interior_dashboard-modified-1774702428122.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2065/19632065/19632065-interior_dashboard-modified-1774702428122.jpeg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8395%252F17018395%252Fdocs_service_history-1774625994106.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D99ccee65d17ef416d0c233dad73b513f%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8395/17018395/docs_service_history-1774625994106.jpg?ixlib=js-3.8.0&auto=format&s=99ccee65d17ef416d0c233dad73b513f not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4635%252F20474635%252Finterior_boot-1774706181648.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4635/20474635/interior_boot-1774706181648.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7302%252F13467302%252Finstrument_cluster-1774465360135.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7302/13467302/instrument_cluster-1774465360135.jpeg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5946%252F11255946%252Finstrument_cluster-1774624662101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5946/11255946/instrument_cluster-1774624662101.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2065%252F19632065%252Finterior_boot-1774701178814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2065/19632065/interior_boot-1774701178814.jpg not downloaded yet
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=972&page=27&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8395%252F17018395%252Fwheels_front_driver-1774625400382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8395/17018395/wheels_front_driver-1774625400382.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4635%252F20474635%252Fdocs_service_history-1774706325595.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df4211d86b8fa7ee08277d59a3f9f2828%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4635/20474635/docs_service_history-1774706325595.jpg?ixlib=js-3.8.0&auto=format&s=f4211d86b8fa7ee08277d59a3f9f2828 not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7302%252F13467302%252Finterior_boot-1774100877860.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7302/13467302/interior_boot-1774100877860.jpeg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5946%252F11255946%252Finterior_boot-1774617958325.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5946/11255946/interior_boot-1774617958325.jpg not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2065%252F19632065%252Fdocs_service_history-1774701509046.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D327f1857d1738dbe84af94a319a0d97f%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2065/19632065/docs_service_history-1774701509046.jpg?ixlib=js-3.8.0&auto=format&s=327f1857d1738dbe84af94a319a0d97f not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7302%252F13467302%252Fdocs_service_history-1774101102122.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4a141e3317c3af532cbe5ca5aac2fef7%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7302/13467302/docs_service_history-1774101102122.jpeg?ixlib=js-3.8.0&auto=format&s=4a141e3317c3af532cbe5ca5aac2fef7 not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5946%252F11255946%252Fdocs_service_history-1774623304457.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8a8e3fe607c5f7d8bbaf909e8f048d33%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5946/11255946/docs_service_history-1774623304457.jpg?ixlib=js-3.8.0&auto=format&s=8a8e3fe607c5f7d8bbaf909e8f048d33 not downloaded yet
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2065%252F19632065%252Fdocs_service_history-1774701513207.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0f23d9cbf7f2fcce19e816ed6a7c27b4%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2065/19632065/docs_service_history-1774701513207.jpg?ixlib=js-3.8.0&auto=format&s=0f23d9cbf7f2fcce19e816ed6a7c27b4 not downloaded yet
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5940/19915940/exterior_rear_driver-1774715354032.jpg> (referer: None)
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5940/19915940/exterior_front_driver-1774774299088.jpg> (referer: None)
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20411853
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 18697582
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 3263792
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20388810
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20267620
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20355104
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 16997942
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20235987
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20327167
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 18355209
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20500674
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20417268
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720417268%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [motorway.uk] INFO: Scrape type for 20417268: 1
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20488448
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488448%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [motorway.uk] INFO: Scrape type for 20488448: 1
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8898/20268898/exterior_rear_passenger-1774179205968.jpg> (referer: None)
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 4592998
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20289196
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 17884848
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717884848%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [motorway.uk] INFO: Scrape type for 17884848: 1
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20406554
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20396431
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720396431%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [motorway.uk] INFO: Scrape type for 20396431: 1
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20479789
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20496248
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 16533872
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716533872%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [motorway.uk] INFO: Scrape type for 16533872: 1
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20491744
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 19390207
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20065341
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20491588
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 19412192
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 8144237
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 20178701
2026-03-29 20:05:58 [motorway.uk] INFO: Found listing with ID: 9608672
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279608672%27 HTTP/1.1" 200 None
2026-03-29 20:05:58 [motorway.uk] INFO: Scrape type for 9608672: 1
2026-03-29 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5940/19915940/exterior_rear_passenger-1774774322290.jpg> (referer: None)
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf7cd90>
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bacfcf4-f8c4-59cf-8ce0-d5079394a67b/7bacfcf4-f8c4-59cf-8ce0-d5079394a67b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5940%252F19915940%252Fexterior_rear_driver-1774715354032.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5940/19915940/exterior_rear_driver-1774715354032.jpg saved to cache
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7bacfcf4-f8c4-59cf-8ce0-d5079394a67b
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f822cd90>
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bacfcf4-f8c4-59cf-8ce0-d5079394a67b/7bacfcf4-f8c4-59cf-8ce0-d5079394a67b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5940%252F19915940%252Fexterior_front_driver-1774774299088.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5940/19915940/exterior_front_driver-1774774299088.jpg saved to cache
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7bacfcf4-f8c4-59cf-8ce0-d5079394a67b
2026-03-29 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5940/19915940/interior_front_seats-1774716112382.jpg> (referer: None)
2026-03-29 20:05:59 [motorway.uk] INFO: Found listing with ID: 20487398
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487398%27 HTTP/1.1" 200 None
2026-03-29 20:05:59 [motorway.uk] INFO: Scrape type for 20487398: 1
2026-03-29 20:05:59 [motorway.uk] INFO: Found listing with ID: 20473693
2026-03-29 20:05:59 [motorway.uk] INFO: Found listing with ID: 19953302
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719953302%27 HTTP/1.1" 200 None
2026-03-29 20:05:59 [motorway.uk] INFO: Scrape type for 19953302: 1
2026-03-29 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5940/19915940/exterior_front_passenger-1774774316005.jpg> (referer: None)
2026-03-29 20:05:59 [motorway.uk] INFO: Found listing with ID: 20149199
2026-03-29 20:05:59 [motorway.uk] INFO: Found listing with ID: 20426141
2026-03-29 20:05:59 [motorway.uk] INFO: Found listing with ID: 10536049
2026-03-29 20:05:59 [motorway.uk] INFO: Found listing with ID: 20307524
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720307524%27 HTTP/1.1" 200 None
2026-03-29 20:05:59 [motorway.uk] INFO: Scrape type for 20307524: 1
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85b5dd0>
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ee45be2-b606-5755-85fd-bb4a6293d902/4ee45be2-b606-5755-85fd-bb4a6293d902_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8898%252F20268898%252Fexterior_rear_passenger-1774179205968.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8898/20268898/exterior_rear_passenger-1774179205968.jpg saved to cache
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ee45be2-b606-5755-85fd-bb4a6293d902
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e56f90>
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bacfcf4-f8c4-59cf-8ce0-d5079394a67b/7bacfcf4-f8c4-59cf-8ce0-d5079394a67b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5940%252F19915940%252Fexterior_rear_passenger-1774774322290.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5940/19915940/exterior_rear_passenger-1774774322290.jpg saved to cache
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7bacfcf4-f8c4-59cf-8ce0-d5079394a67b
2026-03-29 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8898/20268898/interior_dashboard-1774712253416.jpg> (referer: None)
2026-03-29 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20384196.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d5950>
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bacfcf4-f8c4-59cf-8ce0-d5079394a67b/7bacfcf4-f8c4-59cf-8ce0-d5079394a67b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5940%252F19915940%252Finterior_front_seats-1774716112382.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5940/19915940/interior_front_seats-1774716112382.jpg saved to cache
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7bacfcf4-f8c4-59cf-8ce0-d5079394a67b
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82c9210>
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bacfcf4-f8c4-59cf-8ce0-d5079394a67b/7bacfcf4-f8c4-59cf-8ce0-d5079394a67b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5940%252F19915940%252Fexterior_front_passenger-1774774316005.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5940/19915940/exterior_front_passenger-1774774316005.jpg saved to cache
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7bacfcf4-f8c4-59cf-8ce0-d5079394a67b
2026-03-29 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5946/11255946/docs_service_history-1774623304457.jpg?ixlib=js-3.8.0&auto=format&s=8a8e3fe607c5f7d8bbaf909e8f048d33> (referer: None)
2026-03-29 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5940/19915940/interior_boot-1774716117177.jpg> (referer: None)
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e22a10>
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ee45be2-b606-5755-85fd-bb4a6293d902/4ee45be2-b606-5755-85fd-bb4a6293d902_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8898%252F20268898%252Finterior_dashboard-1774712253416.jpg') HTTP/1.1" 204 0
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8898/20268898/interior_dashboard-1774712253416.jpg saved to cache
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ee45be2-b606-5755-85fd-bb4a6293d902
2026-03-29 20:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6695c238-4169-52fd-8cfd-ae53fe1b867b with identifier: 20384196
2026-03-29 20:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6695c238-4169-52fd-8cfd-ae53fe1b867b with scrape type 1
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6695c238-4169-52fd-8cfd-ae53fe1b867b
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4196%252F20384196%252Fexterior_front_driver-1774695503810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4196/20384196/exterior_front_driver-1774695503810.jpg not downloaded yet
2026-03-29 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2065/19632065/exterior_front_passenger-1774700683323.jpg> (referer: None)
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4196%252F20384196%252Fexterior_rear_driver-1774695580246.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4196/20384196/exterior_rear_driver-1774695580246.jpg not downloaded yet
2026-03-29 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17160787.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19713153.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4196%252F20384196%252Fexterior_front_passenger-1774695648386.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4196/20384196/exterior_front_passenger-1774695648386.jpg not downloaded yet
2026-03-29 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ab1c10>
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbabe5f4-f473-570a-b24b-e440fb98f18c/fbabe5f4-f473-570a-b24b-e440fb98f18c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5946%252F11255946%252Fdocs_service_history-1774623304457.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8a8e3fe607c5f7d8bbaf909e8f048d33') HTTP/1.1" 204 0
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5946/11255946/docs_service_history-1774623304457.jpg?ixlib=js-3.8.0&auto=format&s=8a8e3fe607c5f7d8bbaf909e8f048d33 saved to cache
2026-03-29 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbabe5f4-f473-570a-b24b-e440fb98f18c
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa041050>
2026-03-29 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7bacfcf4-f8c4-59cf-8ce0-d5079394a67b/7bacfcf4-f8c4-59cf-8ce0-d5079394a67b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5940%252F19915940%252Finterior_boot-1774716117177.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5940/19915940/interior_boot-1774716117177.jpg saved to cache
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7bacfcf4-f8c4-59cf-8ce0-d5079394a67b
2026-03-29 20:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8898/20268898/interior_front_seats-1774179469810.jpg> (referer: None)
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4196%252F20384196%252Fexterior_rear_passenger-1774695619941.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4196/20384196/exterior_rear_passenger-1774695619941.jpg not downloaded yet
2026-03-29 20:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20478408.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4196%252F20384196%252Finterior_front_seats-1774694778634.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4196/20384196/interior_front_seats-1774694778634.jpg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4196%252F20384196%252Finterior_rear_seats-1774694822884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4196/20384196/interior_rear_seats-1774694822884.jpg not downloaded yet
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85e0f90>
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e32b93f6-e893-54cb-8329-64984efa9038/e32b93f6-e893-54cb-8329-64984efa9038_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2065%252F19632065%252Fexterior_front_passenger-1774700683323.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2065/19632065/exterior_front_passenger-1774700683323.jpg saved to cache
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e32b93f6-e893-54cb-8329-64984efa9038
2026-03-29 20:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63dd2cb8-7a5f-52ed-aa8f-0befefe2e244 with identifier: 17160787
2026-03-29 20:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63dd2cb8-7a5f-52ed-aa8f-0befefe2e244 with scrape type 1
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63dd2cb8-7a5f-52ed-aa8f-0befefe2e244
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0787%252F17160787%252Fexterior_front_driver-1774699093054.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0787/17160787/exterior_front_driver-1774699093054.jpeg not downloaded yet
2026-03-29 20:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3bd6039-ca1e-5ff0-be21-f581ed70cfff with identifier: 19713153
2026-03-29 20:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3bd6039-ca1e-5ff0-be21-f581ed70cfff with scrape type 1
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3bd6039-ca1e-5ff0-be21-f581ed70cfff
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3153%252F19713153%252F19713153-exterior_front_driver-modified-1774617962627.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3153/19713153/19713153-exterior_front_driver-modified-1774617962627.jpeg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4196%252F20384196%252Finterior_dashboard-1774696141012.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4196/20384196/interior_dashboard-1774696141012.jpg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0787%252F17160787%252Fexterior_rear_driver-1774699175801.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0787/17160787/exterior_rear_driver-1774699175801.jpeg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3153%252F19713153%252F19713153-exterior_rear_driver-modified-1774618011804.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3153/19713153/19713153-exterior_rear_driver-modified-1774618011804.jpeg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4196%252F20384196%252Finstrument_cluster-1774694838784.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4196/20384196/instrument_cluster-1774694838784.jpg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0787%252F17160787%252Fexterior_front_passenger-1774699122143.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0787/17160787/exterior_front_passenger-1774699122143.jpeg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3153%252F19713153%252Fexterior_front_passenger-1771935141175.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3153/19713153/exterior_front_passenger-1771935141175.jpeg not downloaded yet
2026-03-29 20:06:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0130d0>
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ee45be2-b606-5755-85fd-bb4a6293d902/4ee45be2-b606-5755-85fd-bb4a6293d902_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8898%252F20268898%252Finterior_front_seats-1774179469810.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8898/20268898/interior_front_seats-1774179469810.jpg saved to cache
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ee45be2-b606-5755-85fd-bb4a6293d902
2026-03-29 20:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2370e387-ca8d-59d7-950e-da0d9998bc4b with identifier: 20478408
2026-03-29 20:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2370e387-ca8d-59d7-950e-da0d9998bc4b with scrape type 1
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2370e387-ca8d-59d7-950e-da0d9998bc4b
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8408%252F20478408%252Fexterior_front_driver-1774700232922.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8408/20478408/exterior_front_driver-1774700232922.jpg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4196%252F20384196%252Finterior_boot-1774694915972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4196/20384196/interior_boot-1774694915972.jpg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0787%252F17160787%252Fexterior_rear_passenger-1774699145643.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0787/17160787/exterior_rear_passenger-1774699145643.jpeg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3153%252F19713153%252Fexterior_rear_passenger-1771935171435.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3153/19713153/exterior_rear_passenger-1771935171435.jpeg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8408%252F20478408%252Fexterior_rear_driver-1774700252558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8408/20478408/exterior_rear_driver-1774700252558.jpg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4196%252F20384196%252Fdocs_service_history-1774695162968.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D18980bcd0dedf322fb25d2e869561cee%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4196/20384196/docs_service_history-1774695162968.jpg?ixlib=js-3.8.0&auto=format&s=18980bcd0dedf322fb25d2e869561cee not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0787%252F17160787%252Finterior_front_seats-1774699507376.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0787/17160787/interior_front_seats-1774699507376.jpeg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3153%252F19713153%252Finterior_front_seats-1771935439888.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3153/19713153/interior_front_seats-1771935439888.jpeg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8408%252F20478408%252Fexterior_front_passenger-1774700274799.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8408/20478408/exterior_front_passenger-1774700274799.jpg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0787%252F17160787%252Finterior_rear_seats-1774699593175.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0787/17160787/interior_rear_seats-1774699593175.jpeg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3153%252F19713153%252Finterior_rear_seats-1771935407822.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3153/19713153/interior_rear_seats-1771935407822.jpeg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8408%252F20478408%252Fexterior_rear_passenger-1774700258945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8408/20478408/exterior_rear_passenger-1774700258945.jpg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0787%252F17160787%252F17160787-interior_dashboard-modified-1774704286129.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0787/17160787/17160787-interior_dashboard-modified-1774704286129.jpeg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3153%252F19713153%252F19713153-interior_dashboard-modified-1774617989437.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3153/19713153/19713153-interior_dashboard-modified-1774617989437.jpeg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8408%252F20478408%252Finterior_front_seats-1774700928784.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8408/20478408/interior_front_seats-1774700928784.jpg not downloaded yet
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0787%252F17160787%252Finstrument_cluster-1774699683570.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0787/17160787/instrument_cluster-1774699683570.jpeg not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3153%252F19713153%252Finterior_boot-1771935663593.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3153/19713153/interior_boot-1771935663593.jpeg not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8408%252F20478408%252Finterior_rear_seats-1774700781392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8408/20478408/interior_rear_seats-1774700781392.jpg not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0787%252F17160787%252Finterior_boot-1774699757901.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0787/17160787/interior_boot-1774699757901.jpeg not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3153%252F19713153%252Fdocs_service_history-1774461452139.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dae78478985abba851e453b763a9e129f%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3153/19713153/docs_service_history-1774461452139.jpeg?ixlib=js-3.8.0&auto=format&s=ae78478985abba851e453b763a9e129f not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8408%252F20478408%252Finterior_dashboard-1774700812568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8408/20478408/interior_dashboard-1774700812568.jpg not downloaded yet
2026-03-29 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20175981.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0787%252F17160787%252F17160787-docs_service_history-modified-1774704031880.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df300629b746d972ac395bc4f743ad0c8%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0787/17160787/17160787-docs_service_history-modified-1774704031880.jpeg?ixlib=js-3.8.0&auto=format&s=f300629b746d972ac395bc4f743ad0c8 not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3153%252F19713153%252F19713153-docs_service_history-modified-1774618352449.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6ec72318d9548efb1053caedf69a31e8%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3153/19713153/19713153-docs_service_history-modified-1774618352449.jpeg?ixlib=js-3.8.0&auto=format&s=6ec72318d9548efb1053caedf69a31e8 not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8408%252F20478408%252Finstrument_cluster-1774700755614.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8408/20478408/instrument_cluster-1774700755614.jpg not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8408%252F20478408%252Finterior_boot-1774700846018.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8408/20478408/interior_boot-1774700846018.jpg not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8408%252F20478408%252Fdocs_service_history-1774701283810.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D838ae3926e91386ddc10edbd27ab30be%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8408/20478408/docs_service_history-1774701283810.jpg?ixlib=js-3.8.0&auto=format&s=838ae3926e91386ddc10edbd27ab30be not downloaded yet
2026-03-29 20:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e4f1764-102b-5832-89c4-e1419592243e with identifier: 20175981
2026-03-29 20:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e4f1764-102b-5832-89c4-e1419592243e with scrape type 1
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e4f1764-102b-5832-89c4-e1419592243e
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5981%252F20175981%252Fexterior_front_driver-1774703619027.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_front_driver-1774703619027.jpg not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5981%252F20175981%252Fexterior_rear_driver-1774703652403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_rear_driver-1774703652403.jpg not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5981%252F20175981%252Fexterior_front_passenger-1774703687719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_front_passenger-1774703687719.jpg not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5981%252F20175981%252Fexterior_rear_passenger-1774703666914.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_rear_passenger-1774703666914.jpg not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5981%252F20175981%252Finterior_front_seats-1774704258943.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5981/20175981/interior_front_seats-1774704258943.jpg not downloaded yet
2026-03-29 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0787/17160787/exterior_front_passenger-1774699122143.jpeg> (referer: None)
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5981%252F20175981%252Finterior_rear_seats-1774704276804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5981/20175981/interior_rear_seats-1774704276804.jpg not downloaded yet
2026-03-29 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0787/17160787/exterior_rear_passenger-1774699145643.jpeg> (referer: None)
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5981%252F20175981%252Finterior_dashboard-1774704312430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5981/20175981/interior_dashboard-1774704312430.jpg not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5981%252F20175981%252Finstrument_cluster-1774704356200.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5981/20175981/instrument_cluster-1774704356200.jpg not downloaded yet
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5981%252F20175981%252Finterior_boot-1774704313892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5981/20175981/interior_boot-1774704313892.jpg not downloaded yet
2026-03-29 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3153/19713153/exterior_rear_passenger-1771935171435.jpeg> (referer: None)
2026-03-29 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8408/20478408/exterior_front_driver-1774700232922.jpg> (referer: None)
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5981%252F20175981%252Fdocs_service_history-1774704590789.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D76fabb3da67f7dde76c363cf17a4995a%27 HTTP/1.1" 200 None
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5981/20175981/docs_service_history-1774704590789.jpg?ixlib=js-3.8.0&auto=format&s=76fabb3da67f7dde76c363cf17a4995a not downloaded yet
2026-03-29 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2065/19632065/interior_boot-1774701178814.jpg> (referer: None)
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9294290>
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63dd2cb8-7a5f-52ed-aa8f-0befefe2e244/63dd2cb8-7a5f-52ed-aa8f-0befefe2e244_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0787%252F17160787%252Fexterior_front_passenger-1774699122143.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0787/17160787/exterior_front_passenger-1774699122143.jpeg saved to cache
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63dd2cb8-7a5f-52ed-aa8f-0befefe2e244
2026-03-29 20:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3153/19713153/exterior_front_passenger-1771935141175.jpeg> (referer: None)
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89e8350>
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63dd2cb8-7a5f-52ed-aa8f-0befefe2e244/63dd2cb8-7a5f-52ed-aa8f-0befefe2e244_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0787%252F17160787%252Fexterior_rear_passenger-1774699145643.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0787/17160787/exterior_rear_passenger-1774699145643.jpeg saved to cache
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63dd2cb8-7a5f-52ed-aa8f-0befefe2e244
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa184090>
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3bd6039-ca1e-5ff0-be21-f581ed70cfff/e3bd6039-ca1e-5ff0-be21-f581ed70cfff_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3153%252F19713153%252Fexterior_rear_passenger-1771935171435.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3153/19713153/exterior_rear_passenger-1771935171435.jpeg saved to cache
2026-03-29 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3bd6039-ca1e-5ff0-be21-f581ed70cfff
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf6bd90>
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2370e387-ca8d-59d7-950e-da0d9998bc4b/2370e387-ca8d-59d7-950e-da0d9998bc4b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8408%252F20478408%252Fexterior_front_driver-1774700232922.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8408/20478408/exterior_front_driver-1774700232922.jpg saved to cache
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2370e387-ca8d-59d7-950e-da0d9998bc4b
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf6a610>
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e32b93f6-e893-54cb-8329-64984efa9038/e32b93f6-e893-54cb-8329-64984efa9038_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2065%252F19632065%252Finterior_boot-1774701178814.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2065/19632065/interior_boot-1774701178814.jpg saved to cache
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e32b93f6-e893-54cb-8329-64984efa9038
2026-03-29 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1008&page=28&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0de0d0>
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3bd6039-ca1e-5ff0-be21-f581ed70cfff/e3bd6039-ca1e-5ff0-be21-f581ed70cfff_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3153%252F19713153%252Fexterior_front_passenger-1771935141175.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3153/19713153/exterior_front_passenger-1771935141175.jpeg saved to cache
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3bd6039-ca1e-5ff0-be21-f581ed70cfff
2026-03-29 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8408/20478408/interior_dashboard-1774700812568.jpg> (referer: None)
2026-03-29 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4196/20384196/instrument_cluster-1774694838784.jpg> (referer: None)
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20304692
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 15783679
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 17667845
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 17291886
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 17331311
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717331311%27 HTTP/1.1" 200 None
2026-03-29 20:06:02 [motorway.uk] INFO: Scrape type for 17331311: 1
2026-03-29 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2065/19632065/docs_service_history-1774701513207.jpg?ixlib=js-3.8.0&auto=format&s=0f23d9cbf7f2fcce19e816ed6a7c27b4> (referer: None)
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20377284
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720377284%27 HTTP/1.1" 200 None
2026-03-29 20:06:02 [motorway.uk] INFO: Scrape type for 20377284: 1
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 18264016
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20486192
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20489798
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489798%27 HTTP/1.1" 200 None
2026-03-29 20:06:02 [motorway.uk] INFO: Scrape type for 20489798: 1
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 18016902
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718016902%27 HTTP/1.1" 200 None
2026-03-29 20:06:02 [motorway.uk] INFO: Scrape type for 18016902: 1
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20194798
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720194798%27 HTTP/1.1" 200 None
2026-03-29 20:06:02 [motorway.uk] INFO: Scrape type for 20194798: 1
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 19772114
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20365288
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 19121650
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 13570427
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 13327562
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713327562%27 HTTP/1.1" 200 None
2026-03-29 20:06:02 [motorway.uk] INFO: Scrape type for 13327562: 1
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94b56d0>
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2370e387-ca8d-59d7-950e-da0d9998bc4b/2370e387-ca8d-59d7-950e-da0d9998bc4b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8408%252F20478408%252Finterior_dashboard-1774700812568.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8408/20478408/interior_dashboard-1774700812568.jpg saved to cache
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2370e387-ca8d-59d7-950e-da0d9998bc4b
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9296a90>
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6695c238-4169-52fd-8cfd-ae53fe1b867b/6695c238-4169-52fd-8cfd-ae53fe1b867b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4196%252F20384196%252Finstrument_cluster-1774694838784.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4196/20384196/instrument_cluster-1774694838784.jpg saved to cache
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6695c238-4169-52fd-8cfd-ae53fe1b867b
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 17966792
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20229861
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20471278
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20454392
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20165611
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720165611%27 HTTP/1.1" 200 None
2026-03-29 20:06:02 [motorway.uk] INFO: Scrape type for 20165611: 2
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a599d0>
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e32b93f6-e893-54cb-8329-64984efa9038/e32b93f6-e893-54cb-8329-64984efa9038_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2065%252F19632065%252Fdocs_service_history-1774701513207.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0f23d9cbf7f2fcce19e816ed6a7c27b4') HTTP/1.1" 204 0
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2065/19632065/docs_service_history-1774701513207.jpg?ixlib=js-3.8.0&auto=format&s=0f23d9cbf7f2fcce19e816ed6a7c27b4 saved to cache
2026-03-29 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e32b93f6-e893-54cb-8329-64984efa9038
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 19472539
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20422592
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720422592%27 HTTP/1.1" 200 None
2026-03-29 20:06:02 [motorway.uk] INFO: Scrape type for 20422592: 1
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20385998
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 16437364
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20369773
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 18202599
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20493993
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 9310356
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20226525
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 3894223
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 9990352
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 19838996
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719838996%27 HTTP/1.1" 200 None
2026-03-29 20:06:02 [motorway.uk] INFO: Scrape type for 19838996: 1
2026-03-29 20:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 13722608
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20486496
2026-03-29 20:06:02 [motorway.uk] INFO: Found listing with ID: 20043212
2026-03-29 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5981/20175981/docs_service_history-1774704590789.jpg?ixlib=js-3.8.0&auto=format&s=76fabb3da67f7dde76c363cf17a4995a> (referer: None)
2026-03-29 20:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4196/20384196/interior_boot-1774694915972.jpg> (referer: None)
2026-03-29 20:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5981/20175981/instrument_cluster-1774704356200.jpg> (referer: None)
2026-03-29 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5981/20175981/interior_front_seats-1774704258943.jpg> (referer: None)
2026-03-29 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_rear_passenger-1774703666914.jpg> (referer: None)
2026-03-29 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5981/20175981/interior_rear_seats-1774704276804.jpg> (referer: None)
2026-03-29 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_front_passenger-1774703687719.jpg> (referer: None)
2026-03-29 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5981/20175981/interior_dashboard-1774704312430.jpg> (referer: None)
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93e2910>
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5981%252F20175981%252Fdocs_service_history-1774704590789.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D76fabb3da67f7dde76c363cf17a4995a') HTTP/1.1" 204 0
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5981/20175981/docs_service_history-1774704590789.jpg?ixlib=js-3.8.0&auto=format&s=76fabb3da67f7dde76c363cf17a4995a saved to cache
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e4f1764-102b-5832-89c4-e1419592243e
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f827e850>
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6695c238-4169-52fd-8cfd-ae53fe1b867b/6695c238-4169-52fd-8cfd-ae53fe1b867b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4196%252F20384196%252Finterior_boot-1774694915972.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4196/20384196/interior_boot-1774694915972.jpg saved to cache
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6695c238-4169-52fd-8cfd-ae53fe1b867b
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f39690>
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5981%252F20175981%252Finstrument_cluster-1774704356200.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5981/20175981/instrument_cluster-1774704356200.jpg saved to cache
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e4f1764-102b-5832-89c4-e1419592243e
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89e3cd0>
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5981%252F20175981%252Finterior_front_seats-1774704258943.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5981/20175981/interior_front_seats-1774704258943.jpg saved to cache
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e4f1764-102b-5832-89c4-e1419592243e
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f907f990>
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5981%252F20175981%252Fexterior_rear_passenger-1774703666914.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_rear_passenger-1774703666914.jpg saved to cache
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e4f1764-102b-5832-89c4-e1419592243e
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89e0610>
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5981%252F20175981%252Finterior_rear_seats-1774704276804.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5981/20175981/interior_rear_seats-1774704276804.jpg saved to cache
2026-03-29 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e4f1764-102b-5832-89c4-e1419592243e
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f870ea8a090>
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5981%252F20175981%252Fexterior_front_passenger-1774703687719.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_front_passenger-1774703687719.jpg saved to cache
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e4f1764-102b-5832-89c4-e1419592243e
2026-03-29 20:06:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8adc550>
2026-03-29 20:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5981%252F20175981%252Finterior_dashboard-1774704312430.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5981/20175981/interior_dashboard-1774704312430.jpg saved to cache
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e4f1764-102b-5832-89c4-e1419592243e
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5981/20175981/interior_boot-1774704313892.jpg> (referer: None)
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_rear_driver-1774703652403.jpg> (referer: None)
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9608672.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9ffac50>
2026-03-29 20:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5981%252F20175981%252Finterior_boot-1774704313892.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5981/20175981/interior_boot-1774704313892.jpg saved to cache
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e4f1764-102b-5832-89c4-e1419592243e
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487398.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0c8dd0>
2026-03-29 20:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5981%252F20175981%252Fexterior_rear_driver-1774703652403.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_rear_driver-1774703652403.jpg saved to cache
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e4f1764-102b-5832-89c4-e1419592243e
2026-03-29 20:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f666fdca-80af-5bc9-8d02-0ad34ec3f8eb with identifier: 9608672
2026-03-29 20:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f666fdca-80af-5bc9-8d02-0ad34ec3f8eb with scrape type 1
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f666fdca-80af-5bc9-8d02-0ad34ec3f8eb
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8672%252F9608672%252Fexterior_front_driver-1774716187067.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8672/9608672/exterior_front_driver-1774716187067.jpg not downloaded yet
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8672%252F9608672%252Fexterior_rear_driver-1774716151767.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8672/9608672/exterior_rear_driver-1774716151767.jpg not downloaded yet
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16533872.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20307524.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19953302.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41bd0d9d-c365-59a2-a35f-7edebc57ec28 with identifier: 20487398
2026-03-29 20:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41bd0d9d-c365-59a2-a35f-7edebc57ec28 with scrape type 1
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41bd0d9d-c365-59a2-a35f-7edebc57ec28
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F20487398%252Fexterior_front_driver-1774700873767.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/20487398/exterior_front_driver-1774700873767.jpg not downloaded yet
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8672%252F9608672%252Fexterior_front_passenger-1774716119575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8672/9608672/exterior_front_passenger-1774716119575.jpg not downloaded yet
2026-03-29 20:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F20487398%252Fexterior_rear_driver-1774700880486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/20487398/exterior_rear_driver-1774700880486.jpg not downloaded yet
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8672%252F9608672%252Fexterior_rear_passenger-1774716166022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8672/9608672/exterior_rear_passenger-1774716166022.jpg not downloaded yet
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F20487398%252Fexterior_front_passenger-1774700866814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/20487398/exterior_front_passenger-1774700866814.jpg not downloaded yet
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8672%252F9608672%252Finterior_front_seats-1774716823355.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8672/9608672/interior_front_seats-1774716823355.jpg not downloaded yet
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F20487398%252Fexterior_rear_passenger-1774700885173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/20487398/exterior_rear_passenger-1774700885173.jpg not downloaded yet
2026-03-29 20:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91ad784c-c691-5713-b3c3-50283d034100 with identifier: 16533872
2026-03-29 20:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91ad784c-c691-5713-b3c3-50283d034100 with scrape type 1
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91ad784c-c691-5713-b3c3-50283d034100
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3872%252F16533872%252Fexterior_front_driver-1774701338462.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3872/16533872/exterior_front_driver-1774701338462.jpg not downloaded yet
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8672%252F9608672%252Finterior_rear_seats-1774716815599.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8672/9608672/interior_rear_seats-1774716815599.jpg not downloaded yet
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7398%252F20487398%252Finterior_front_seats-1774701104519.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7398/20487398/interior_front_seats-1774701104519.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3872%252F16533872%252Fexterior_rear_driver-1774701368862.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3872/16533872/exterior_rear_driver-1774701368862.jpg not downloaded yet
2026-03-29 20:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e17f355d-801c-5586-8ce1-9cc4c3b510eb with identifier: 20307524
2026-03-29 20:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e17f355d-801c-5586-8ce1-9cc4c3b510eb with scrape type 1
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e17f355d-801c-5586-8ce1-9cc4c3b510eb
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7524%252F20307524%252Fexterior_front_driver-1774109744011.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7524/20307524/exterior_front_driver-1774109744011.jpg not downloaded yet
2026-03-29 20:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65d5091d-c138-5ddd-b4e9-8aac21159e9b with identifier: 19953302
2026-03-29 20:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65d5091d-c138-5ddd-b4e9-8aac21159e9b with scrape type 1
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65d5091d-c138-5ddd-b4e9-8aac21159e9b
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3302%252F19953302%252Fexterior_front_driver-1774714018802.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3302/19953302/exterior_front_driver-1774714018802.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8672%252F9608672%252Finterior_dashboard-1774716832387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8672/9608672/interior_dashboard-1774716832387.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7398%252F20487398%252Finterior_rear_seats-1774701223899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7398/20487398/interior_rear_seats-1774701223899.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3872%252F16533872%252Fexterior_front_passenger-1774701413101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3872/16533872/exterior_front_passenger-1774701413101.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7524%252F20307524%252Fexterior_rear_driver-1774109785013.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7524/20307524/exterior_rear_driver-1774109785013.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3302%252F19953302%252Fexterior_rear_driver-1774700449200.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3302/19953302/exterior_rear_driver-1774700449200.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8672%252F9608672%252Finstrument_cluster-1774777590297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8672/9608672/instrument_cluster-1774777590297.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F20487398%252Finterior_dashboard-1774701110788.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/20487398/interior_dashboard-1774701110788.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3872%252F16533872%252Fexterior_rear_passenger-1774444707200.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3872/16533872/exterior_rear_passenger-1774444707200.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7524%252F20307524%252Fexterior_front_passenger-1774715656668.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7524/20307524/exterior_front_passenger-1774715656668.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3302%252F19953302%252Fexterior_front_passenger-1774700326318.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3302/19953302/exterior_front_passenger-1774700326318.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8672%252F9608672%252Finterior_boot-1774716809848.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8672/9608672/interior_boot-1774716809848.jpg not downloaded yet
2026-03-29 20:06:05 [scrapy.extensions.logstats] INFO: Crawled 253 pages (at 46 pages/min), scraped 139 items (at 22 items/min)
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7398%252F20487398%252Finstrument_cluster-1774701211881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7398/20487398/instrument_cluster-1774701211881.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3872%252F16533872%252Finterior_front_seats-1774703935745.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3872/16533872/interior_front_seats-1774703935745.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7524%252F20307524%252Fexterior_rear_passenger-1774109661444.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7524/20307524/exterior_rear_passenger-1774109661444.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3302%252F19953302%252Fexterior_rear_passenger-1774700378255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3302/19953302/exterior_rear_passenger-1774700378255.jpg not downloaded yet
2026-03-29 20:06:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 309MiB
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8672%252F9608672%252Fdocs_service_history-1774717481914.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3696a29f3d9dbd53b7c75eace5ca0d11%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8672/9608672/docs_service_history-1774717481914.jpg?ixlib=js-3.8.0&auto=format&s=3696a29f3d9dbd53b7c75eace5ca0d11 not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7398%252F20487398%252Finterior_boot-1774701100240.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7398/20487398/interior_boot-1774701100240.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3872%252F16533872%252Finterior_rear_seats-1774704024506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3872/16533872/interior_rear_seats-1774704024506.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7524%252F20307524%252Finterior_front_seats-1774364486694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7524/20307524/interior_front_seats-1774364486694.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3302%252F19953302%252Finterior_front_seats-1774699867894.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3302/19953302/interior_front_seats-1774699867894.jpg not downloaded yet
2026-03-29 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8672/9608672/exterior_front_driver-1774716187067.jpg> (referer: None)
2026-03-29 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1044&page=29&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7398%252F20487398%252Fdocs_service_history-1774701350943.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D318d88814ec046c723b4cdd2786b471f%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7398/20487398/docs_service_history-1774701350943.jpg?ixlib=js-3.8.0&auto=format&s=318d88814ec046c723b4cdd2786b471f not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3872%252F16533872%252Finterior_dashboard-1774702052559.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3872/16533872/interior_dashboard-1774702052559.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7524%252F20307524%252Finterior_rear_seats-1774715417224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7524/20307524/interior_rear_seats-1774715417224.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3302%252F19953302%252Finterior_rear_seats-1774700740421.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3302/19953302/interior_rear_seats-1774700740421.jpg not downloaded yet
2026-03-29 20:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3872%252F16533872%252Finstrument_cluster-1774702114680.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3872/16533872/instrument_cluster-1774702114680.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7524%252F20307524%252Finterior_dashboard-1774715239244.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7524/20307524/interior_dashboard-1774715239244.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3302%252F19953302%252Finterior_dashboard-1774713792659.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3302/19953302/interior_dashboard-1774713792659.jpg not downloaded yet
2026-03-29 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8672/9608672/exterior_rear_driver-1774716151767.jpg> (referer: None)
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3872%252F16533872%252Finterior_boot-1774702112822.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3872/16533872/interior_boot-1774702112822.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7524%252F20307524%252Finterior_boot-1774715859309.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7524/20307524/interior_boot-1774715859309.jpg not downloaded yet
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3302%252F19953302%252Finstrument_cluster-1774699934258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3302/19953302/instrument_cluster-1774699934258.jpg not downloaded yet
2026-03-29 20:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa09610>
2026-03-29 20:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f666fdca-80af-5bc9-8d02-0ad34ec3f8eb/f666fdca-80af-5bc9-8d02-0ad34ec3f8eb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8672%252F9608672%252Fexterior_front_driver-1774716187067.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8672/9608672/exterior_front_driver-1774716187067.jpg saved to cache
2026-03-29 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f666fdca-80af-5bc9-8d02-0ad34ec3f8eb
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20481167
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 11262426
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 19102337
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719102337%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [motorway.uk] INFO: Scrape type for 19102337: 1
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3872%252F16533872%252Fdocs_service_history-1774703471130.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D38ec2425945d21075b44c0c327f832fa%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3872/16533872/docs_service_history-1774703471130.jpg?ixlib=js-3.8.0&auto=format&s=38ec2425945d21075b44c0c327f832fa not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7524%252F20307524%252Fdocs_service_history-1774429104078.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3cb563f848f35152abc2de945168a624%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7524/20307524/docs_service_history-1774429104078.jpg?ixlib=js-3.8.0&auto=format&s=3cb563f848f35152abc2de945168a624 not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3302%252F19953302%252Finterior_boot-1774700020741.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3302/19953302/interior_boot-1774700020741.jpg not downloaded yet
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20421191
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20228423
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20365167
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 16886677
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20489690
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 5776267
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20487109
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20254081
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 18038036
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20473354
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473354%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [motorway.uk] INFO: Scrape type for 20473354: 1
2026-03-29 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8408/20478408/instrument_cluster-1774700755614.jpg> (referer: None)
2026-03-29 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20422592.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f961b650>
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f666fdca-80af-5bc9-8d02-0ad34ec3f8eb/f666fdca-80af-5bc9-8d02-0ad34ec3f8eb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8672%252F9608672%252Fexterior_rear_driver-1774716151767.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8672/9608672/exterior_rear_driver-1774716151767.jpg saved to cache
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f666fdca-80af-5bc9-8d02-0ad34ec3f8eb
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7524%252F20307524%252Fdocs_service_history-1774429315694.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D03acd5f8aeb325efc120161f459cbd71%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7524/20307524/docs_service_history-1774429315694.jpg?ixlib=js-3.8.0&auto=format&s=03acd5f8aeb325efc120161f459cbd71 not downloaded yet
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3302%252F19953302%252Fdocs_service_history-1774711845445.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8da2109d097d21e85f1e9de83e0ff17a%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3302/19953302/docs_service_history-1774711845445.jpg?ixlib=js-3.8.0&auto=format&s=8da2109d097d21e85f1e9de83e0ff17a not downloaded yet
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20172363
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20323228
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20486197
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486197%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [motorway.uk] INFO: Scrape type for 20486197: 1
2026-03-29 20:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19838996.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 16378604
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716378604%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [motorway.uk] INFO: Scrape type for 16378604: 1
2026-03-29 20:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20456017
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 17631330
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717631330%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [motorway.uk] INFO: Scrape type for 17631330: 1
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabc3590>
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2370e387-ca8d-59d7-950e-da0d9998bc4b/2370e387-ca8d-59d7-950e-da0d9998bc4b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8408%252F20478408%252Finstrument_cluster-1774700755614.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8408/20478408/instrument_cluster-1774700755614.jpg saved to cache
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2370e387-ca8d-59d7-950e-da0d9998bc4b
2026-03-29 20:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d71d4c7-49c7-5791-bb7e-a55f7c1f1885 with identifier: 20422592
2026-03-29 20:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d71d4c7-49c7-5791-bb7e-a55f7c1f1885 with scrape type 1
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d71d4c7-49c7-5791-bb7e-a55f7c1f1885
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2592%252F20422592%252Fexterior_front_driver-1774358262884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2592/20422592/exterior_front_driver-1774358262884.jpg not downloaded yet
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 12503630
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 19805155
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20484488
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 19543159
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 11178434
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20434695
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20490377
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20488936
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 20484850
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484850%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [motorway.uk] INFO: Scrape type for 20484850: 1
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2592%252F20422592%252Fexterior_rear_driver-1774358256905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2592/20422592/exterior_rear_driver-1774358256905.jpg not downloaded yet
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 19905225
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 18671000
2026-03-29 20:06:06 [motorway.uk] INFO: Found listing with ID: 15950437
2026-03-29 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715950437%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [motorway.uk] INFO: Scrape type for 15950437: 1
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2592%252F20422592%252Fexterior_front_passenger-1774358270278.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2592/20422592/exterior_front_passenger-1774358270278.jpg not downloaded yet
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 12936291
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712936291%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [motorway.uk] INFO: Scrape type for 12936291: 1
2026-03-29 20:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df92eb44-2939-5048-a481-b52541c82508 with identifier: 19838996
2026-03-29 20:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df92eb44-2939-5048-a481-b52541c82508 with scrape type 1
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df92eb44-2939-5048-a481-b52541c82508
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8996%252F19838996%252Fexterior_front_driver-1774718123719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8996/19838996/exterior_front_driver-1774718123719.jpg not downloaded yet
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2592%252F20422592%252Fexterior_rear_passenger-1774358278979.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2592/20422592/exterior_rear_passenger-1774358278979.jpg not downloaded yet
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 19919784
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719919784%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [motorway.uk] INFO: Scrape type for 19919784: 1
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8996%252F19838996%252Fexterior_rear_driver-1774717966451.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8996/19838996/exterior_rear_driver-1774717966451.jpg not downloaded yet
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2592%252F20422592%252Finterior_front_seats-1774359209320.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2592/20422592/interior_front_seats-1774359209320.jpg not downloaded yet
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 20285746
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 20473072
2026-03-29 20:06:07 [motorway.uk] INFO: Found listing with ID: 19988748
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8996%252F19838996%252Fexterior_front_passenger-1774718001327.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8996/19838996/exterior_front_passenger-1774718001327.jpg not downloaded yet
2026-03-29 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_front_driver-1774703619027.jpg> (referer: None)
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2592%252F20422592%252Finterior_rear_seats-1774359181608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2592/20422592/interior_rear_seats-1774359181608.jpg not downloaded yet
2026-03-29 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8672/9608672/docs_service_history-1774717481914.jpg?ixlib=js-3.8.0&auto=format&s=3696a29f3d9dbd53b7c75eace5ca0d11> (referer: None)
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8996%252F19838996%252Fexterior_rear_passenger-1774718303022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8996/19838996/exterior_rear_passenger-1774718303022.jpg not downloaded yet
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2592%252F20422592%252Finterior_dashboard-1774359197293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2592/20422592/interior_dashboard-1774359197293.jpg not downloaded yet
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8996%252F19838996%252Finterior_front_seats-1774718659499.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8996/19838996/interior_front_seats-1774718659499.jpg not downloaded yet
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2592%252F20422592%252Finstrument_cluster-1774359304415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2592/20422592/instrument_cluster-1774359304415.jpg not downloaded yet
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8996%252F19838996%252Finterior_rear_seats-1774718673915.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8996/19838996/interior_rear_seats-1774718673915.jpg not downloaded yet
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2592%252F20422592%252Finterior_boot-1774358932644.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2592/20422592/interior_boot-1774358932644.jpg not downloaded yet
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8996%252F19838996%252Finterior_dashboard-1774718702623.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8996/19838996/interior_dashboard-1774718702623.jpg not downloaded yet
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2592%252F20422592%252Fdocs_service_history-1774359429276.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7b63bbf9926bc093cbe86d8d70d8b214%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2592/20422592/docs_service_history-1774359429276.jpg?ixlib=js-3.8.0&auto=format&s=7b63bbf9926bc093cbe86d8d70d8b214 not downloaded yet
2026-03-29 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18016902.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e48350>
2026-03-29 20:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5981%252F20175981%252Fexterior_front_driver-1774703619027.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_front_driver-1774703619027.jpg saved to cache
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e4f1764-102b-5832-89c4-e1419592243e
2026-03-29 20:06:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e4f1764-102b-5832-89c4-e1419592243e, skipping ID generation
2026-03-29 20:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e4f1764-102b-5832-89c4-e1419592243e with scrape type 1
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e4f1764-102b-5832-89c4-e1419592243e sending to next pipeline
2026-03-29 20:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2e4f1764-102b-5832-89c4-e1419592243e, identifier: 20175981
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8996%252F19838996%252Finstrument_cluster-1774718750330.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8996/19838996/instrument_cluster-1774718750330.jpg not downloaded yet
2026-03-29 20:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2e4f1764-102b-5832-89c4-e1419592243e with identifier: 20175981
2026-03-29 20:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2e4f1764-102b-5832-89c4-e1419592243e with identifier: 20175981
2026-03-29 20:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2e4f1764-102b-5832-89c4-e1419592243e with identifier: 20175981 to the API
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_front_driver-1774703619027.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '2e4f1764-102b-5832-89c4-e1419592243e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AF71 MXO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20175981',
'listing': 'auction',
'location': 'North Lincolnshire Doncaster',
'make': 'BMW',
'model': '3 Series',
'odometer': 47200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2655205,
'Height': 2850,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_front_driver-1774703619027.jpg',
'Width': 3800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2268248,
'Height': 2960,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_rear_driver-1774703652403.jpg',
'Width': 3947},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3035175,
'Height': 2843,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_front_passenger-1774703687719.jpg',
'Width': 3790},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2485684,
'Height': 2717,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5981/20175981/exterior_rear_passenger-1774703666914.jpg',
'Width': 3623},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2426886,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5981/20175981/interior_front_seats-1774704258943.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2326438,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5981/20175981/interior_rear_seats-1774704276804.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3134810,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5981/20175981/interior_dashboard-1774704312430.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1214027,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5981/20175981/instrument_cluster-1774704356200.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3149502,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5981/20175981/interior_boot-1774704313892.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4f1764-102b-5832-89c4-e1419592243e/2e4f1764-102b-5832-89c4-e1419592243e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 608107,
'Height': 3005,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5981/20175981/docs_service_history-1774704590789.jpg?ixlib=js-3.8.0&auto=format&s=76fabb3da67f7dde76c363cf17a4995a',
'Width': 2039}],
'price': 18088,
'price_includes_vat': False,
'registration_date': '2021-09-16',
'seats_number': None,
'seller_name': None,
'title': 'BMW 330E M Sport Auto',
'transmission': 'automatic',
'trim': '330E M Sport Auto',
'vin': 'WBA5P52040FL70146',
'year': 2021}
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720175981%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [motorway.uk] INFO: Saving data for 20175981: {'created_time': 1774814768.101543, 'last_price_update_time': 1774814768.101558, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20175981') HTTP/1.1" 204 0
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84ca550>
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f666fdca-80af-5bc9-8d02-0ad34ec3f8eb/f666fdca-80af-5bc9-8d02-0ad34ec3f8eb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8672%252F9608672%252Fdocs_service_history-1774717481914.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3696a29f3d9dbd53b7c75eace5ca0d11') HTTP/1.1" 204 0
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8672/9608672/docs_service_history-1774717481914.jpg?ixlib=js-3.8.0&auto=format&s=3696a29f3d9dbd53b7c75eace5ca0d11 saved to cache
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f666fdca-80af-5bc9-8d02-0ad34ec3f8eb
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8996%252F19838996%252Finterior_boot-1774718709957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8996/19838996/interior_boot-1774718709957.jpg not downloaded yet
2026-03-29 20:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ba3247a-6dcb-539b-b1a2-09b74e91cc78 with identifier: 18016902
2026-03-29 20:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ba3247a-6dcb-539b-b1a2-09b74e91cc78 with scrape type 1
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ba3247a-6dcb-539b-b1a2-09b74e91cc78
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6902%252F18016902%252Fexterior_front_driver-1774783269321.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6902/18016902/exterior_front_driver-1774783269321.jpg not downloaded yet
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8996%252F19838996%252Fdocs_service_history-1774719075725.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D40aa687959e3158f5c851cdcf62a5163%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8996/19838996/docs_service_history-1774719075725.jpg?ixlib=js-3.8.0&auto=format&s=40aa687959e3158f5c851cdcf62a5163 not downloaded yet
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6902%252F18016902%252Fexterior_rear_driver-1774783302350.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6902/18016902/exterior_rear_driver-1774783302350.jpg not downloaded yet
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6902%252F18016902%252Fexterior_front_passenger-1774783279213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6902/18016902/exterior_front_passenger-1774783279213.jpg not downloaded yet
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8408/20478408/interior_boot-1774700846018.jpg> (referer: None)
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6902%252F18016902%252Fexterior_rear_passenger-1774783291262.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6902/18016902/exterior_rear_passenger-1774783291262.jpg not downloaded yet
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6902%252F18016902%252Finterior_front_seats-1774783316100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6902/18016902/interior_front_seats-1774783316100.jpg not downloaded yet
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20194798.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6902%252F18016902%252Finterior_rear_seats-1774783351107.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6902/18016902/interior_rear_seats-1774783351107.jpg not downloaded yet
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20377284.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20165611.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13327562.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489798.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6902%252F18016902%252F18016902-interior_dashboard-default-1774787623471.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6902/18016902/18016902-interior_dashboard-default-1774787623471.jpg not downloaded yet
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85e2050>
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2370e387-ca8d-59d7-950e-da0d9998bc4b/2370e387-ca8d-59d7-950e-da0d9998bc4b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8408%252F20478408%252Finterior_boot-1774700846018.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8408/20478408/interior_boot-1774700846018.jpg saved to cache
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2370e387-ca8d-59d7-950e-da0d9998bc4b
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6902%252F18016902%252Finterior_boot-1774783375729.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6902/18016902/interior_boot-1774783375729.jpg not downloaded yet
2026-03-29 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19102337.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6902%252F18016902%252Fdocs_service_history-1774784705297.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0c64542240e685145b294d35c941e206%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6902/18016902/docs_service_history-1774784705297.jpg?ixlib=js-3.8.0&auto=format&s=0c64542240e685145b294d35c941e206 not downloaded yet
2026-03-29 20:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08f27759-068e-501a-ad9d-07bf55ada4ed with identifier: 20194798
2026-03-29 20:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08f27759-068e-501a-ad9d-07bf55ada4ed with scrape type 1
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08f27759-068e-501a-ad9d-07bf55ada4ed
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4798%252F20194798%252Fexterior_front_driver-1774626491241.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4798/20194798/exterior_front_driver-1774626491241.jpg not downloaded yet
2026-03-29 20:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64a01ae7-eb1e-59a2-943c-a49cdf9b4fe5 with identifier: 20377284
2026-03-29 20:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64a01ae7-eb1e-59a2-943c-a49cdf9b4fe5 with scrape type 1
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64a01ae7-eb1e-59a2-943c-a49cdf9b4fe5
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7284%252F20377284%252Fexterior_front_driver-1774716781690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7284/20377284/exterior_front_driver-1774716781690.jpg not downloaded yet
2026-03-29 20:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48a6423b-7891-54df-a60c-4f399b71caf7 with identifier: 20165611
2026-03-29 20:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48a6423b-7891-54df-a60c-4f399b71caf7 with scrape type 2
2026-03-29 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48a6423b-7891-54df-a60c-4f399b71caf7 with scrape type 2
2026-03-29 20:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 48a6423b-7891-54df-a60c-4f399b71caf7, identifier: 20165611
2026-03-29 20:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dd89cd8-ff15-5c30-9cee-67e4192fc1a9 with identifier: 13327562
2026-03-29 20:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dd89cd8-ff15-5c30-9cee-67e4192fc1a9 with scrape type 1
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7dd89cd8-ff15-5c30-9cee-67e4192fc1a9
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7562%252F13327562%252Fexterior_front_driver-1774713746024.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7562/13327562/exterior_front_driver-1774713746024.jpg not downloaded yet
2026-03-29 20:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ced0e43c-ec16-5cd5-9bd2-d39316c677d0 with identifier: 20489798
2026-03-29 20:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ced0e43c-ec16-5cd5-9bd2-d39316c677d0 with scrape type 1
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ced0e43c-ec16-5cd5-9bd2-d39316c677d0
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9798%252F20489798%252Fexterior_front_driver-1774771755779.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9798/20489798/exterior_front_driver-1774771755779.jpg not downloaded yet
2026-03-29 20:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 48a6423b-7891-54df-a60c-4f399b71caf7 with identifier: 20165611
2026-03-29 20:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 48a6423b-7891-54df-a60c-4f399b71caf7 with identifier: 20165611
2026-03-29 20:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 48a6423b-7891-54df-a60c-4f399b71caf7 with identifier: 20165611 to the API
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20165611.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '48a6423b-7891-54df-a60c-4f399b71caf7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WJ66 YAX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20165611',
'listing': 'auction',
'location': 'Somerset Taunton',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 17308,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 9707,
'price_includes_vat': False,
'registration_date': '2016-09-28',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Yaris Icon VVT-i CVT',
'transmission': 'automatic',
'trim': 'Icon VVT-i CVT',
'vin': 'VNKKJ3D300A382690',
'year': 2016}
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720165611%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [motorway.uk] INFO: Saving data for 20165611: {'auction_closing_time': 1774884600.0, 'created_time': 1774383138.71306, 'last_price_update_time': 1774814769.447686}
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20165611') HTTP/1.1" 204 0
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6902%252F18016902%252Fdocs_service_history-1774784710301.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9fca14d01f05947f0b83dc5237eb247c%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6902/18016902/docs_service_history-1774784710301.jpg?ixlib=js-3.8.0&auto=format&s=9fca14d01f05947f0b83dc5237eb247c not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4798%252F20194798%252Fexterior_rear_driver-1774626605877.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4798/20194798/exterior_rear_driver-1774626605877.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7284%252F20377284%252Fexterior_rear_driver-1774778738467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7284/20377284/exterior_rear_driver-1774778738467.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7562%252F13327562%252Fexterior_rear_driver-1774713778313.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7562/13327562/exterior_rear_driver-1774713778313.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9798%252F20489798%252Fexterior_rear_driver-1774774622104.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9798/20489798/exterior_rear_driver-1774774622104.jpg not downloaded yet
2026-03-29 20:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3abced4-115f-53d4-b143-19a48272b304 with identifier: 19102337
2026-03-29 20:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3abced4-115f-53d4-b143-19a48272b304 with scrape type 1
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3abced4-115f-53d4-b143-19a48272b304
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2337%252F19102337%252Fexterior_front_driver-1774195124270.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2337/19102337/exterior_front_driver-1774195124270.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4798%252F20194798%252Fexterior_front_passenger-1774626636938.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4798/20194798/exterior_front_passenger-1774626636938.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7284%252F20377284%252Fexterior_front_passenger-1774716823709.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7284/20377284/exterior_front_passenger-1774716823709.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7562%252F13327562%252Fexterior_front_passenger-1774713809077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7562/13327562/exterior_front_passenger-1774713809077.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9798%252F20489798%252Fexterior_front_passenger-1774771831466.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9798/20489798/exterior_front_passenger-1774771831466.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2337%252F19102337%252Fexterior_rear_driver-1774195179229.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2337/19102337/exterior_rear_driver-1774195179229.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4798%252F20194798%252Fexterior_rear_passenger-1774626615172.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4798/20194798/exterior_rear_passenger-1774626615172.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7284%252F20377284%252Fexterior_rear_passenger-1774716810122.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7284/20377284/exterior_rear_passenger-1774716810122.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7562%252F13327562%252Fexterior_rear_passenger-1774713793613.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7562/13327562/exterior_rear_passenger-1774713793613.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9798%252F20489798%252Fexterior_rear_passenger-1774771764291.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9798/20489798/exterior_rear_passenger-1774771764291.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2337%252F19102337%252Fexterior_front_passenger-1774195246170.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2337/19102337/exterior_front_passenger-1774195246170.jpg not downloaded yet
2026-03-29 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6902/18016902/exterior_front_passenger-1774783279213.jpg> (referer: None)
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4798%252F20194798%252Finterior_front_seats-1774627389329.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4798/20194798/interior_front_seats-1774627389329.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7284%252F20377284%252Finterior_front_seats-1774717199373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7284/20377284/interior_front_seats-1774717199373.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7562%252F13327562%252Finterior_front_seats-1774714572353.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7562/13327562/interior_front_seats-1774714572353.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9798%252F20489798%252Finterior_front_seats-1774772527421.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9798/20489798/interior_front_seats-1774772527421.jpg not downloaded yet
2026-03-29 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17331311.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2337%252F19102337%252Fexterior_rear_passenger-1774195197798.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2337/19102337/exterior_rear_passenger-1774195197798.jpg not downloaded yet
2026-03-29 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6902/18016902/exterior_rear_passenger-1774783291262.jpg> (referer: None)
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4798%252F20194798%252Finterior_rear_seats-1774627616088.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4798/20194798/interior_rear_seats-1774627616088.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7284%252F20377284%252Finterior_rear_seats-1774717217074.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7284/20377284/interior_rear_seats-1774717217074.jpg not downloaded yet
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7562%252F13327562%252Finterior_rear_seats-1774714934313.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7562/13327562/interior_rear_seats-1774714934313.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9798%252F20489798%252Finterior_rear_seats-1774772650142.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9798/20489798/interior_rear_seats-1774772650142.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2337%252F19102337%252Finterior_front_seats-1774196352795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2337/19102337/interior_front_seats-1774196352795.jpg not downloaded yet
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f35290>
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ba3247a-6dcb-539b-b1a2-09b74e91cc78/9ba3247a-6dcb-539b-b1a2-09b74e91cc78_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6902%252F18016902%252Fexterior_front_passenger-1774783279213.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6902/18016902/exterior_front_passenger-1774783279213.jpg saved to cache
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ba3247a-6dcb-539b-b1a2-09b74e91cc78
2026-03-29 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8996/19838996/exterior_front_passenger-1774718001327.jpg> (referer: None)
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4798%252F20194798%252Finterior_dashboard-1774627669040.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4798/20194798/interior_dashboard-1774627669040.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7284%252F20377284%252Finterior_dashboard-1774778722905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7284/20377284/interior_dashboard-1774778722905.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7562%252F13327562%252Finterior_dashboard-1774714616442.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7562/13327562/interior_dashboard-1774714616442.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9798%252F20489798%252Finterior_dashboard-1774772543831.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9798/20489798/interior_dashboard-1774772543831.jpg not downloaded yet
2026-03-29 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3302/19953302/interior_dashboard-1774713792659.jpg> (referer: None)
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2337%252F19102337%252Finterior_rear_seats-1774196403706.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2337/19102337/interior_rear_seats-1774196403706.jpg not downloaded yet
2026-03-29 20:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3 with identifier: 17331311
2026-03-29 20:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3 with scrape type 1
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1311%252F17331311%252Fexterior_front_driver-1774787417267.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1311/17331311/exterior_front_driver-1774787417267.jpg not downloaded yet
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96294d0>
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ba3247a-6dcb-539b-b1a2-09b74e91cc78/9ba3247a-6dcb-539b-b1a2-09b74e91cc78_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6902%252F18016902%252Fexterior_rear_passenger-1774783291262.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6902/18016902/exterior_rear_passenger-1774783291262.jpg saved to cache
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ba3247a-6dcb-539b-b1a2-09b74e91cc78
2026-03-29 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6902/18016902/exterior_rear_driver-1774783302350.jpg> (referer: None)
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4798%252F20194798%252Finstrument_cluster-1774627393861.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4798/20194798/instrument_cluster-1774627393861.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7284%252F20377284%252Finterior_boot-1774717257938.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7284/20377284/interior_boot-1774717257938.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7562%252F13327562%252Finstrument_cluster-1774715024078.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7562/13327562/instrument_cluster-1774715024078.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9798%252F20489798%252Finstrument_cluster-1774772484385.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9798/20489798/instrument_cluster-1774772484385.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2337%252F19102337%252Finterior_dashboard-1774196457329.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2337/19102337/interior_dashboard-1774196457329.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1311%252F17331311%252Fexterior_rear_driver-1774787428064.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1311/17331311/exterior_rear_driver-1774787428064.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4798%252F20194798%252Finterior_boot-1774627681021.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4798/20194798/interior_boot-1774627681021.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7284%252F20377284%252Fdocs_service_history-1774717645938.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4d58d9df584d7511d77efb8493cc0145%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7284/20377284/docs_service_history-1774717645938.jpg?ixlib=js-3.8.0&auto=format&s=4d58d9df584d7511d77efb8493cc0145 not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7562%252F13327562%252Finterior_boot-1774714679940.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7562/13327562/interior_boot-1774714679940.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9798%252F20489798%252Finterior_boot-1774772525909.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9798/20489798/interior_boot-1774772525909.jpg not downloaded yet
2026-03-29 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1080&page=30&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f953eed0>
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df92eb44-2939-5048-a481-b52541c82508/df92eb44-2939-5048-a481-b52541c82508_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8996%252F19838996%252Fexterior_front_passenger-1774718001327.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8996/19838996/exterior_front_passenger-1774718001327.jpg saved to cache
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df92eb44-2939-5048-a481-b52541c82508
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9524cd0>
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65d5091d-c138-5ddd-b4e9-8aac21159e9b/65d5091d-c138-5ddd-b4e9-8aac21159e9b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3302%252F19953302%252Finterior_dashboard-1774713792659.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3302/19953302/interior_dashboard-1774713792659.jpg saved to cache
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65d5091d-c138-5ddd-b4e9-8aac21159e9b
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2337%252F19102337%252Finstrument_cluster-1774196438184.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2337/19102337/instrument_cluster-1774196438184.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1311%252F17331311%252Fexterior_front_passenger-1774787452426.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1311/17331311/exterior_front_passenger-1774787452426.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4798%252F20194798%252Fdocs_service_history-1774628093814.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd2be5152c0693f8f28aa6e9b969c903a%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4798/20194798/docs_service_history-1774628093814.jpg?ixlib=js-3.8.0&auto=format&s=d2be5152c0693f8f28aa6e9b969c903a not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7284%252F20377284%252Fdocs_service_history-1774717647451.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5808b2c556090bda2165a7420ce8ab51%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7284/20377284/docs_service_history-1774717647451.jpg?ixlib=js-3.8.0&auto=format&s=5808b2c556090bda2165a7420ce8ab51 not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7562%252F13327562%252Fdamage_scratches-1774713896775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7562/13327562/damage_scratches-1774713896775.jpg not downloaded yet
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9798%252F20489798%252Fdocs_service_history-1774774575063.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1614ac74005455691e731b5537c4e439%27 HTTP/1.1" 200 None
2026-03-29 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9798/20489798/docs_service_history-1774774575063.jpg?ixlib=js-3.8.0&auto=format&s=1614ac74005455691e731b5537c4e439 not downloaded yet
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88d46d0>
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ba3247a-6dcb-539b-b1a2-09b74e91cc78/9ba3247a-6dcb-539b-b1a2-09b74e91cc78_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6902%252F18016902%252Fexterior_rear_driver-1774783302350.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6902/18016902/exterior_rear_driver-1774783302350.jpg saved to cache
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ba3247a-6dcb-539b-b1a2-09b74e91cc78
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2337%252F19102337%252Finterior_boot-1774196498567.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2337/19102337/interior_boot-1774196498567.jpg not downloaded yet
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1311%252F17331311%252Fexterior_rear_passenger-1774787442940.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1311/17331311/exterior_rear_passenger-1774787442940.jpg not downloaded yet
2026-03-29 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8408/20478408/docs_service_history-1774701283810.jpg?ixlib=js-3.8.0&auto=format&s=838ae3926e91386ddc10edbd27ab30be> (referer: None)
2026-03-29 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3302/19953302/interior_front_seats-1774699867894.jpg> (referer: None)
2026-03-29 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20473354.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20500109
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20492540
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 4255654
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20381378
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 19391206
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 12889821
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 2216003
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20466618
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20454779
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20175346
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20488633
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20418638
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20394387
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20484190
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484190%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 20484190: 1
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2337%252F19102337%252Fdocs_service_history-1774701640091.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De68894af337013d622875dcdb78d63f5%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2337/19102337/docs_service_history-1774701640091.jpg?ixlib=js-3.8.0&auto=format&s=e68894af337013d622875dcdb78d63f5 not downloaded yet
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1311%252F17331311%252Finterior_front_seats-1774788003474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1311/17331311/interior_front_seats-1774788003474.jpg not downloaded yet
2026-03-29 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6902/18016902/interior_rear_seats-1774783351107.jpg> (referer: None)
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20488957
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488957%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 20488957: 1
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1311%252F17331311%252Finterior_rear_seats-1774787922271.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1311/17331311/interior_rear_seats-1774787922271.jpg not downloaded yet
2026-03-29 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6902/18016902/interior_front_seats-1774783316100.jpg> (referer: None)
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20381560
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20490401
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 19925842
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20301602
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20482735
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20445456
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 17007661
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 16212102
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 3155170
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273155170%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 3155170: 1
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1311%252F17331311%252Finterior_dashboard-1774796849721.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1311/17331311/interior_dashboard-1774796849721.jpg not downloaded yet
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20438840
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720438840%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 20438840: 1
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9533890>
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2370e387-ca8d-59d7-950e-da0d9998bc4b/2370e387-ca8d-59d7-950e-da0d9998bc4b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8408%252F20478408%252Fdocs_service_history-1774701283810.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D838ae3926e91386ddc10edbd27ab30be') HTTP/1.1" 204 0
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8408/20478408/docs_service_history-1774701283810.jpg?ixlib=js-3.8.0&auto=format&s=838ae3926e91386ddc10edbd27ab30be saved to cache
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2370e387-ca8d-59d7-950e-da0d9998bc4b
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f91e6dd0>
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65d5091d-c138-5ddd-b4e9-8aac21159e9b/65d5091d-c138-5ddd-b4e9-8aac21159e9b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3302%252F19953302%252Finterior_front_seats-1774699867894.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3302/19953302/interior_front_seats-1774699867894.jpg saved to cache
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65d5091d-c138-5ddd-b4e9-8aac21159e9b
2026-03-29 20:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52c5590b-eb28-5960-8cbc-5da529f910fb with identifier: 20473354
2026-03-29 20:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52c5590b-eb28-5960-8cbc-5da529f910fb with scrape type 1
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 52c5590b-eb28-5960-8cbc-5da529f910fb
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3354%252F20473354%252Fexterior_front_driver-1774621139984.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_front_driver-1774621139984.jpg not downloaded yet
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1311%252F17331311%252Finstrument_cluster-1774787937025.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1311/17331311/instrument_cluster-1774787937025.jpg not downloaded yet
2026-03-29 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6902/18016902/18016902-interior_dashboard-default-1774787623471.jpg> (referer: None)
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20141953
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 18015367
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 3408584
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20257689
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20465447
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20172367
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720172367%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 20172367: 1
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3354%252F20473354%252Fexterior_rear_driver-1774621148194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_rear_driver-1774621148194.jpg not downloaded yet
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1311%252F17331311%252Finterior_boot-1774796853881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1311/17331311/interior_boot-1774796853881.jpg not downloaded yet
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 19146005
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 10030504
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20428748
2026-03-29 20:06:11 [motorway.uk] INFO: Found listing with ID: 20494737
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720494737%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [motorway.uk] INFO: Scrape type for 20494737: 1
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3354%252F20473354%252Fexterior_front_passenger-1774621207859.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_front_passenger-1774621207859.jpg not downloaded yet
2026-03-29 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6902/18016902/interior_boot-1774783375729.jpg> (referer: None)
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1311%252F17331311%252Fdocs_service_history-1774788476766.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9ebb15d6ba733ef7abecd2163406e94e%27 HTTP/1.1" 200 None
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1311/17331311/docs_service_history-1774788476766.jpg?ixlib=js-3.8.0&auto=format&s=9ebb15d6ba733ef7abecd2163406e94e not downloaded yet
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95c0350>
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ba3247a-6dcb-539b-b1a2-09b74e91cc78/9ba3247a-6dcb-539b-b1a2-09b74e91cc78_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6902%252F18016902%252Finterior_rear_seats-1774783351107.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6902/18016902/interior_rear_seats-1774783351107.jpg saved to cache
2026-03-29 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ba3247a-6dcb-539b-b1a2-09b74e91cc78
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebed6750>
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ba3247a-6dcb-539b-b1a2-09b74e91cc78/9ba3247a-6dcb-539b-b1a2-09b74e91cc78_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6902%252F18016902%252Finterior_front_seats-1774783316100.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6902/18016902/interior_front_seats-1774783316100.jpg saved to cache
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ba3247a-6dcb-539b-b1a2-09b74e91cc78
2026-03-29 20:06:12 [motorway.uk] INFO: Found listing with ID: 20445682
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720445682%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [motorway.uk] INFO: Scrape type for 20445682: 1
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3354%252F20473354%252Fexterior_rear_passenger-1774621154455.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_rear_passenger-1774621154455.jpg not downloaded yet
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c7d310>
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ba3247a-6dcb-539b-b1a2-09b74e91cc78/9ba3247a-6dcb-539b-b1a2-09b74e91cc78_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6902%252F18016902%252F18016902-interior_dashboard-default-1774787623471.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6902/18016902/18016902-interior_dashboard-default-1774787623471.jpg saved to cache
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ba3247a-6dcb-539b-b1a2-09b74e91cc78
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3354%252F20473354%252Finterior_front_seats-1774621807022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3354/20473354/interior_front_seats-1774621807022.jpg not downloaded yet
2026-03-29 20:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2337/19102337/exterior_front_passenger-1774195246170.jpg> (referer: None)
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84f7a90>
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ba3247a-6dcb-539b-b1a2-09b74e91cc78/9ba3247a-6dcb-539b-b1a2-09b74e91cc78_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6902%252F18016902%252Finterior_boot-1774783375729.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6902/18016902/interior_boot-1774783375729.jpg saved to cache
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ba3247a-6dcb-539b-b1a2-09b74e91cc78
2026-03-29 20:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3354%252F20473354%252Finterior_rear_seats-1774621824077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3354/20473354/interior_rear_seats-1774621824077.jpg not downloaded yet
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9798/20489798/exterior_rear_passenger-1774771764291.jpg> (referer: None)
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3354%252F20473354%252Finterior_dashboard-1774621934269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3354/20473354/interior_dashboard-1774621934269.jpg not downloaded yet
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f960d890>
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3abced4-115f-53d4-b143-19a48272b304/a3abced4-115f-53d4-b143-19a48272b304_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2337%252F19102337%252Fexterior_front_passenger-1774195246170.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2337/19102337/exterior_front_passenger-1774195246170.jpg saved to cache
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3abced4-115f-53d4-b143-19a48272b304
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3354%252F20473354%252Finstrument_cluster-1774688464568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3354/20473354/instrument_cluster-1774688464568.jpg not downloaded yet
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486197.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3354%252F20473354%252Finterior_boot-1774621897457.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3354/20473354/interior_boot-1774621897457.jpg not downloaded yet
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f51e50>
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced0e43c-ec16-5cd5-9bd2-d39316c677d0/ced0e43c-ec16-5cd5-9bd2-d39316c677d0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9798%252F20489798%252Fexterior_rear_passenger-1774771764291.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9798/20489798/exterior_rear_passenger-1774771764291.jpg saved to cache
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ced0e43c-ec16-5cd5-9bd2-d39316c677d0
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3354%252F20473354%252Fdocs_service_history-1774622092763.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd1b5e1f94d2e44791597b22038f082da%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3354/20473354/docs_service_history-1774622092763.jpg?ixlib=js-3.8.0&auto=format&s=d1b5e1f94d2e44791597b22038f082da not downloaded yet
2026-03-29 20:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6ddb0bb-3281-59bc-9bd7-c7ff726710d0 with identifier: 20486197
2026-03-29 20:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0 with scrape type 1
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6197%252F20486197%252Fexterior_front_driver-1774700352382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_front_driver-1774700352382.jpg not downloaded yet
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6197%252F20486197%252Fexterior_rear_driver-1774700357790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_rear_driver-1774700357790.jpg not downloaded yet
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6197%252F20486197%252Fexterior_front_passenger-1774700357410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_front_passenger-1774700357410.jpg not downloaded yet
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8996/19838996/interior_boot-1774718709957.jpg> (referer: None)
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6197%252F20486197%252Fexterior_rear_passenger-1774700364853.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_rear_passenger-1774700364853.jpg not downloaded yet
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1311/17331311/exterior_front_passenger-1774787452426.jpg> (referer: None)
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6197%252F20486197%252Finterior_front_seats-1774699887548.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6197/20486197/interior_front_seats-1774699887548.jpg not downloaded yet
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9798/20489798/interior_front_seats-1774772527421.jpg> (referer: None)
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6197%252F20486197%252Finterior_rear_seats-1774699935362.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6197/20486197/interior_rear_seats-1774699935362.jpg not downloaded yet
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9798/20489798/interior_boot-1774772525909.jpg> (referer: None)
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_rear_passenger-1774621154455.jpg> (referer: None)
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_rear_driver-1774621148194.jpg> (referer: None)
2026-03-29 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_front_passenger-1774621207859.jpg> (referer: None)
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6197%252F20486197%252Finterior_dashboard-1774700020585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6197/20486197/interior_dashboard-1774700020585.jpg not downloaded yet
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6197%252F20486197%252Finstrument_cluster-1774699995472.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6197/20486197/instrument_cluster-1774699995472.jpg not downloaded yet
2026-03-29 20:06:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f76790>
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df92eb44-2939-5048-a481-b52541c82508/df92eb44-2939-5048-a481-b52541c82508_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8996%252F19838996%252Finterior_boot-1774718709957.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8996/19838996/interior_boot-1774718709957.jpg saved to cache
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df92eb44-2939-5048-a481-b52541c82508
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6197%252F20486197%252Finterior_boot-1774699977324.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6197/20486197/interior_boot-1774699977324.jpg not downloaded yet
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8214790>
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3/ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1311%252F17331311%252Fexterior_front_passenger-1774787452426.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1311/17331311/exterior_front_passenger-1774787452426.jpg saved to cache
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6197%252F20486197%252Fdocs_service_history-1774701456161.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D342b3138e7428cdb550c40450b142eab%27 HTTP/1.1" 200 None
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6197/20486197/docs_service_history-1774701456161.jpg?ixlib=js-3.8.0&auto=format&s=342b3138e7428cdb550c40450b142eab not downloaded yet
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0185d0>
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced0e43c-ec16-5cd5-9bd2-d39316c677d0/ced0e43c-ec16-5cd5-9bd2-d39316c677d0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9798%252F20489798%252Finterior_front_seats-1774772527421.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9798/20489798/interior_front_seats-1774772527421.jpg saved to cache
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ced0e43c-ec16-5cd5-9bd2-d39316c677d0
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa01b990>
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ced0e43c-ec16-5cd5-9bd2-d39316c677d0/ced0e43c-ec16-5cd5-9bd2-d39316c677d0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9798%252F20489798%252Finterior_boot-1774772525909.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9798/20489798/interior_boot-1774772525909.jpg saved to cache
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ced0e43c-ec16-5cd5-9bd2-d39316c677d0
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa18a10>
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3354%252F20473354%252Fexterior_rear_passenger-1774621154455.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_rear_passenger-1774621154455.jpg saved to cache
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52c5590b-eb28-5960-8cbc-5da529f910fb
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfa9c50>
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3354%252F20473354%252Fexterior_rear_driver-1774621148194.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_rear_driver-1774621148194.jpg saved to cache
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52c5590b-eb28-5960-8cbc-5da529f910fb
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82ad4d0>
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3354%252F20473354%252Fexterior_front_passenger-1774621207859.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_front_passenger-1774621207859.jpg saved to cache
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52c5590b-eb28-5960-8cbc-5da529f910fb
2026-03-29 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2337/19102337/instrument_cluster-1774196438184.jpg> (referer: None)
2026-03-29 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3354/20473354/instrument_cluster-1774688464568.jpg> (referer: None)
2026-03-29 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3354/20473354/interior_rear_seats-1774621824077.jpg> (referer: None)
2026-03-29 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1311/17331311/docs_service_history-1774788476766.jpg?ixlib=js-3.8.0&auto=format&s=9ebb15d6ba733ef7abecd2163406e94e> (referer: None)
2026-03-29 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1311/17331311/interior_boot-1774796853881.jpg> (referer: None)
2026-03-29 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7562/13327562/interior_boot-1774714679940.jpg> (referer: None)
2026-03-29 20:06:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82aea90>
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3abced4-115f-53d4-b143-19a48272b304/a3abced4-115f-53d4-b143-19a48272b304_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2337%252F19102337%252Finstrument_cluster-1774196438184.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2337/19102337/instrument_cluster-1774196438184.jpg saved to cache
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3abced4-115f-53d4-b143-19a48272b304
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8264790>
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3354%252F20473354%252Finstrument_cluster-1774688464568.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3354/20473354/instrument_cluster-1774688464568.jpg saved to cache
2026-03-29 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 52c5590b-eb28-5960-8cbc-5da529f910fb
2026-03-29 20:06:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f821df50>
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3354%252F20473354%252Finterior_rear_seats-1774621824077.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3354/20473354/interior_rear_seats-1774621824077.jpg saved to cache
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52c5590b-eb28-5960-8cbc-5da529f910fb
2026-03-29 20:06:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85e8350>
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3/ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1311%252F17331311%252Fdocs_service_history-1774788476766.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9ebb15d6ba733ef7abecd2163406e94e') HTTP/1.1" 204 0
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1311/17331311/docs_service_history-1774788476766.jpg?ixlib=js-3.8.0&auto=format&s=9ebb15d6ba733ef7abecd2163406e94e saved to cache
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8267bd0>
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3/ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1311%252F17331311%252Finterior_boot-1774796853881.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1311/17331311/interior_boot-1774796853881.jpg saved to cache
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3
2026-03-29 20:06:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f914b750>
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dd89cd8-ff15-5c30-9cee-67e4192fc1a9/7dd89cd8-ff15-5c30-9cee-67e4192fc1a9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7562%252F13327562%252Finterior_boot-1774714679940.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7562/13327562/interior_boot-1774714679940.jpg saved to cache
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7dd89cd8-ff15-5c30-9cee-67e4192fc1a9
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_front_passenger-1774700357410.jpg> (referer: None)
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6197/20486197/docs_service_history-1774701456161.jpg?ixlib=js-3.8.0&auto=format&s=342b3138e7428cdb550c40450b142eab> (referer: None)
2026-03-29 20:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6197/20486197/interior_dashboard-1774700020585.jpg> (referer: None)
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_rear_driver-1774700357790.jpg> (referer: None)
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_rear_passenger-1774700364853.jpg> (referer: None)
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6197/20486197/instrument_cluster-1774699995472.jpg> (referer: None)
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6197/20486197/interior_boot-1774699977324.jpg> (referer: None)
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6197/20486197/interior_rear_seats-1774699935362.jpg> (referer: None)
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f782d0>
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6197%252F20486197%252Fexterior_front_passenger-1774700357410.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_front_passenger-1774700357410.jpg saved to cache
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0
2026-03-29 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6197/20486197/interior_front_seats-1774699887548.jpg> (referer: None)
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe46e90>
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6197%252F20486197%252Fdocs_service_history-1774701456161.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D342b3138e7428cdb550c40450b142eab') HTTP/1.1" 204 0
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6197/20486197/docs_service_history-1774701456161.jpg?ixlib=js-3.8.0&auto=format&s=342b3138e7428cdb550c40450b142eab saved to cache
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f897d910>
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6197%252F20486197%252Finterior_dashboard-1774700020585.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6197/20486197/interior_dashboard-1774700020585.jpg saved to cache
2026-03-29 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae2d990>
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6197%252F20486197%252Fexterior_rear_driver-1774700357790.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_rear_driver-1774700357790.jpg saved to cache
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f897c4d0>
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6197%252F20486197%252Fexterior_rear_passenger-1774700364853.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_rear_passenger-1774700364853.jpg saved to cache
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88d49d0>
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6197%252F20486197%252Finstrument_cluster-1774699995472.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6197/20486197/instrument_cluster-1774699995472.jpg saved to cache
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c10350>
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6197%252F20486197%252Finterior_boot-1774699977324.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6197/20486197/interior_boot-1774699977324.jpg saved to cache
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9579450>
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6197%252F20486197%252Finterior_rear_seats-1774699935362.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6197/20486197/interior_rear_seats-1774699935362.jpg saved to cache
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0
2026-03-29 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20494737.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93e3d10>
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6197%252F20486197%252Finterior_front_seats-1774699887548.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6197/20486197/interior_front_seats-1774699887548.jpg saved to cache
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0
2026-03-29 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3354/20473354/docs_service_history-1774622092763.jpg?ixlib=js-3.8.0&auto=format&s=d1b5e1f94d2e44791597b22038f082da> (referer: None)
2026-03-29 20:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 255dfa7a-e5f2-5898-b504-c35bb0878e75 with identifier: 20494737
2026-03-29 20:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 255dfa7a-e5f2-5898-b504-c35bb0878e75 with scrape type 1
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 255dfa7a-e5f2-5898-b504-c35bb0878e75
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4737%252F20494737%252Fexterior_front_driver-1774724206598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4737/20494737/exterior_front_driver-1774724206598.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4737%252F20494737%252Fexterior_rear_driver-1774724224165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4737/20494737/exterior_rear_driver-1774724224165.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4737%252F20494737%252Fexterior_front_passenger-1774724252197.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4737/20494737/exterior_front_passenger-1774724252197.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4737%252F20494737%252Fexterior_rear_passenger-1774724240179.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4737/20494737/exterior_rear_passenger-1774724240179.jpg not downloaded yet
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4737%252F20494737%252Finterior_front_seats-1774724463946.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4737/20494737/interior_front_seats-1774724463946.jpg not downloaded yet
2026-03-29 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3354/20473354/interior_dashboard-1774621934269.jpg> (referer: None)
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4737%252F20494737%252Finterior_rear_seats-1774724479795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4737/20494737/interior_rear_seats-1774724479795.jpg not downloaded yet
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f813b590>
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3354%252F20473354%252Fdocs_service_history-1774622092763.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd1b5e1f94d2e44791597b22038f082da') HTTP/1.1" 204 0
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3354/20473354/docs_service_history-1774622092763.jpg?ixlib=js-3.8.0&auto=format&s=d1b5e1f94d2e44791597b22038f082da saved to cache
2026-03-29 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 52c5590b-eb28-5960-8cbc-5da529f910fb
2026-03-29 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2337/19102337/docs_service_history-1774701640091.jpg?ixlib=js-3.8.0&auto=format&s=e68894af337013d622875dcdb78d63f5> (referer: None)
2026-03-29 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4737%252F20494737%252Finterior_dashboard-1774724499094.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4737/20494737/interior_dashboard-1774724499094.jpg not downloaded yet
2026-03-29 20:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20445682.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4737%252F20494737%252Finstrument_cluster-1774724575365.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4737/20494737/instrument_cluster-1774724575365.jpg not downloaded yet
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9675910>
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3354%252F20473354%252Finterior_dashboard-1774621934269.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3354/20473354/interior_dashboard-1774621934269.jpg saved to cache
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 52c5590b-eb28-5960-8cbc-5da529f910fb
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4737%252F20494737%252Finterior_boot-1774724501991.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4737/20494737/interior_boot-1774724501991.jpg not downloaded yet
2026-03-29 20:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20172367.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F4737%252F20494737%252Fdocs_service_history-1774727898924.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D11aa1a8a2a557519aee00d9470805b0b%27 HTTP/1.1" 200 None
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/4737/20494737/docs_service_history-1774727898924.jpg?ixlib=js-3.8.0&auto=format&s=11aa1a8a2a557519aee00d9470805b0b not downloaded yet
2026-03-29 20:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_front_driver-1774700352382.jpg> (referer: None)
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9271350>
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3abced4-115f-53d4-b143-19a48272b304/a3abced4-115f-53d4-b143-19a48272b304_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2337%252F19102337%252Fdocs_service_history-1774701640091.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De68894af337013d622875dcdb78d63f5') HTTP/1.1" 204 0
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2337/19102337/docs_service_history-1774701640091.jpg?ixlib=js-3.8.0&auto=format&s=e68894af337013d622875dcdb78d63f5 saved to cache
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3abced4-115f-53d4-b143-19a48272b304
2026-03-29 20:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03e8aea1-9182-58bf-b49d-a6186844376a with identifier: 20445682
2026-03-29 20:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03e8aea1-9182-58bf-b49d-a6186844376a with scrape type 1
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03e8aea1-9182-58bf-b49d-a6186844376a
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5682%252F20445682%252Fexterior_front_driver-1774630459220.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5682/20445682/exterior_front_driver-1774630459220.jpg not downloaded yet
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5682%252F20445682%252Fexterior_rear_driver-1774630478491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5682/20445682/exterior_rear_driver-1774630478491.jpg not downloaded yet
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5682%252F20445682%252Fexterior_front_passenger-1774630505625.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5682/20445682/exterior_front_passenger-1774630505625.jpg not downloaded yet
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5682%252F20445682%252Fexterior_rear_passenger-1774630494810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5682/20445682/exterior_rear_passenger-1774630494810.jpg not downloaded yet
2026-03-29 20:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1c17a82-5ce0-5d58-a44e-5fca2dd353d9 with identifier: 20172367
2026-03-29 20:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1c17a82-5ce0-5d58-a44e-5fca2dd353d9 with scrape type 1
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1c17a82-5ce0-5d58-a44e-5fca2dd353d9
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2367%252F20172367%252Fexterior_front_driver-1774697596899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2367/20172367/exterior_front_driver-1774697596899.jpg not downloaded yet
2026-03-29 20:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3354/20473354/interior_front_seats-1774621807022.jpg> (referer: None)
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5682%252F20445682%252Finterior_front_seats-1774630748508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5682/20445682/interior_front_seats-1774630748508.jpg not downloaded yet
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2367%252F20172367%252Fexterior_rear_driver-1773047223926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2367/20172367/exterior_rear_driver-1773047223926.jpg not downloaded yet
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88e37d0>
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6197%252F20486197%252Fexterior_front_driver-1774700352382.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_front_driver-1774700352382.jpg saved to cache
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0
2026-03-29 20:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6ddb0bb-3281-59bc-9bd7-c7ff726710d0, skipping ID generation
2026-03-29 20:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0 with scrape type 1
2026-03-29 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6ddb0bb-3281-59bc-9bd7-c7ff726710d0 sending to next pipeline
2026-03-29 20:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c6ddb0bb-3281-59bc-9bd7-c7ff726710d0, identifier: 20486197
2026-03-29 20:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c6ddb0bb-3281-59bc-9bd7-c7ff726710d0 with identifier: 20486197
2026-03-29 20:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c6ddb0bb-3281-59bc-9bd7-c7ff726710d0 with identifier: 20486197
2026-03-29 20:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c6ddb0bb-3281-59bc-9bd7-c7ff726710d0 with identifier: 20486197 to the API
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_front_driver-1774700352382.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'c6ddb0bb-3281-59bc-9bd7-c7ff726710d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NA70 XLX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20486197',
'listing': 'auction',
'location': 'Cheshire East Sandbach',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 50970,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1719504,
'Height': 2436,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_front_driver-1774700352382.jpg',
'Width': 3248},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1916118,
'Height': 2341,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_rear_driver-1774700357790.jpg',
'Width': 3121},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2116428,
'Height': 2487,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_front_passenger-1774700357410.jpg',
'Width': 3316},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2098512,
'Height': 2552,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6197/20486197/exterior_rear_passenger-1774700364853.jpg',
'Width': 3402},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4180112,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6197/20486197/interior_front_seats-1774699887548.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4731247,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6197/20486197/interior_rear_seats-1774699935362.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1982860,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6197/20486197/interior_dashboard-1774700020585.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3025017,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6197/20486197/instrument_cluster-1774699995472.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4169322,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6197/20486197/interior_boot-1774699977324.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6ddb0bb-3281-59bc-9bd7-c7ff726710d0/c6ddb0bb-3281-59bc-9bd7-c7ff726710d0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692535,
'Height': 2353,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6197/20486197/docs_service_history-1774701456161.jpg?ixlib=js-3.8.0&auto=format&s=342b3138e7428cdb550c40450b142eab',
'Width': 3137}],
'price': 13919,
'price_includes_vat': False,
'registration_date': '2020-09-21',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf R-LINE Edition TDI',
'transmission': 'manual',
'trim': 'R-LINE Edition TDI',
'vin': 'WVWZZZAUZLW124121',
'year': 2020}
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486197%27 HTTP/1.1" 200 None
2026-03-29 20:06:17 [motorway.uk] INFO: Saving data for 20486197: {'created_time': 1774814777.571402, 'last_price_update_time': 1774814777.571416, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20486197') HTTP/1.1" 204 0
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5682%252F20445682%252Finterior_rear_seats-1774630761295.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5682/20445682/interior_rear_seats-1774630761295.jpg not downloaded yet
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2367%252F20172367%252Fexterior_front_passenger-1772991556077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2367/20172367/exterior_front_passenger-1772991556077.jpg not downloaded yet
2026-03-29 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1116&page=31&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_front_driver-1774621139984.jpg> (referer: None)
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5682%252F20445682%252Finterior_dashboard-1774693101693.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5682/20445682/interior_dashboard-1774693101693.jpg not downloaded yet
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2367%252F20172367%252Fexterior_rear_passenger-1774697640732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2367/20172367/exterior_rear_passenger-1774697640732.jpg not downloaded yet
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac1ee50>
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3354%252F20473354%252Finterior_front_seats-1774621807022.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3354/20473354/interior_front_seats-1774621807022.jpg saved to cache
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52c5590b-eb28-5960-8cbc-5da529f910fb
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5682%252F20445682%252Finstrument_cluster-1774630849002.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5682/20445682/instrument_cluster-1774630849002.jpg not downloaded yet
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2367%252F20172367%252Finterior_front_seats-1772992227913.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2367/20172367/interior_front_seats-1772992227913.jpg not downloaded yet
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5682%252F20445682%252Finterior_boot-1774693111888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5682/20445682/interior_boot-1774693111888.jpg not downloaded yet
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2367%252F20172367%252Finterior_rear_seats-1772992115843.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2367/20172367/interior_rear_seats-1772992115843.jpg not downloaded yet
2026-03-29 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20438840.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20255071
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20418634
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20499940
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499940%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [motorway.uk] INFO: Scrape type for 20499940: 1
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa18b10>
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3354%252F20473354%252Fexterior_front_driver-1774621139984.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_front_driver-1774621139984.jpg saved to cache
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52c5590b-eb28-5960-8cbc-5da529f910fb
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5682%252F20445682%252Fdocs_service_history-1774631228223.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D19868379ddcd518fe050167b3d15b5d9%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5682/20445682/docs_service_history-1774631228223.jpg?ixlib=js-3.8.0&auto=format&s=19868379ddcd518fe050167b3d15b5d9 not downloaded yet
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2367%252F20172367%252Finterior_dashboard-1774781256643.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2367/20172367/interior_dashboard-1774781256643.jpg not downloaded yet
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20473047
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20441126
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20467526
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20285675
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20295392
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 10200221
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 13316160
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20479742
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720479742%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [motorway.uk] INFO: Scrape type for 20479742: 1
2026-03-29 20:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f44f4772-d0a1-5b6c-9585-666e3e6ceba5 with identifier: 20438840
2026-03-29 20:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5 with scrape type 1
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8840%252F20438840%252Fexterior_front_driver-1774525741605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_front_driver-1774525741605.jpg not downloaded yet
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2367%252F20172367%252Finstrument_cluster-1773047020723.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2367/20172367/instrument_cluster-1773047020723.jpg not downloaded yet
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20477549
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 16662751
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 12330372
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 19684886
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719684886%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [motorway.uk] INFO: Scrape type for 19684886: 1
2026-03-29 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3354/20473354/interior_boot-1774621897457.jpg> (referer: None)
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8840%252F20438840%252Fexterior_rear_driver-1774525763085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_rear_driver-1774525763085.jpg not downloaded yet
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2367%252F20172367%252Finterior_boot-1772992193354.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2367/20172367/interior_boot-1772992193354.jpg not downloaded yet
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 17190543
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717190543%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [motorway.uk] INFO: Scrape type for 17190543: 1
2026-03-29 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3155170.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8840%252F20438840%252Fexterior_front_passenger-1774525748998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_front_passenger-1774525748998.jpg not downloaded yet
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2367%252F20172367%252Fdocs_service_history-1773047418675.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da971319bb1050e335d9cced8d4072f14%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2367/20172367/docs_service_history-1773047418675.jpg?ixlib=js-3.8.0&auto=format&s=a971319bb1050e335d9cced8d4072f14 not downloaded yet
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 14032750
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20240321
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20020846
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 14443515
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20470846
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 17982437
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20156998
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 18987203
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718987203%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [motorway.uk] INFO: Scrape type for 18987203: 1
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8840%252F20438840%252Fexterior_rear_passenger-1774525754611.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_rear_passenger-1774525754611.jpg not downloaded yet
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 5963462
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 17363006
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 18720332
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20374415
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20438823
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 20489356
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 17446143
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717446143%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [motorway.uk] INFO: Scrape type for 17446143: 1
2026-03-29 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488957.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8840%252F20438840%252Finterior_front_seats-1774526564871.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8840/20438840/interior_front_seats-1774526564871.jpg not downloaded yet
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f927ff10>
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3354%252F20473354%252Finterior_boot-1774621897457.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3354/20473354/interior_boot-1774621897457.jpg saved to cache
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 52c5590b-eb28-5960-8cbc-5da529f910fb
2026-03-29 20:06:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52c5590b-eb28-5960-8cbc-5da529f910fb, skipping ID generation
2026-03-29 20:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52c5590b-eb28-5960-8cbc-5da529f910fb with scrape type 1
2026-03-29 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52c5590b-eb28-5960-8cbc-5da529f910fb sending to next pipeline
2026-03-29 20:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 52c5590b-eb28-5960-8cbc-5da529f910fb, identifier: 20473354
2026-03-29 20:06:18 [motorway.uk] INFO: Found listing with ID: 18406701
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718406701%27 HTTP/1.1" 200 None
2026-03-29 20:06:18 [motorway.uk] INFO: Scrape type for 18406701: 1
2026-03-29 20:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 52c5590b-eb28-5960-8cbc-5da529f910fb with identifier: 20473354
2026-03-29 20:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 52c5590b-eb28-5960-8cbc-5da529f910fb with identifier: 20473354
2026-03-29 20:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 52c5590b-eb28-5960-8cbc-5da529f910fb with identifier: 20473354 to the API
2026-03-29 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3354/20473354/interior_boot-1774621897457.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '52c5590b-eb28-5960-8cbc-5da529f910fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EO22 ZGT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20473354',
'listing': 'auction',
'location': 'Suffolk Ipswich',
'make': 'Fiat',
'model': '500',
'odometer': 37750,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1686590,
'Height': 2341,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_front_driver-1774621139984.jpg',
'Width': 3121},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1321973,
'Height': 2120,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_rear_driver-1774621148194.jpg',
'Width': 2827},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1317658,
'Height': 2090,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_front_passenger-1774621207859.jpg',
'Width': 2787},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1369890,
'Height': 2255,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3354/20473354/exterior_rear_passenger-1774621154455.jpg',
'Width': 3007},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3279463,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3354/20473354/interior_front_seats-1774621807022.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3028422,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3354/20473354/interior_rear_seats-1774621824077.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1885891,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3354/20473354/interior_dashboard-1774621934269.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1025716,
'Height': 1839,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3354/20473354/instrument_cluster-1774688464568.jpg',
'Width': 2451},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3665655,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3354/20473354/interior_boot-1774621897457.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5590b-eb28-5960-8cbc-5da529f910fb/52c5590b-eb28-5960-8cbc-5da529f910fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 497256,
'Height': 1086,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3354/20473354/docs_service_history-1774622092763.jpg?ixlib=js-3.8.0&auto=format&s=d1b5e1f94d2e44791597b22038f082da',
'Width': 3117}],
'price': 9112,
'price_includes_vat': False,
'registration_date': '2022-03-09',
'seats_number': None,
'seller_name': None,
'title': 'Fiat 500 C Dolcevita + MHEV',
'transmission': 'manual',
'trim': 'C Dolcevita + MHEV',
'vin': 'ZFABF1CJ9NJF84931',
'year': 2022}
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473354%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [motorway.uk] INFO: Saving data for 20473354: {'created_time': 1774814779.245551, 'last_price_update_time': 1774814779.245562, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20473354') HTTP/1.1" 204 0
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8840%252F20438840%252Finterior_rear_seats-1774526570706.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8840/20438840/interior_rear_seats-1774526570706.jpg not downloaded yet
2026-03-29 20:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8240c0c-23c2-5da6-b00f-42c685dc76eb with identifier: 3155170
2026-03-29 20:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8240c0c-23c2-5da6-b00f-42c685dc76eb with scrape type 1
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8240c0c-23c2-5da6-b00f-42c685dc76eb
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5170%252F3155170%252Fexterior_front_driver-1774771432207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_front_driver-1774771432207.jpg not downloaded yet
2026-03-29 20:06:19 [motorway.uk] INFO: Found listing with ID: 20403434
2026-03-29 20:06:19 [motorway.uk] INFO: Found listing with ID: 19912396
2026-03-29 20:06:19 [motorway.uk] INFO: Found listing with ID: 5587668
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275587668%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [motorway.uk] INFO: Scrape type for 5587668: 1
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8840%252F20438840%252Finterior_dashboard-1774526596504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8840/20438840/interior_dashboard-1774526596504.jpg not downloaded yet
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5170%252F3155170%252Fexterior_rear_driver-1774771451605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_rear_driver-1774771451605.jpg not downloaded yet
2026-03-29 20:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f53d9efd-c63c-52bd-94cb-e3bfcba47d83 with identifier: 20488957
2026-03-29 20:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83 with scrape type 1
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8957%252F20488957%252Fexterior_front_driver-1774705719198.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8957/20488957/exterior_front_driver-1774705719198.jpg not downloaded yet
2026-03-29 20:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1311/17331311/instrument_cluster-1774787937025.jpg> (referer: None)
2026-03-29 20:06:19 [motorway.uk] INFO: Found listing with ID: 20325290
2026-03-29 20:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8840%252F20438840%252Finstrument_cluster-1774527468765.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8840/20438840/instrument_cluster-1774527468765.jpg not downloaded yet
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5170%252F3155170%252Fexterior_front_passenger-1774771475975.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_front_passenger-1774771475975.jpg not downloaded yet
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8957%252F20488957%252Fexterior_rear_driver-1774705747098.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8957/20488957/exterior_rear_driver-1774705747098.jpg not downloaded yet
2026-03-29 20:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1311/17331311/interior_dashboard-1774796849721.jpg> (referer: None)
2026-03-29 20:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4737/20494737/interior_dashboard-1774724499094.jpg> (referer: None)
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8840%252F20438840%252Finterior_boot-1774526585225.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8840/20438840/interior_boot-1774526585225.jpg not downloaded yet
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5170%252F3155170%252Fexterior_rear_passenger-1774771458180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_rear_passenger-1774771458180.jpg not downloaded yet
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8957%252F20488957%252Fexterior_front_passenger-1774707068012.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8957/20488957/exterior_front_passenger-1774707068012.jpg not downloaded yet
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8840%252F20438840%252Fdocs_service_history-1774608473594.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfb41032dacdcae511e752af06eaf7fcd%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8840/20438840/docs_service_history-1774608473594.jpg?ixlib=js-3.8.0&auto=format&s=fb41032dacdcae511e752af06eaf7fcd not downloaded yet
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5170%252F3155170%252Finterior_front_seats-1774771864964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5170/3155170/interior_front_seats-1774771864964.jpg not downloaded yet
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8957%252F20488957%252Fexterior_rear_passenger-1774705774718.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8957/20488957/exterior_rear_passenger-1774705774718.jpg not downloaded yet
2026-03-29 20:06:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f922d350>
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3/ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1311%252F17331311%252Finstrument_cluster-1774787937025.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1311/17331311/instrument_cluster-1774787937025.jpg saved to cache
2026-03-29 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3
2026-03-29 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5170%252F3155170%252Finterior_rear_seats-1774771882254.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5170/3155170/interior_rear_seats-1774771882254.jpg not downloaded yet
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8957%252F20488957%252Finterior_front_seats-1774706132721.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8957/20488957/interior_front_seats-1774706132721.jpg not downloaded yet
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5170%252F3155170%252Finterior_dashboard-1774771947454.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5170/3155170/interior_dashboard-1774771947454.jpg not downloaded yet
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8957%252F20488957%252Finterior_rear_seats-1774706120910.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8957/20488957/interior_rear_seats-1774706120910.jpg not downloaded yet
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82f35d0>
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3/ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1311%252F17331311%252Finterior_dashboard-1774796849721.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1311/17331311/interior_dashboard-1774796849721.jpg saved to cache
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f882a210>
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255dfa7a-e5f2-5898-b504-c35bb0878e75/255dfa7a-e5f2-5898-b504-c35bb0878e75_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4737%252F20494737%252Finterior_dashboard-1774724499094.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4737/20494737/interior_dashboard-1774724499094.jpg saved to cache
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 255dfa7a-e5f2-5898-b504-c35bb0878e75
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5170%252F3155170%252Finterior_boot-1774771908511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5170/3155170/interior_boot-1774771908511.jpg not downloaded yet
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8957%252F20488957%252Finterior_dashboard-1774706109970.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8957/20488957/interior_dashboard-1774706109970.jpg not downloaded yet
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5170%252F3155170%252Fdocs_service_history-1774774064244.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df0d0f17651e62472787796e99d1c6519%27 HTTP/1.1" 200 None
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5170/3155170/docs_service_history-1774774064244.jpg?ixlib=js-3.8.0&auto=format&s=f0d0f17651e62472787796e99d1c6519 not downloaded yet
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8957%252F20488957%252Finstrument_cluster-1774706276288.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8957/20488957/instrument_cluster-1774706276288.jpg not downloaded yet
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5170%252F3155170%252Fdamage_scratches-1774771556177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5170/3155170/damage_scratches-1774771556177.jpg not downloaded yet
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8957%252F20488957%252Finterior_boot-1774706065346.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8957/20488957/interior_boot-1774706065346.jpg not downloaded yet
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8957%252F20488957%252Fdocs_service_history-1774706457892.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D678e398b3e1a53b73d7a37c380119e33%27 HTTP/1.1" 200 None
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8957/20488957/docs_service_history-1774706457892.jpg?ixlib=js-3.8.0&auto=format&s=678e398b3e1a53b73d7a37c380119e33 not downloaded yet
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4737/20494737/interior_front_seats-1774724463946.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2367/20172367/exterior_rear_passenger-1774697640732.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4737/20494737/interior_boot-1774724501991.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4737/20494737/interior_rear_seats-1774724479795.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4737/20494737/instrument_cluster-1774724575365.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1311/17331311/interior_rear_seats-1774787922271.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2367/20172367/interior_front_seats-1772992227913.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5682/20445682/instrument_cluster-1774630849002.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_front_driver-1774771432207.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8840/20438840/interior_rear_seats-1774526570706.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1311/17331311/interior_front_seats-1774788003474.jpg> (referer: None)
2026-03-29 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5682/20445682/interior_dashboard-1774693101693.jpg> (referer: None)
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f39590>
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255dfa7a-e5f2-5898-b504-c35bb0878e75/255dfa7a-e5f2-5898-b504-c35bb0878e75_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4737%252F20494737%252Finterior_front_seats-1774724463946.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4737/20494737/interior_front_seats-1774724463946.jpg saved to cache
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 255dfa7a-e5f2-5898-b504-c35bb0878e75
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96bded0>
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c17a82-5ce0-5d58-a44e-5fca2dd353d9/e1c17a82-5ce0-5d58-a44e-5fca2dd353d9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2367%252F20172367%252Fexterior_rear_passenger-1774697640732.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2367/20172367/exterior_rear_passenger-1774697640732.jpg saved to cache
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1c17a82-5ce0-5d58-a44e-5fca2dd353d9
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe504d0>
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255dfa7a-e5f2-5898-b504-c35bb0878e75/255dfa7a-e5f2-5898-b504-c35bb0878e75_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4737%252F20494737%252Finterior_boot-1774724501991.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4737/20494737/interior_boot-1774724501991.jpg saved to cache
2026-03-29 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 255dfa7a-e5f2-5898-b504-c35bb0878e75
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f938d910>
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255dfa7a-e5f2-5898-b504-c35bb0878e75/255dfa7a-e5f2-5898-b504-c35bb0878e75_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4737%252F20494737%252Finterior_rear_seats-1774724479795.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4737/20494737/interior_rear_seats-1774724479795.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 255dfa7a-e5f2-5898-b504-c35bb0878e75
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae8c5d0>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_255dfa7a-e5f2-5898-b504-c35bb0878e75/255dfa7a-e5f2-5898-b504-c35bb0878e75_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4737%252F20494737%252Finstrument_cluster-1774724575365.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4737/20494737/instrument_cluster-1774724575365.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 255dfa7a-e5f2-5898-b504-c35bb0878e75
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f960e150>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3/ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1311%252F17331311%252Finterior_rear_seats-1774787922271.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1311/17331311/interior_rear_seats-1774787922271.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f937e010>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c17a82-5ce0-5d58-a44e-5fca2dd353d9/e1c17a82-5ce0-5d58-a44e-5fca2dd353d9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2367%252F20172367%252Finterior_front_seats-1772992227913.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2367/20172367/interior_front_seats-1772992227913.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1c17a82-5ce0-5d58-a44e-5fca2dd353d9
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f38f50>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e8aea1-9182-58bf-b49d-a6186844376a/03e8aea1-9182-58bf-b49d-a6186844376a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5682%252F20445682%252Finstrument_cluster-1774630849002.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5682/20445682/instrument_cluster-1774630849002.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03e8aea1-9182-58bf-b49d-a6186844376a
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e60690>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5170%252F3155170%252Fexterior_front_driver-1774771432207.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_front_driver-1774771432207.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8240c0c-23c2-5da6-b00f-42c685dc76eb
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f96b10>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8840%252F20438840%252Finterior_rear_seats-1774526570706.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8840/20438840/interior_rear_seats-1774526570706.jpg saved to cache
2026-03-29 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad88b50>
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3/ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1311%252F17331311%252Finterior_front_seats-1774788003474.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1311/17331311/interior_front_seats-1774788003474.jpg saved to cache
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab6b16fb-75c3-5f2c-b269-a2f15ad55ad3
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f96110>
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03e8aea1-9182-58bf-b49d-a6186844376a/03e8aea1-9182-58bf-b49d-a6186844376a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5682%252F20445682%252Finterior_dashboard-1774693101693.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5682/20445682/interior_dashboard-1774693101693.jpg saved to cache
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03e8aea1-9182-58bf-b49d-a6186844376a
2026-03-29 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8957/20488957/interior_dashboard-1774706109970.jpg> (referer: None)
2026-03-29 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8957/20488957/interior_boot-1774706065346.jpg> (referer: None)
2026-03-29 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5170/3155170/interior_boot-1774771908511.jpg> (referer: None)
2026-03-29 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/5170/3155170/docs_service_history-1774774064244.jpg?ixlib=js-3.8.0&auto=format&s=f0d0f17651e62472787796e99d1c6519> (referer: None)
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9168b10>
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8957%252F20488957%252Finterior_dashboard-1774706109970.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8957/20488957/interior_dashboard-1774706109970.jpg saved to cache
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f931c910>
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8957%252F20488957%252Finterior_boot-1774706065346.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8957/20488957/interior_boot-1774706065346.jpg saved to cache
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfa4bd0>
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5170%252F3155170%252Finterior_boot-1774771908511.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5170/3155170/interior_boot-1774771908511.jpg saved to cache
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8240c0c-23c2-5da6-b00f-42c685dc76eb
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x15\x04\xa4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xdfZ\x00\x14\xe5\xa5\x00\x00\x00\x00'
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95c0990>
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5170%252F3155170%252Fdocs_service_history-1774774064244.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df0d0f17651e62472787796e99d1c6519') HTTP/1.1" 204 0
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5170/3155170/docs_service_history-1774774064244.jpg?ixlib=js-3.8.0&auto=format&s=f0d0f17651e62472787796e99d1c6519 saved to cache
2026-03-29 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8240c0c-23c2-5da6-b00f-42c685dc76eb
2026-03-29 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/5587668.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18406701.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8957/20488957/docs_service_history-1774706457892.jpg?ixlib=js-3.8.0&auto=format&s=678e398b3e1a53b73d7a37c380119e33> (referer: None)
2026-03-29 20:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8957/20488957/exterior_rear_passenger-1774705774718.jpg> (referer: None)
2026-03-29 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8957/20488957/exterior_front_passenger-1774707068012.jpg> (referer: None)
2026-03-29 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8840/20438840/docs_service_history-1774608473594.jpg?ixlib=js-3.8.0&auto=format&s=fb41032dacdcae511e752af06eaf7fcd> (referer: None)
2026-03-29 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8957/20488957/interior_rear_seats-1774706120910.jpg> (referer: None)
2026-03-29 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8957/20488957/interior_front_seats-1774706132721.jpg> (referer: None)
2026-03-29 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5170/3155170/damage_scratches-1774771556177.jpg> (referer: None)
2026-03-29 20:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9770e09-84f9-5aa8-81f9-bc584b65d91b with identifier: 5587668
2026-03-29 20:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9770e09-84f9-5aa8-81f9-bc584b65d91b with scrape type 1
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9770e09-84f9-5aa8-81f9-bc584b65d91b
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7668%252F5587668%252Fexterior_front_driver-1774780665783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_front_driver-1774780665783.jpg not downloaded yet
2026-03-29 20:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b75afd4-6371-5e43-9b48-515e8e9277ae with identifier: 18406701
2026-03-29 20:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b75afd4-6371-5e43-9b48-515e8e9277ae with scrape type 1
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b75afd4-6371-5e43-9b48-515e8e9277ae
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6701%252F18406701%252Fexterior_front_driver-1772553894869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_front_driver-1772553894869.jpg not downloaded yet
2026-03-29 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5170/3155170/interior_front_seats-1774771864964.jpg> (referer: None)
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7668%252F5587668%252Fexterior_rear_driver-1774780683457.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_rear_driver-1774780683457.jpg not downloaded yet
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6701%252F18406701%252Fexterior_rear_driver-1772553975201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_rear_driver-1772553975201.jpg not downloaded yet
2026-03-29 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5170/3155170/interior_dashboard-1774771947454.jpg> (referer: None)
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7668%252F5587668%252Fexterior_front_passenger-1774780707658.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_front_passenger-1774780707658.jpg not downloaded yet
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6701%252F18406701%252Fexterior_front_passenger-1772553921647.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_front_passenger-1772553921647.jpg not downloaded yet
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfb5b90>
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8957%252F20488957%252Fdocs_service_history-1774706457892.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D678e398b3e1a53b73d7a37c380119e33') HTTP/1.1" 204 0
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8957/20488957/docs_service_history-1774706457892.jpg?ixlib=js-3.8.0&auto=format&s=678e398b3e1a53b73d7a37c380119e33 saved to cache
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81c3510>
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8957%252F20488957%252Fexterior_rear_passenger-1774705774718.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8957/20488957/exterior_rear_passenger-1774705774718.jpg saved to cache
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8251450>
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8957%252F20488957%252Fexterior_front_passenger-1774707068012.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8957/20488957/exterior_front_passenger-1774707068012.jpg saved to cache
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83
2026-03-29 20:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8957/20488957/instrument_cluster-1774706276288.jpg> (referer: None)
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7668%252F5587668%252Fexterior_rear_passenger-1774780693222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_rear_passenger-1774780693222.jpg not downloaded yet
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6701%252F18406701%252Fexterior_rear_passenger-1772553952343.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_rear_passenger-1772553952343.jpg not downloaded yet
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8250c90>
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8840%252F20438840%252Fdocs_service_history-1774608473594.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfb41032dacdcae511e752af06eaf7fcd') HTTP/1.1" 204 0
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8840/20438840/docs_service_history-1774608473594.jpg?ixlib=js-3.8.0&auto=format&s=fb41032dacdcae511e752af06eaf7fcd saved to cache
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5
2026-03-29 20:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa14510>
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8957%252F20488957%252Finterior_rear_seats-1774706120910.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8957/20488957/interior_rear_seats-1774706120910.jpg saved to cache
2026-03-29 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83
2026-03-29 20:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8bfe790>
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8957%252F20488957%252Finterior_front_seats-1774706132721.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8957/20488957/interior_front_seats-1774706132721.jpg saved to cache
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8bfd290>
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5170%252F3155170%252Fdamage_scratches-1774771556177.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5170/3155170/damage_scratches-1774771556177.jpg saved to cache
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8240c0c-23c2-5da6-b00f-42c685dc76eb
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f7b510>
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5170%252F3155170%252Finterior_front_seats-1774771864964.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5170/3155170/interior_front_seats-1774771864964.jpg saved to cache
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8240c0c-23c2-5da6-b00f-42c685dc76eb
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7668%252F5587668%252Finterior_front_seats-1774781166170.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7668/5587668/interior_front_seats-1774781166170.jpg not downloaded yet
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6701%252F18406701%252Finterior_front_seats-1772557391600.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6701/18406701/interior_front_seats-1772557391600.jpg not downloaded yet
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c30e10>
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5170%252F3155170%252Finterior_dashboard-1774771947454.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5170/3155170/interior_dashboard-1774771947454.jpg saved to cache
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8240c0c-23c2-5da6-b00f-42c685dc76eb
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010df890>
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8957%252F20488957%252Finstrument_cluster-1774706276288.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8957/20488957/instrument_cluster-1774706276288.jpg saved to cache
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8840/20438840/instrument_cluster-1774527468765.jpg> (referer: None)
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7668%252F5587668%252Finterior_rear_seats-1774781185567.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7668/5587668/interior_rear_seats-1774781185567.jpg not downloaded yet
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6701%252F18406701%252Finterior_rear_seats-1772557643144.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6701/18406701/interior_rear_seats-1772557643144.jpg not downloaded yet
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7668%252F5587668%252Finterior_dashboard-1774783216817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7668/5587668/interior_dashboard-1774783216817.jpg not downloaded yet
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6701%252F18406701%252F18406701-interior_dashboard-modified-1774715059990.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6701/18406701/18406701-interior_dashboard-modified-1774715059990.jpeg not downloaded yet
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7668%252F5587668%252Finstrument_cluster-1774781259139.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7668/5587668/instrument_cluster-1774781259139.jpg not downloaded yet
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6701%252F18406701%252Finstrument_cluster-1772980021576.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6701/18406701/instrument_cluster-1772980021576.jpg not downloaded yet
2026-03-29 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5170/3155170/interior_rear_seats-1774771882254.jpg> (referer: None)
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7668%252F5587668%252Finterior_boot-1774781247354.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7668/5587668/interior_boot-1774781247354.jpg not downloaded yet
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6701%252F18406701%252Finterior_boot-1772557922280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6701/18406701/interior_boot-1772557922280.jpg not downloaded yet
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7668%252F5587668%252Fdocs_service_history-1774782042802.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da4d2ec68f1f8b134e2c49154ffc1e48d%27 HTTP/1.1" 200 None
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7668/5587668/docs_service_history-1774782042802.jpg?ixlib=js-3.8.0&auto=format&s=a4d2ec68f1f8b134e2c49154ffc1e48d not downloaded yet
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6701%252F18406701%252Fdocs_service_history-1774111762156.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df7aec6453ff15788f3b3da54f273928d%27 HTTP/1.1" 200 None
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6701/18406701/docs_service_history-1774111762156.jpg?ixlib=js-3.8.0&auto=format&s=f7aec6453ff15788f3b3da54f273928d not downloaded yet
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fdb350>
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8840%252F20438840%252Finstrument_cluster-1774527468765.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8840/20438840/instrument_cluster-1774527468765.jpg saved to cache
2026-03-29 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f817d650>
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5170%252F3155170%252Finterior_rear_seats-1774771882254.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5170/3155170/interior_rear_seats-1774771882254.jpg saved to cache
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8240c0c-23c2-5da6-b00f-42c685dc76eb
2026-03-29 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_front_passenger-1774771475975.jpg> (referer: None)
2026-03-29 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8957/20488957/exterior_front_driver-1774705719198.jpg> (referer: None)
2026-03-29 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8957/20488957/exterior_rear_driver-1774705747098.jpg> (referer: None)
2026-03-29 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_rear_passenger-1774771458180.jpg> (referer: None)
2026-03-29 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_front_passenger-1772553921647.jpg> (referer: None)
2026-03-29 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_rear_driver-1774771451605.jpg> (referer: None)
2026-03-29 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_rear_passenger-1772553952343.jpg> (referer: None)
2026-03-29 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8840/20438840/interior_boot-1774526585225.jpg> (referer: None)
2026-03-29 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_rear_passenger-1774780693222.jpg> (referer: None)
2026-03-29 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6701/18406701/interior_rear_seats-1772557643144.jpg> (referer: None)
2026-03-29 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6701/18406701/18406701-interior_dashboard-modified-1774715059990.jpeg> (referer: None)
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f967d650>
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5170%252F3155170%252Fexterior_front_passenger-1774771475975.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_front_passenger-1774771475975.jpg saved to cache
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8240c0c-23c2-5da6-b00f-42c685dc76eb
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95fa010>
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8957%252F20488957%252Fexterior_front_driver-1774705719198.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8957/20488957/exterior_front_driver-1774705719198.jpg saved to cache
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84d5610>
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8957%252F20488957%252Fexterior_rear_driver-1774705747098.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8957/20488957/exterior_rear_driver-1774705747098.jpg saved to cache
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83
2026-03-29 20:06:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f53d9efd-c63c-52bd-94cb-e3bfcba47d83, skipping ID generation
2026-03-29 20:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83 with scrape type 1
2026-03-29 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f53d9efd-c63c-52bd-94cb-e3bfcba47d83 sending to next pipeline
2026-03-29 20:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f53d9efd-c63c-52bd-94cb-e3bfcba47d83, identifier: 20488957
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f817c850>
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5170%252F3155170%252Fexterior_rear_passenger-1774771458180.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_rear_passenger-1774771458180.jpg saved to cache
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8240c0c-23c2-5da6-b00f-42c685dc76eb
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac5a090>
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6701%252F18406701%252Fexterior_front_passenger-1772553921647.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_front_passenger-1772553921647.jpg saved to cache
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b75afd4-6371-5e43-9b48-515e8e9277ae
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8466550>
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5170%252F3155170%252Fexterior_rear_driver-1774771451605.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_rear_driver-1774771451605.jpg saved to cache
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8240c0c-23c2-5da6-b00f-42c685dc76eb
2026-03-29 20:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8240c0c-23c2-5da6-b00f-42c685dc76eb, skipping ID generation
2026-03-29 20:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8240c0c-23c2-5da6-b00f-42c685dc76eb with scrape type 1
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8240c0c-23c2-5da6-b00f-42c685dc76eb sending to next pipeline
2026-03-29 20:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c8240c0c-23c2-5da6-b00f-42c685dc76eb, identifier: 3155170
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa55f10>
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6701%252F18406701%252Fexterior_rear_passenger-1772553952343.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_rear_passenger-1772553952343.jpg saved to cache
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b75afd4-6371-5e43-9b48-515e8e9277ae
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb8550>
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8840%252F20438840%252Finterior_boot-1774526585225.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8840/20438840/interior_boot-1774526585225.jpg saved to cache
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafbb590>
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7668%252F5587668%252Fexterior_rear_passenger-1774780693222.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_rear_passenger-1774780693222.jpg saved to cache
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9770e09-84f9-5aa8-81f9-bc584b65d91b
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700da26d0>
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6701%252F18406701%252Finterior_rear_seats-1772557643144.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6701/18406701/interior_rear_seats-1772557643144.jpg saved to cache
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b75afd4-6371-5e43-9b48-515e8e9277ae
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8465910>
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6701%252F18406701%252F18406701-interior_dashboard-modified-1774715059990.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6701/18406701/18406701-interior_dashboard-modified-1774715059990.jpeg saved to cache
2026-03-29 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b75afd4-6371-5e43-9b48-515e8e9277ae
2026-03-29 20:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f53d9efd-c63c-52bd-94cb-e3bfcba47d83 with identifier: 20488957
2026-03-29 20:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f53d9efd-c63c-52bd-94cb-e3bfcba47d83 with identifier: 20488957
2026-03-29 20:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f53d9efd-c63c-52bd-94cb-e3bfcba47d83 with identifier: 20488957 to the API
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8957/20488957/exterior_rear_driver-1774705747098.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f53d9efd-c63c-52bd-94cb-e3bfcba47d83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HN17 SFO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488957',
'listing': 'auction',
'location': 'Somerset Minehead',
'make': 'Honda',
'model': 'Jazz',
'odometer': 37745,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1642144,
'Height': 2510,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8957/20488957/exterior_front_driver-1774705719198.jpg',
'Width': 3347},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1517383,
'Height': 2537,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8957/20488957/exterior_rear_driver-1774705747098.jpg',
'Width': 3382},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1745919,
'Height': 2469,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8957/20488957/exterior_front_passenger-1774707068012.jpg',
'Width': 3292},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1200352,
'Height': 2288,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8957/20488957/exterior_rear_passenger-1774705774718.jpg',
'Width': 3051},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2597860,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8957/20488957/interior_front_seats-1774706132721.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2672689,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8957/20488957/interior_rear_seats-1774706120910.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2666355,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8957/20488957/interior_dashboard-1774706109970.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2164249,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8957/20488957/instrument_cluster-1774706276288.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2817286,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8957/20488957/interior_boot-1774706065346.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f53d9efd-c63c-52bd-94cb-e3bfcba47d83/f53d9efd-c63c-52bd-94cb-e3bfcba47d83_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 603222,
'Height': 1245,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8957/20488957/docs_service_history-1774706457892.jpg?ixlib=js-3.8.0&auto=format&s=678e398b3e1a53b73d7a37c380119e33',
'Width': 3582}],
'price': 9904,
'price_includes_vat': False,
'registration_date': '2017-04-29',
'seats_number': None,
'seller_name': None,
'title': 'Honda Jazz EX Navi I-VTEC CVT',
'transmission': 'automatic',
'trim': 'EX Navi I-VTEC CVT',
'vin': 'JHMGK3870HX205075',
'year': 2017}
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488957%27 HTTP/1.1" 200 None
2026-03-29 20:06:27 [motorway.uk] INFO: Saving data for 20488957: {'created_time': 1774814787.354894, 'last_price_update_time': 1774814787.354905, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488957') HTTP/1.1" 204 0
2026-03-29 20:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c8240c0c-23c2-5da6-b00f-42c685dc76eb with identifier: 3155170
2026-03-29 20:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c8240c0c-23c2-5da6-b00f-42c685dc76eb with identifier: 3155170
2026-03-29 20:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c8240c0c-23c2-5da6-b00f-42c685dc76eb with identifier: 3155170 to the API
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_rear_driver-1774771451605.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'c8240c0c-23c2-5da6-b00f-42c685dc76eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'V6 FCD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3155170',
'listing': 'auction',
'location': 'Kent Gravesend',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 104153,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1891379,
'Height': 2652,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_front_driver-1774771432207.jpg',
'Width': 3536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1704721,
'Height': 2412,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_rear_driver-1774771451605.jpg',
'Width': 3216},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1283470,
'Height': 2369,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_front_passenger-1774771475975.jpg',
'Width': 3158},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1497722,
'Height': 2307,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5170/3155170/exterior_rear_passenger-1774771458180.jpg',
'Width': 3076},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3278155,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5170/3155170/interior_front_seats-1774771864964.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3029925,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5170/3155170/interior_rear_seats-1774771882254.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3423069,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5170/3155170/interior_dashboard-1774771947454.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4586906,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5170/3155170/interior_boot-1774771908511.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 391391,
'Height': 2111,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/5170/3155170/docs_service_history-1774774064244.jpg?ixlib=js-3.8.0&auto=format&s=f0d0f17651e62472787796e99d1c6519',
'Width': 1583},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8240c0c-23c2-5da6-b00f-42c685dc76eb/c8240c0c-23c2-5da6-b00f-42c685dc76eb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2982263,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5170/3155170/damage_scratches-1774771556177.jpg',
'Width': 4032}],
'price': 1995,
'price_includes_vat': False,
'registration_date': '2008-06-24',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf GT Sport TSI 170 S-A',
'transmission': 'automatic',
'trim': 'GT Sport TSI 170 S-A',
'vin': 'WVWZZZ1KZ9W002727',
'year': 2008}
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273155170%27 HTTP/1.1" 200 None
2026-03-29 20:06:27 [motorway.uk] INFO: Saving data for 3155170: {'created_time': 1774814787.757578, 'last_price_update_time': 1774814787.75759, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3155170') HTTP/1.1" 204 0
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6701/18406701/interior_front_seats-1772557391600.jpg> (referer: None)
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1152&page=32&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6701/18406701/docs_service_history-1774111762156.jpg?ixlib=js-3.8.0&auto=format&s=f7aec6453ff15788f3b3da54f273928d> (referer: None)
2026-03-29 20:06:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_front_passenger-1774780707658.jpg> (referer: None)
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7668/5587668/interior_front_seats-1774781166170.jpg> (referer: None)
2026-03-29 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7668/5587668/interior_rear_seats-1774781185567.jpg> (referer: None)
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadd0ed0>
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6701%252F18406701%252Finterior_front_seats-1772557391600.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6701/18406701/interior_front_seats-1772557391600.jpg saved to cache
2026-03-29 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b75afd4-6371-5e43-9b48-515e8e9277ae
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 18037733
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718037733%27 HTTP/1.1" 200 None
2026-03-29 20:06:28 [motorway.uk] INFO: Scrape type for 18037733: 1
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9382150>
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6701%252F18406701%252Fdocs_service_history-1774111762156.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df7aec6453ff15788f3b3da54f273928d') HTTP/1.1" 204 0
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6701/18406701/docs_service_history-1774111762156.jpg?ixlib=js-3.8.0&auto=format&s=f7aec6453ff15788f3b3da54f273928d saved to cache
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b75afd4-6371-5e43-9b48-515e8e9277ae
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9380350>
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7668%252F5587668%252Fexterior_front_passenger-1774780707658.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_front_passenger-1774780707658.jpg saved to cache
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9770e09-84f9-5aa8-81f9-bc584b65d91b
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8245910>
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7668%252F5587668%252Finterior_front_seats-1774781166170.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7668/5587668/interior_front_seats-1774781166170.jpg saved to cache
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9770e09-84f9-5aa8-81f9-bc584b65d91b
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9178550>
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7668%252F5587668%252Finterior_rear_seats-1774781185567.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7668/5587668/interior_rear_seats-1774781185567.jpg saved to cache
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9770e09-84f9-5aa8-81f9-bc584b65d91b
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20357003
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20419987
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20487473
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20355479
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 12517194
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 17744204
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20209184
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 9654966
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 17811380
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717811380%27 HTTP/1.1" 200 None
2026-03-29 20:06:28 [motorway.uk] INFO: Scrape type for 17811380: 1
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20487082
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487082%27 HTTP/1.1" 200 None
2026-03-29 20:06:28 [motorway.uk] INFO: Scrape type for 20487082: 1
2026-03-29 20:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20405903
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720405903%27 HTTP/1.1" 200 None
2026-03-29 20:06:28 [motorway.uk] INFO: Scrape type for 20405903: 1
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20335691
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20492519
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 19185025
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20473857
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 18463422
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20432038
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20466969
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720466969%27 HTTP/1.1" 200 None
2026-03-29 20:06:28 [motorway.uk] INFO: Scrape type for 20466969: 1
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 16001492
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20488676
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 19668749
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20386402
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20456408
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720456408%27 HTTP/1.1" 200 None
2026-03-29 20:06:28 [motorway.uk] INFO: Scrape type for 20456408: 1
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_front_driver-1772553894869.jpg> (referer: None)
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20144250
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 19436717
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20482913
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20165260
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20420247
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20458630
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 18085024
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20484226
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484226%27 HTTP/1.1" 200 None
2026-03-29 20:06:28 [motorway.uk] INFO: Scrape type for 20484226: 1
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6701/18406701/instrument_cluster-1772980021576.jpg> (referer: None)
2026-03-29 20:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 15574359
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20469502
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20453801
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720453801%27 HTTP/1.1" 200 None
2026-03-29 20:06:28 [motorway.uk] INFO: Scrape type for 20453801: 1
2026-03-29 20:06:28 [motorway.uk] INFO: Found listing with ID: 20497569
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720497569%27 HTTP/1.1" 200 None
2026-03-29 20:06:28 [motorway.uk] INFO: Scrape type for 20497569: 1
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_rear_driver-1772553975201.jpg> (referer: None)
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_rear_passenger-1774525754611.jpg> (referer: None)
2026-03-29 20:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_front_driver-1774780665783.jpg> (referer: None)
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8840/20438840/interior_dashboard-1774526596504.jpg> (referer: None)
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6701/18406701/interior_boot-1772557922280.jpg> (referer: None)
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_rear_driver-1774780683457.jpg> (referer: None)
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fbc610>
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6701%252F18406701%252Fexterior_front_driver-1772553894869.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_front_driver-1772553894869.jpg saved to cache
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b75afd4-6371-5e43-9b48-515e8e9277ae
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7668/5587668/interior_dashboard-1774783216817.jpg> (referer: None)
2026-03-29 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7668/5587668/instrument_cluster-1774781259139.jpg> (referer: None)
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85b5f50>
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6701%252F18406701%252Finstrument_cluster-1772980021576.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6701/18406701/instrument_cluster-1772980021576.jpg saved to cache
2026-03-29 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b75afd4-6371-5e43-9b48-515e8e9277ae
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ce3590>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6701%252F18406701%252Fexterior_rear_driver-1772553975201.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_rear_driver-1772553975201.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b75afd4-6371-5e43-9b48-515e8e9277ae
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf1fb10>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8840%252F20438840%252Fexterior_rear_passenger-1774525754611.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_rear_passenger-1774525754611.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95f8350>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7668%252F5587668%252Fexterior_front_driver-1774780665783.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_front_driver-1774780665783.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9770e09-84f9-5aa8-81f9-bc584b65d91b
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf90d10>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8840%252F20438840%252Finterior_dashboard-1774526596504.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8840/20438840/interior_dashboard-1774526596504.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa161990>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6701%252F18406701%252Finterior_boot-1772557922280.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6701/18406701/interior_boot-1772557922280.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b75afd4-6371-5e43-9b48-515e8e9277ae
2026-03-29 20:06:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b75afd4-6371-5e43-9b48-515e8e9277ae, skipping ID generation
2026-03-29 20:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b75afd4-6371-5e43-9b48-515e8e9277ae with scrape type 1
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b75afd4-6371-5e43-9b48-515e8e9277ae sending to next pipeline
2026-03-29 20:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6b75afd4-6371-5e43-9b48-515e8e9277ae, identifier: 18406701
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8467f50>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7668%252F5587668%252Fexterior_rear_driver-1774780683457.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_rear_driver-1774780683457.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9770e09-84f9-5aa8-81f9-bc584b65d91b
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8244510>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7668%252F5587668%252Finterior_dashboard-1774783216817.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7668/5587668/interior_dashboard-1774783216817.jpg saved to cache
2026-03-29 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9770e09-84f9-5aa8-81f9-bc584b65d91b
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d14f50>
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7668%252F5587668%252Finstrument_cluster-1774781259139.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7668/5587668/instrument_cluster-1774781259139.jpg saved to cache
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9770e09-84f9-5aa8-81f9-bc584b65d91b
2026-03-29 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7668/5587668/docs_service_history-1774782042802.jpg?ixlib=js-3.8.0&auto=format&s=a4d2ec68f1f8b134e2c49154ffc1e48d> (referer: None)
2026-03-29 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8840/20438840/interior_front_seats-1774526564871.jpg> (referer: None)
2026-03-29 20:06:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6b75afd4-6371-5e43-9b48-515e8e9277ae with identifier: 18406701
2026-03-29 20:06:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6b75afd4-6371-5e43-9b48-515e8e9277ae with identifier: 18406701
2026-03-29 20:06:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6b75afd4-6371-5e43-9b48-515e8e9277ae with identifier: 18406701 to the API
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6701/18406701/interior_boot-1772557922280.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6b75afd4-6371-5e43-9b48-515e8e9277ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'JGZ 5538',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18406701',
'listing': 'auction',
'location': 'Belfast Belfast',
'make': 'Volvo',
'model': 'XC40',
'odometer': 123411,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 708113,
'Height': 2126,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_front_driver-1772553894869.jpg',
'Width': 2834},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1075217,
'Height': 2460,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_rear_driver-1772553975201.jpg',
'Width': 3280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 449876,
'Height': 2075,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_front_passenger-1772553921647.jpg',
'Width': 2766},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 974835,
'Height': 2237,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6701/18406701/exterior_rear_passenger-1772553952343.jpg',
'Width': 2982},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1290635,
'Height': 2736,
'OriginUrl': 'https://motorway-photos.imgix.net/6701/18406701/interior_front_seats-1772557391600.jpg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1068233,
'Height': 2736,
'OriginUrl': 'https://motorway-photos.imgix.net/6701/18406701/interior_rear_seats-1772557643144.jpg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1203700,
'Height': 2736,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6701/18406701/18406701-interior_dashboard-modified-1774715059990.jpeg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 782314,
'Height': 2736,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6701/18406701/instrument_cluster-1772980021576.jpg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1508413,
'Height': 2736,
'OriginUrl': 'https://motorway-photos.imgix.net/6701/18406701/interior_boot-1772557922280.jpg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b75afd4-6371-5e43-9b48-515e8e9277ae/6b75afd4-6371-5e43-9b48-515e8e9277ae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 565090,
'Height': 2736,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6701/18406701/docs_service_history-1774111762156.jpg?ixlib=js-3.8.0&auto=format&s=f7aec6453ff15788f3b3da54f273928d',
'Width': 3648}],
'price': 12610,
'price_includes_vat': False,
'registration_date': '2018-03-21',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC40 First Edition T5 AWD Auto',
'transmission': 'automatic',
'trim': 'First Edition T5 AWD Auto',
'vin': 'YV1XZ13BCJ2001219',
'year': 2018}
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718406701%27 HTTP/1.1" 200 None
2026-03-29 20:06:30 [motorway.uk] INFO: Saving data for 18406701: {'created_time': 1774814790.593367, 'last_price_update_time': 1774814790.593378, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18406701') HTTP/1.1" 204 0
2026-03-29 20:06:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e3ef10>
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7668%252F5587668%252Fdocs_service_history-1774782042802.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da4d2ec68f1f8b134e2c49154ffc1e48d') HTTP/1.1" 204 0
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7668/5587668/docs_service_history-1774782042802.jpg?ixlib=js-3.8.0&auto=format&s=a4d2ec68f1f8b134e2c49154ffc1e48d saved to cache
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9770e09-84f9-5aa8-81f9-bc584b65d91b
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95d6010>
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8840%252F20438840%252Finterior_front_seats-1774526564871.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8840/20438840/interior_front_seats-1774526564871.jpg saved to cache
2026-03-29 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5
2026-03-29 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7668/5587668/interior_boot-1774781247354.jpg> (referer: None)
2026-03-29 20:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2367/20172367/docs_service_history-1773047418675.jpg?ixlib=js-3.8.0&auto=format&s=a971319bb1050e335d9cced8d4072f14> (referer: None)
2026-03-29 20:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17446143.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadae850>
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7668%252F5587668%252Finterior_boot-1774781247354.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7668/5587668/interior_boot-1774781247354.jpg saved to cache
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9770e09-84f9-5aa8-81f9-bc584b65d91b
2026-03-29 20:06:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9770e09-84f9-5aa8-81f9-bc584b65d91b, skipping ID generation
2026-03-29 20:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9770e09-84f9-5aa8-81f9-bc584b65d91b with scrape type 1
2026-03-29 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9770e09-84f9-5aa8-81f9-bc584b65d91b sending to next pipeline
2026-03-29 20:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f9770e09-84f9-5aa8-81f9-bc584b65d91b, identifier: 5587668
2026-03-29 20:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f9770e09-84f9-5aa8-81f9-bc584b65d91b with identifier: 5587668
2026-03-29 20:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f9770e09-84f9-5aa8-81f9-bc584b65d91b with identifier: 5587668
2026-03-29 20:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f9770e09-84f9-5aa8-81f9-bc584b65d91b with identifier: 5587668 to the API
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7668/5587668/interior_boot-1774781247354.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'f9770e09-84f9-5aa8-81f9-bc584b65d91b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'K222 GGR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/5587668',
'listing': 'auction',
'location': 'West Sussex Chichester',
'make': 'Mercedes',
'model': 'C Class',
'odometer': 28864,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1416951,
'Height': 2545,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_front_driver-1774780665783.jpg',
'Width': 3393},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1609543,
'Height': 2726,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_rear_driver-1774780683457.jpg',
'Width': 3635},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1631754,
'Height': 2682,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_front_passenger-1774780707658.jpg',
'Width': 3576},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1264991,
'Height': 2461,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7668/5587668/exterior_rear_passenger-1774780693222.jpg',
'Width': 3281},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3581244,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7668/5587668/interior_front_seats-1774781166170.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3431381,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7668/5587668/interior_rear_seats-1774781185567.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2088466,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7668/5587668/interior_dashboard-1774783216817.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2217909,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7668/5587668/instrument_cluster-1774781259139.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3333790,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7668/5587668/interior_boot-1774781247354.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9770e09-84f9-5aa8-81f9-bc584b65d91b/f9770e09-84f9-5aa8-81f9-bc584b65d91b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2603195,
'Height': 2967,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7668/5587668/docs_service_history-1774782042802.jpg?ixlib=js-3.8.0&auto=format&s=a4d2ec68f1f8b134e2c49154ffc1e48d',
'Width': 2060}],
'price': 16235,
'price_includes_vat': False,
'registration_date': '2019-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes C 200 AMG Line Auto',
'transmission': 'automatic',
'trim': 'C 200 AMG Line Auto',
'vin': 'WDD2054772F882945',
'year': 2019}
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275587668%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [motorway.uk] INFO: Saving data for 5587668: {'created_time': 1774814792.009761, 'last_price_update_time': 1774814792.009771, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='5587668') HTTP/1.1" 204 0
2026-03-29 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20466969.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17811380.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9170a90>
2026-03-29 20:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c17a82-5ce0-5d58-a44e-5fca2dd353d9/e1c17a82-5ce0-5d58-a44e-5fca2dd353d9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2367%252F20172367%252Fdocs_service_history-1773047418675.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da971319bb1050e335d9cced8d4072f14') HTTP/1.1" 204 0
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2367/20172367/docs_service_history-1773047418675.jpg?ixlib=js-3.8.0&auto=format&s=a971319bb1050e335d9cced8d4072f14 saved to cache
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1c17a82-5ce0-5d58-a44e-5fca2dd353d9
2026-03-29 20:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c326f7df-c651-5f9a-b72e-8f465c50bb12 with identifier: 17446143
2026-03-29 20:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c326f7df-c651-5f9a-b72e-8f465c50bb12 with scrape type 1
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c326f7df-c651-5f9a-b72e-8f465c50bb12
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6143%252F17446143%252Fexterior_front_driver-1774691015893.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6143/17446143/exterior_front_driver-1774691015893.jpeg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6143%252F17446143%252Fexterior_rear_driver-1774691121579.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6143/17446143/exterior_rear_driver-1774691121579.jpeg not downloaded yet
2026-03-29 20:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5 with identifier: 20466969
2026-03-29 20:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5 with scrape type 1
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6969%252F20466969%252Fexterior_front_driver-1774715688178.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6969/20466969/exterior_front_driver-1774715688178.jpg not downloaded yet
2026-03-29 20:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0bbd0d7-b060-5708-a5f8-37095bde5b2e with identifier: 17811380
2026-03-29 20:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0bbd0d7-b060-5708-a5f8-37095bde5b2e with scrape type 1
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0bbd0d7-b060-5708-a5f8-37095bde5b2e
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1380%252F17811380%252Fexterior_front_driver-1774688573682.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1380/17811380/exterior_front_driver-1774688573682.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6143%252F17446143%252Fexterior_front_passenger-1774691065144.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6143/17446143/exterior_front_passenger-1774691065144.jpeg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6969%252F20466969%252Fexterior_rear_driver-1774715702594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6969/20466969/exterior_rear_driver-1774715702594.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1380%252F17811380%252Fexterior_rear_driver-1774688591314.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1380/17811380/exterior_rear_driver-1774688591314.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6143%252F17446143%252Fexterior_rear_passenger-1774691094867.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6143/17446143/exterior_rear_passenger-1774691094867.jpeg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6969%252F20466969%252Fexterior_front_passenger-1774715736185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6969/20466969/exterior_front_passenger-1774715736185.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1380%252F17811380%252Fexterior_front_passenger-1774690643265.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1380/17811380/exterior_front_passenger-1774690643265.jpg not downloaded yet
2026-03-29 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18037733.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6143%252F17446143%252Finterior_front_seats-1774691147243.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6143/17446143/interior_front_seats-1774691147243.jpeg not downloaded yet
2026-03-29 20:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_rear_driver-1774525763085.jpg> (referer: None)
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6969%252F20466969%252Fexterior_rear_passenger-1774715721605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6969/20466969/exterior_rear_passenger-1774715721605.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1380%252F17811380%252Fexterior_rear_passenger-1774690667993.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1380/17811380/exterior_rear_passenger-1774690667993.jpg not downloaded yet
2026-03-29 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20456408.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6143%252F17446143%252Finterior_rear_seats-1774691320772.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6143/17446143/interior_rear_seats-1774691320772.jpeg not downloaded yet
2026-03-29 20:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6969%252F20466969%252Finterior_front_seats-1774716258031.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6969/20466969/interior_front_seats-1774716258031.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1380%252F17811380%252Finterior_front_seats-1774689168666.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1380/17811380/interior_front_seats-1774689168666.jpg not downloaded yet
2026-03-29 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_front_passenger-1774525748998.jpg> (referer: None)
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6143%252F17446143%252F17446143-interior_dashboard-modified-1774781388584.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6143/17446143/17446143-interior_dashboard-modified-1774781388584.jpeg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6969%252F20466969%252Finterior_rear_seats-1774716291593.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6969/20466969/interior_rear_seats-1774716291593.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1380%252F17811380%252Finterior_rear_seats-1774689241372.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1380/17811380/interior_rear_seats-1774689241372.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6143%252F17446143%252Finstrument_cluster-1774679132889.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6143/17446143/instrument_cluster-1774679132889.jpeg not downloaded yet
2026-03-29 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2367/20172367/instrument_cluster-1773047020723.jpg> (referer: None)
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6969%252F20466969%252Finterior_dashboard-1774792938246.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6969/20466969/interior_dashboard-1774792938246.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1380%252F17811380%252Finterior_dashboard-1774690620357.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1380/17811380/interior_dashboard-1774690620357.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6143%252F17446143%252Finterior_boot-1774679248142.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6143/17446143/interior_boot-1774679248142.jpeg not downloaded yet
2026-03-29 20:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01c56b0d-c369-5d23-8859-4dd29187bd3b with identifier: 18037733
2026-03-29 20:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01c56b0d-c369-5d23-8859-4dd29187bd3b with scrape type 1
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01c56b0d-c369-5d23-8859-4dd29187bd3b
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7733%252F18037733%252Fexterior_front_driver-1774202228302.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7733/18037733/exterior_front_driver-1774202228302.jpg not downloaded yet
2026-03-29 20:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadac8d0>
2026-03-29 20:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8840%252F20438840%252Fexterior_rear_driver-1774525763085.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_rear_driver-1774525763085.jpg saved to cache
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5
2026-03-29 20:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5 with identifier: 20456408
2026-03-29 20:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5 with scrape type 1
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6408%252F20456408%252Fexterior_front_driver-1774699577205.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6408/20456408/exterior_front_driver-1774699577205.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6969%252F20466969%252Finstrument_cluster-1774716352799.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6969/20466969/instrument_cluster-1774716352799.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1380%252F17811380%252Finstrument_cluster-1774689046148.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1380/17811380/instrument_cluster-1774689046148.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6143%252F17446143%252Fdocs_service_history-1774680130129.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9da820f45cd4a0e795dcd5987360e416%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6143/17446143/docs_service_history-1774680130129.jpeg?ixlib=js-3.8.0&auto=format&s=9da820f45cd4a0e795dcd5987360e416 not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7733%252F18037733%252Fexterior_rear_driver-1774202371196.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7733/18037733/exterior_rear_driver-1774202371196.jpg not downloaded yet
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6408%252F20456408%252Fexterior_rear_driver-1774699590038.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6408/20456408/exterior_rear_driver-1774699590038.jpg not downloaded yet
2026-03-29 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20497569.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ac59d0>
2026-03-29 20:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8840%252F20438840%252Fexterior_front_passenger-1774525748998.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_front_passenger-1774525748998.jpg saved to cache
2026-03-29 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6969%252F20466969%252Finterior_boot-1774716337587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6969/20466969/interior_boot-1774716337587.jpg not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1380%252F17811380%252Finterior_boot-1774689024387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1380/17811380/interior_boot-1774689024387.jpg not downloaded yet
2026-03-29 20:06:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7733%252F18037733%252Fexterior_front_passenger-1774202357918.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7733/18037733/exterior_front_passenger-1774202357918.jpg not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20456408%252Fexterior_front_passenger-1774697016810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20456408/exterior_front_passenger-1774697016810.jpg not downloaded yet
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88bc290>
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c17a82-5ce0-5d58-a44e-5fca2dd353d9/e1c17a82-5ce0-5d58-a44e-5fca2dd353d9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2367%252F20172367%252Finstrument_cluster-1773047020723.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2367/20172367/instrument_cluster-1773047020723.jpg saved to cache
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1c17a82-5ce0-5d58-a44e-5fca2dd353d9
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6969%252F20466969%252Fdocs_service_history-1774716759438.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd6c083080ab705454df33588aa1db718%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6969/20466969/docs_service_history-1774716759438.jpg?ixlib=js-3.8.0&auto=format&s=d6c083080ab705454df33588aa1db718 not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1380%252F17811380%252Fdocs_service_history-1774689377683.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbf2cfb3ed75f36ac7f7706f4ba797af3%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1380/17811380/docs_service_history-1774689377683.jpg?ixlib=js-3.8.0&auto=format&s=bf2cfb3ed75f36ac7f7706f4ba797af3 not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7733%252F18037733%252Fexterior_rear_passenger-1774202397504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7733/18037733/exterior_rear_passenger-1774202397504.jpg not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20456408%252Fexterior_rear_passenger-1774697012712.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20456408/exterior_rear_passenger-1774697012712.jpg not downloaded yet
2026-03-29 20:06:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdd5cf2c-181d-5a44-8387-f7dcd89ae15a with identifier: 20497569
2026-03-29 20:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a with scrape type 1
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Fexterior_front_driver-1774776865155.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_front_driver-1774776865155.jpg not downloaded yet
2026-03-29 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_front_driver-1774525741605.jpg> (referer: None)
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7733%252F18037733%252Finterior_front_seats-1774203153059.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7733/18037733/interior_front_seats-1774203153059.jpg not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20456408%252Finterior_front_seats-1774697579854.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20456408/interior_front_seats-1774697579854.jpg not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Fexterior_rear_driver-1774776890403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_rear_driver-1774776890403.jpg not downloaded yet
2026-03-29 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1188&page=33&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7733%252F18037733%252Finterior_rear_seats-1774204310690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7733/18037733/interior_rear_seats-1774204310690.jpg not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20456408%252Finterior_rear_seats-1774697575539.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20456408/interior_rear_seats-1774697575539.jpg not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Fexterior_front_passenger-1774776942870.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_front_passenger-1774776942870.jpg not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7733%252F18037733%252Finterior_dashboard-1774203241481.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7733/18037733/interior_dashboard-1774203241481.jpg not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20456408%252Finterior_dashboard-1774697594737.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20456408/interior_dashboard-1774697594737.jpg not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Fexterior_rear_passenger-1774776910755.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_rear_passenger-1774776910755.jpg not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7733%252F18037733%252Finstrument_cluster-1774204350912.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7733/18037733/instrument_cluster-1774204350912.jpg not downloaded yet
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20456408%252Finterior_boot-1774697577775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20456408/interior_boot-1774697577775.jpg not downloaded yet
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94df9d0>
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8840%252F20438840%252Fexterior_front_driver-1774525741605.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_front_driver-1774525741605.jpg saved to cache
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5
2026-03-29 20:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f44f4772-d0a1-5b6c-9585-666e3e6ceba5, skipping ID generation
2026-03-29 20:06:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5 with scrape type 1
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f44f4772-d0a1-5b6c-9585-666e3e6ceba5 sending to next pipeline
2026-03-29 20:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f44f4772-d0a1-5b6c-9585-666e3e6ceba5, identifier: 20438840
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7569%252F20497569%252Finterior_front_seats-1774776617909.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7569/20497569/interior_front_seats-1774776617909.jpg not downloaded yet
2026-03-29 20:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f44f4772-d0a1-5b6c-9585-666e3e6ceba5 with identifier: 20438840
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:06:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White+%26+Black HTTP/1.1" 200 None
2026-03-29 20:06:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f44f4772-d0a1-5b6c-9585-666e3e6ceba5 with identifier: 20438840
2026-03-29 20:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f44f4772-d0a1-5b6c-9585-666e3e6ceba5 with identifier: 20438840 to the API
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_front_driver-1774525741605.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'f44f4772-d0a1-5b6c-9585-666e3e6ceba5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WG69 WSE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20438840',
'listing': 'auction',
'location': 'Plymouth Plymouth',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 29000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1296654,
'Height': 2860,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_front_driver-1774525741605.jpg',
'Width': 3813},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 824898,
'Height': 2207,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_rear_driver-1774525763085.jpg',
'Width': 2943},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1028465,
'Height': 2602,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_front_passenger-1774525748998.jpg',
'Width': 3469},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1095620,
'Height': 2568,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8840/20438840/exterior_rear_passenger-1774525754611.jpg',
'Width': 3424},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1950130,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8840/20438840/interior_front_seats-1774526564871.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1901362,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8840/20438840/interior_rear_seats-1774526570706.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1501628,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8840/20438840/interior_dashboard-1774526596504.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436835,
'Height': 1337,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8840/20438840/instrument_cluster-1774527468765.jpg',
'Width': 1783},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2310124,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8840/20438840/interior_boot-1774526585225.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f44f4772-d0a1-5b6c-9585-666e3e6ceba5/f44f4772-d0a1-5b6c-9585-666e3e6ceba5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2020809,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8840/20438840/docs_service_history-1774608473594.jpg?ixlib=js-3.8.0&auto=format&s=fb41032dacdcae511e752af06eaf7fcd',
'Width': 3840}],
'price': 11291,
'price_includes_vat': False,
'registration_date': '2019-12-23',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Yaris Y20 VVT-i HEV CVT',
'transmission': 'automatic',
'trim': 'Y20 VVT-i HEV CVT',
'vin': 'VNKKD3D390A654340',
'year': 2019}
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720438840%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [motorway.uk] INFO: Saving data for 20438840: {'created_time': 1774814794.45986, 'last_price_update_time': 1774814794.459873, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20438840') HTTP/1.1" 204 0
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7733%252F18037733%252Finterior_boot-1774204228985.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7733/18037733/interior_boot-1774204228985.jpg not downloaded yet
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6408%252F20456408%252Fdocs_service_history-1774699661485.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D421aff9f781dbcf6075c5104dffaa69b%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6408/20456408/docs_service_history-1774699661485.jpg?ixlib=js-3.8.0&auto=format&s=421aff9f781dbcf6075c5104dffaa69b not downloaded yet
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20484945
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 14357475
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20175875
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20016415
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 18975319
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20492267
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20435647
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720435647%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [motorway.uk] INFO: Scrape type for 20435647: 1
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7569%252F20497569%252Finterior_rear_seats-1774776620232.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7569/20497569/interior_rear_seats-1774776620232.jpg not downloaded yet
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7733%252F18037733%252Fdocs_service_history-1774713801273.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3dbbb65ff6f6a9ec773888393be66491%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7733/18037733/docs_service_history-1774713801273.jpg?ixlib=js-3.8.0&auto=format&s=3dbbb65ff6f6a9ec773888393be66491 not downloaded yet
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6408%252F20456408%252Fdocs_service_history-1774699671692.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2448867cab4f8d8cc7733ca7ff24f134%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6408/20456408/docs_service_history-1774699671692.jpg?ixlib=js-3.8.0&auto=format&s=2448867cab4f8d8cc7733ca7ff24f134 not downloaded yet
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20487216
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 18947501
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20381015
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20482805
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 9373677
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20339850
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20478886
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 19640893
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 16034385
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20490883
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 18780849
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 18169442
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20467557
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20172298
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20481158
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720481158%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [motorway.uk] INFO: Scrape type for 20481158: 1
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Finterior_dashboard-1774776631248.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/interior_dashboard-1774776631248.jpg not downloaded yet
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1380/17811380/exterior_front_passenger-1774690643265.jpg> (referer: None)
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20009659
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720009659%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [motorway.uk] INFO: Scrape type for 20009659: 1
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Finstrument_cluster-1774776636399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/instrument_cluster-1774776636399.jpg not downloaded yet
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 19320604
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20473409
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20388349
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720388349%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [motorway.uk] INFO: Scrape type for 20388349: 1
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7569%252F20497569%252Finterior_boot-1774777276357.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7569/20497569/interior_boot-1774777276357.jpg not downloaded yet
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20484226.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17190543.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487082.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6969/20466969/exterior_front_passenger-1774715736185.jpg> (referer: None)
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 14416221
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 15999217
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20500662
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 19873015
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719873015%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [motorway.uk] INFO: Scrape type for 19873015: 1
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Fwheels_front_driver-1774776285162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/wheels_front_driver-1774776285162.jpg not downloaded yet
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20405903.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18987203.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20398790
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 13687661
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 13044273
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713044273%27 HTTP/1.1" 200 None
2026-03-29 20:06:34 [motorway.uk] INFO: Scrape type for 13044273: 1
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20453801.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e23150>
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bbd0d7-b060-5708-a5f8-37095bde5b2e/a0bbd0d7-b060-5708-a5f8-37095bde5b2e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1380%252F17811380%252Fexterior_front_passenger-1774690643265.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1380/17811380/exterior_front_passenger-1774690643265.jpg saved to cache
2026-03-29 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0bbd0d7-b060-5708-a5f8-37095bde5b2e
2026-03-29 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2367/20172367/interior_boot-1772992193354.jpg> (referer: None)
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 11047706
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 20388848
2026-03-29 20:06:34 [motorway.uk] INFO: Found listing with ID: 18340983
2026-03-29 20:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f0a5390-9f4b-582b-8d5d-f092773ea91d with identifier: 20484226
2026-03-29 20:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d with scrape type 1
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4226%252F20484226%252Fexterior_front_driver-1774690487008.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_front_driver-1774690487008.jpg not downloaded yet
2026-03-29 20:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dd847c2-5725-5f6e-b509-5a9602b2b059 with identifier: 17190543
2026-03-29 20:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd847c2-5725-5f6e-b509-5a9602b2b059 with scrape type 1
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2dd847c2-5725-5f6e-b509-5a9602b2b059
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0543%252F17190543%252Fexterior_front_driver-1774695536287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_front_driver-1774695536287.jpg not downloaded yet
2026-03-29 20:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca4125e8-1e35-5063-86dc-574ceda4cf5c with identifier: 20487082
2026-03-29 20:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca4125e8-1e35-5063-86dc-574ceda4cf5c with scrape type 1
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca4125e8-1e35-5063-86dc-574ceda4cf5c
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7082%252F20487082%252Fexterior_front_driver-1774711205397.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7082/20487082/exterior_front_driver-1774711205397.jpg not downloaded yet
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f916d0d0>
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5/9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6969%252F20466969%252Fexterior_front_passenger-1774715736185.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6969/20466969/exterior_front_passenger-1774715736185.jpg saved to cache
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5
2026-03-29 20:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9314e08-4e07-5cf0-9461-c3e95cec9593 with identifier: 20405903
2026-03-29 20:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9314e08-4e07-5cf0-9461-c3e95cec9593 with scrape type 1
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9314e08-4e07-5cf0-9461-c3e95cec9593
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5903%252F20405903%252Fexterior_front_driver-1774273367975.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_front_driver-1774273367975.jpg not downloaded yet
2026-03-29 20:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2345849f-d8ac-55cb-95be-1ed8429984c7 with identifier: 18987203
2026-03-29 20:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2345849f-d8ac-55cb-95be-1ed8429984c7 with scrape type 1
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2345849f-d8ac-55cb-95be-1ed8429984c7
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7203%252F18987203%252Fexterior_front_driver-1774625958768.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_front_driver-1774625958768.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4226%252F20484226%252Fexterior_rear_driver-1774690504595.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_rear_driver-1774690504595.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0543%252F17190543%252Fexterior_rear_driver-1774695625352.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_rear_driver-1774695625352.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7082%252F20487082%252Fexterior_rear_driver-1774711206197.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7082/20487082/exterior_rear_driver-1774711206197.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5903%252F20405903%252Fexterior_rear_driver-1774273378499.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_rear_driver-1774273378499.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7203%252F18987203%252Fexterior_rear_driver-1774625969359.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_rear_driver-1774625969359.jpg not downloaded yet
2026-03-29 20:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e912281f-4476-5bdc-af72-fa9417500154 with identifier: 20453801
2026-03-29 20:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e912281f-4476-5bdc-af72-fa9417500154 with scrape type 1
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e912281f-4476-5bdc-af72-fa9417500154
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3801%252F20453801%252Fexterior_front_driver-1774780063914.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_front_driver-1774780063914.jpg not downloaded yet
2026-03-29 20:06:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa02ced0>
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1c17a82-5ce0-5d58-a44e-5fca2dd353d9/e1c17a82-5ce0-5d58-a44e-5fca2dd353d9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2367%252F20172367%252Finterior_boot-1772992193354.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2367/20172367/interior_boot-1772992193354.jpg saved to cache
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1c17a82-5ce0-5d58-a44e-5fca2dd353d9
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4226%252F20484226%252Fexterior_front_passenger-1774690551157.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_front_passenger-1774690551157.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0543%252F17190543%252Fexterior_front_passenger-1774695646634.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_front_passenger-1774695646634.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7082%252F20487082%252Fexterior_front_passenger-1774711213663.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7082/20487082/exterior_front_passenger-1774711213663.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5903%252F20405903%252Fexterior_front_passenger-1774273379552.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_front_passenger-1774273379552.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7203%252F18987203%252Fexterior_front_passenger-1774626051014.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_front_passenger-1774626051014.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3801%252F20453801%252Fexterior_rear_driver-1774780102522.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_rear_driver-1774780102522.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4226%252F20484226%252Fexterior_rear_passenger-1774690555747.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_rear_passenger-1774690555747.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0543%252F17190543%252Fexterior_rear_passenger-1774695645904.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_rear_passenger-1774695645904.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7082%252F20487082%252Fexterior_rear_passenger-1774714923302.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7082/20487082/exterior_rear_passenger-1774714923302.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5903%252F20405903%252Fexterior_rear_passenger-1774273371466.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_rear_passenger-1774273371466.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7203%252F18987203%252Fexterior_rear_passenger-1774625978391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_rear_passenger-1774625978391.jpg not downloaded yet
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3801%252F20453801%252Fexterior_front_passenger-1774780155579.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_front_passenger-1774780155579.jpg not downloaded yet
2026-03-29 20:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6408/20456408/exterior_rear_passenger-1774697012712.jpg> (referer: None)
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4226%252F20484226%252Finterior_front_seats-1774691278089.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4226/20484226/interior_front_seats-1774691278089.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0543%252F17190543%252Finterior_front_seats-1774697641236.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0543/17190543/interior_front_seats-1774697641236.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7082%252F20487082%252Finterior_front_seats-1774711609966.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7082/20487082/interior_front_seats-1774711609966.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5903%252F20405903%252Finterior_front_seats-1774273721445.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5903/20405903/interior_front_seats-1774273721445.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7203%252F18987203%252Finterior_front_seats-1774626953269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7203/18987203/interior_front_seats-1774626953269.jpg not downloaded yet
2026-03-29 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_rear_driver-1774776890403.jpg> (referer: None)
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3801%252F20453801%252Fexterior_rear_passenger-1774780128876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_rear_passenger-1774780128876.jpg not downloaded yet
2026-03-29 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19684886.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4226%252F20484226%252Finterior_rear_seats-1774691295817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4226/20484226/interior_rear_seats-1774691295817.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0543%252F17190543%252Finterior_rear_seats-1774696250896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0543/17190543/interior_rear_seats-1774696250896.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7082%252F20487082%252Finterior_rear_seats-1774711684863.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7082/20487082/interior_rear_seats-1774711684863.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5903%252F20405903%252Finterior_rear_seats-1774273719118.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5903/20405903/interior_rear_seats-1774273719118.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7203%252F18987203%252Finterior_rear_seats-1774626975279.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7203/18987203/interior_rear_seats-1774626975279.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3801%252F20453801%252Finterior_front_seats-1774781245614.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3801/20453801/interior_front_seats-1774781245614.jpg not downloaded yet
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8949610>
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5/ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20456408%252Fexterior_rear_passenger-1774697012712.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20456408/exterior_rear_passenger-1774697012712.jpg saved to cache
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4226%252F20484226%252Finterior_dashboard-1774691400517.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4226/20484226/interior_dashboard-1774691400517.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0543%252F17190543%252Finterior_dashboard-1774696300992.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0543/17190543/interior_dashboard-1774696300992.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7082%252F20487082%252Finterior_dashboard-1774714905276.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7082/20487082/interior_dashboard-1774714905276.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5903%252F20405903%252Finterior_dashboard-1774273745602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5903/20405903/interior_dashboard-1774273745602.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7203%252F18987203%252Finterior_dashboard-1774627132715.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7203/18987203/interior_dashboard-1774627132715.jpg not downloaded yet
2026-03-29 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1380/17811380/interior_front_seats-1774689168666.jpg> (referer: None)
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3801%252F20453801%252Finterior_dashboard-1774785787347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3801/20453801/interior_dashboard-1774785787347.jpg not downloaded yet
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8950c50>
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Fexterior_rear_driver-1774776890403.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_rear_driver-1774776890403.jpg saved to cache
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4226%252F20484226%252Finstrument_cluster-1774691369785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4226/20484226/instrument_cluster-1774691369785.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0543%252F17190543%252Finterior_boot-1774706736059.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0543/17190543/interior_boot-1774706736059.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7082%252F20487082%252Finstrument_cluster-1774711616505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7082/20487082/instrument_cluster-1774711616505.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5903%252F20405903%252Finstrument_cluster-1774273714847.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5903/20405903/instrument_cluster-1774273714847.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7203%252F18987203%252Finstrument_cluster-1774627086219.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7203/18987203/instrument_cluster-1774627086219.jpg not downloaded yet
2026-03-29 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6143/17446143/interior_front_seats-1774691147243.jpeg> (referer: None)
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3801%252F20453801%252Finstrument_cluster-1774781303066.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3801/20453801/instrument_cluster-1774781303066.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4226%252F20484226%252Finterior_boot-1774691354714.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4226/20484226/interior_boot-1774691354714.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0543%252F17190543%252Fdocs_service_history-1774697592679.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4afa988e7d2cd7e5cecb8bea4f1fa856%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0543/17190543/docs_service_history-1774697592679.jpg?ixlib=js-3.8.0&auto=format&s=4afa988e7d2cd7e5cecb8bea4f1fa856 not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7082%252F20487082%252Finterior_boot-1774711575489.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7082/20487082/interior_boot-1774711575489.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5903%252F20405903%252Finterior_boot-1774273717384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5903/20405903/interior_boot-1774273717384.jpg not downloaded yet
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7203%252F18987203%252Finterior_boot-1774627004283.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7203/18987203/interior_boot-1774627004283.jpg not downloaded yet
2026-03-29 20:06:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74f39e53-da8c-5155-9d52-4526635c8769 with identifier: 19684886
2026-03-29 20:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74f39e53-da8c-5155-9d52-4526635c8769 with scrape type 1
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74f39e53-da8c-5155-9d52-4526635c8769
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4886%252F19684886%252Fexterior_front_driver-1774447666055.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_front_driver-1774447666055.jpg not downloaded yet
2026-03-29 20:06:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82648d0>
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bbd0d7-b060-5708-a5f8-37095bde5b2e/a0bbd0d7-b060-5708-a5f8-37095bde5b2e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1380%252F17811380%252Finterior_front_seats-1774689168666.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1380/17811380/interior_front_seats-1774689168666.jpg saved to cache
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0bbd0d7-b060-5708-a5f8-37095bde5b2e
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3801%252F20453801%252Finterior_boot-1774781426487.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3801/20453801/interior_boot-1774781426487.jpg not downloaded yet
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6969/20466969/instrument_cluster-1774716352799.jpg> (referer: None)
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4226%252F20484226%252Fdocs_service_history-1774716437525.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D12b3a7cc9dce2c69085d6a7b0d060368%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4226/20484226/docs_service_history-1774716437525.jpg?ixlib=js-3.8.0&auto=format&s=12b3a7cc9dce2c69085d6a7b0d060368 not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0543%252F17190543%252Fdocs_service_history-1774697592733.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D82fbb9664002c4f85220c84bdc45e955%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0543/17190543/docs_service_history-1774697592733.jpg?ixlib=js-3.8.0&auto=format&s=82fbb9664002c4f85220c84bdc45e955 not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7082%252F20487082%252Fdocs_service_history-1774712188615.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da2db15aa9c56308bb5c1761d0f5e2240%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7082/20487082/docs_service_history-1774712188615.jpg?ixlib=js-3.8.0&auto=format&s=a2db15aa9c56308bb5c1761d0f5e2240 not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5903%252F20405903%252Fdocs_service_history-1774696208570.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcce9c1ebb4b423b85e3a5df4f5e89527%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5903/20405903/docs_service_history-1774696208570.jpg?ixlib=js-3.8.0&auto=format&s=cce9c1ebb4b423b85e3a5df4f5e89527 not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7203%252F18987203%252Fdocs_service_history-1774627429434.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D38836813acb98b27dcc1c0006bc5d0db%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7203/18987203/docs_service_history-1774627429434.jpg?ixlib=js-3.8.0&auto=format&s=38836813acb98b27dcc1c0006bc5d0db not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4886%252F19684886%252Fexterior_rear_driver-1774448592881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_rear_driver-1774448592881.jpg not downloaded yet
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1380/17811380/instrument_cluster-1774689046148.jpg> (referer: None)
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7082/20487082/exterior_front_passenger-1774711213663.jpg> (referer: None)
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3801%252F20453801%252Fdocs_service_history-1774781838817.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D761c92404ef4179832ee00e65cc4066b%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3801/20453801/docs_service_history-1774781838817.jpg?ixlib=js-3.8.0&auto=format&s=761c92404ef4179832ee00e65cc4066b not downloaded yet
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*\x17\x83\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xfd\xde\x00*\r\x7f\x00\x00\x00\x00'
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8714610>
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c326f7df-c651-5f9a-b72e-8f465c50bb12/c326f7df-c651-5f9a-b72e-8f465c50bb12_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6143%252F17446143%252Finterior_front_seats-1774691147243.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6143/17446143/interior_front_seats-1774691147243.jpeg saved to cache
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c326f7df-c651-5f9a-b72e-8f465c50bb12
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7569/20497569/interior_dashboard-1774776631248.jpg> (referer: None)
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4886%252F19684886%252Fexterior_front_passenger-1774448533108.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_front_passenger-1774448533108.jpg not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3801%252F20453801%252Fdocs_service_history-1774786360884.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbb743cf060952967fddc846fe20e7d79%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3801/20453801/docs_service_history-1774786360884.jpg?ixlib=js-3.8.0&auto=format&s=bb743cf060952967fddc846fe20e7d79 not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4886%252F19684886%252Fexterior_rear_passenger-1774448548622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_rear_passenger-1774448548622.jpg not downloaded yet
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f882b190>
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5/9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6969%252F20466969%252Finstrument_cluster-1774716352799.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6969/20466969/instrument_cluster-1774716352799.jpg saved to cache
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90b9e10>
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bbd0d7-b060-5708-a5f8-37095bde5b2e/a0bbd0d7-b060-5708-a5f8-37095bde5b2e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1380%252F17811380%252Finstrument_cluster-1774689046148.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1380/17811380/instrument_cluster-1774689046148.jpg saved to cache
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0bbd0d7-b060-5708-a5f8-37095bde5b2e
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae71450>
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7082%252F20487082%252Fexterior_front_passenger-1774711213663.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7082/20487082/exterior_front_passenger-1774711213663.jpg saved to cache
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca4125e8-1e35-5063-86dc-574ceda4cf5c
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4886%252F19684886%252Finterior_front_seats-1774448671878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4886/19684886/interior_front_seats-1774448671878.jpg not downloaded yet
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8202f90>
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Finterior_dashboard-1774776631248.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/interior_dashboard-1774776631248.jpg saved to cache
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4886%252F19684886%252Finterior_rear_seats-1774514448762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4886/19684886/interior_rear_seats-1774514448762.jpg not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4886%252F19684886%252Finterior_dashboard-1774514486333.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4886/19684886/interior_dashboard-1774514486333.jpg not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4886%252F19684886%252Finterior_boot-1774514623318.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4886/19684886/interior_boot-1774514623318.jpg not downloaded yet
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4886%252F19684886%252F19684886-docs_service_history-modified-1774694987339.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D29759ff82a0eb5a15abacf28bdfb4c8b%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4886/19684886/19684886-docs_service_history-modified-1774694987339.jpeg?ixlib=js-3.8.0&auto=format&s=29759ff82a0eb5a15abacf28bdfb4c8b not downloaded yet
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_front_passenger-1774273379552.jpg> (referer: None)
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_front_passenger-1774626051014.jpg> (referer: None)
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4886%252F19684886%252Fdocs_service_history-1774624591868.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9a8e6a51fb2f237e29ac6bc9b4262c7b%27 HTTP/1.1" 200 None
2026-03-29 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4886/19684886/docs_service_history-1774624591868.jpg?ixlib=js-3.8.0&auto=format&s=9a8e6a51fb2f237e29ac6bc9b4262c7b not downloaded yet
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_front_passenger-1774690551157.jpg> (referer: None)
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_rear_driver-1774273378499.jpg> (referer: None)
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_front_passenger-1774695646634.jpg> (referer: None)
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_front_driver-1774780063914.jpg> (referer: None)
2026-03-29 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_rear_driver-1774625969359.jpg> (referer: None)
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1b94d0>
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5903%252F20405903%252Fexterior_front_passenger-1774273379552.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_front_passenger-1774273379552.jpg saved to cache
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9314e08-4e07-5cf0-9461-c3e95cec9593
2026-03-29 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4886/19684886/interior_front_seats-1774448671878.jpg> (referer: None)
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf792d0>
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7203%252F18987203%252Fexterior_front_passenger-1774626051014.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_front_passenger-1774626051014.jpg saved to cache
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2345849f-d8ac-55cb-95be-1ed8429984c7
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebbd8290>
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4226%252F20484226%252Fexterior_front_passenger-1774690551157.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_front_passenger-1774690551157.jpg saved to cache
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa16bc90>
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5903%252F20405903%252Fexterior_rear_driver-1774273378499.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_rear_driver-1774273378499.jpg saved to cache
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9314e08-4e07-5cf0-9461-c3e95cec9593
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebbd9dd0>
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0543%252F17190543%252Fexterior_front_passenger-1774695646634.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_front_passenger-1774695646634.jpg saved to cache
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2dd847c2-5725-5f6e-b509-5a9602b2b059
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f894e110>
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3801%252F20453801%252Fexterior_front_driver-1774780063914.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_front_driver-1774780063914.jpg saved to cache
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e912281f-4476-5bdc-af72-fa9417500154
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0e5750>
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7203%252F18987203%252Fexterior_rear_driver-1774625969359.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_rear_driver-1774625969359.jpg saved to cache
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2345849f-d8ac-55cb-95be-1ed8429984c7
2026-03-29 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3801/20453801/docs_service_history-1774786360884.jpg?ixlib=js-3.8.0&auto=format&s=bb743cf060952967fddc846fe20e7d79> (referer: None)
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f960f790>
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4886%252F19684886%252Finterior_front_seats-1774448671878.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4886/19684886/interior_front_seats-1774448671878.jpg saved to cache
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74f39e53-da8c-5155-9d52-4526635c8769
2026-03-29 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_front_passenger-1774448533108.jpg> (referer: None)
2026-03-29 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_rear_driver-1774448592881.jpg> (referer: None)
2026-03-29 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_rear_passenger-1774448548622.jpg> (referer: None)
2026-03-29 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4886/19684886/19684886-docs_service_history-modified-1774694987339.jpeg?ixlib=js-3.8.0&auto=format&s=29759ff82a0eb5a15abacf28bdfb4c8b> (referer: None)
2026-03-29 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7203/18987203/docs_service_history-1774627429434.jpg?ixlib=js-3.8.0&auto=format&s=38836813acb98b27dcc1c0006bc5d0db> (referer: None)
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89ae050>
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3801%252F20453801%252Fdocs_service_history-1774786360884.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbb743cf060952967fddc846fe20e7d79') HTTP/1.1" 204 0
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3801/20453801/docs_service_history-1774786360884.jpg?ixlib=js-3.8.0&auto=format&s=bb743cf060952967fddc846fe20e7d79 saved to cache
2026-03-29 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e912281f-4476-5bdc-af72-fa9417500154
2026-03-29 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3801/20453801/docs_service_history-1774781838817.jpg?ixlib=js-3.8.0&auto=format&s=761c92404ef4179832ee00e65cc4066b> (referer: None)
2026-03-29 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5903/20405903/docs_service_history-1774696208570.jpg?ixlib=js-3.8.0&auto=format&s=cce9c1ebb4b423b85e3a5df4f5e89527> (referer: None)
2026-03-29 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7082/20487082/docs_service_history-1774712188615.jpg?ixlib=js-3.8.0&auto=format&s=a2db15aa9c56308bb5c1761d0f5e2240> (referer: None)
2026-03-29 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4886/19684886/interior_boot-1774514623318.jpg> (referer: None)
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88da610>
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4886%252F19684886%252Fexterior_front_passenger-1774448533108.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_front_passenger-1774448533108.jpg saved to cache
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74f39e53-da8c-5155-9d52-4526635c8769
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8455490>
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4886%252F19684886%252Fexterior_rear_driver-1774448592881.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_rear_driver-1774448592881.jpg saved to cache
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74f39e53-da8c-5155-9d52-4526635c8769
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89ac610>
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4886%252F19684886%252Fexterior_rear_passenger-1774448548622.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_rear_passenger-1774448548622.jpg saved to cache
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74f39e53-da8c-5155-9d52-4526635c8769
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84dd910>
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4886%252F19684886%252F19684886-docs_service_history-modified-1774694987339.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D29759ff82a0eb5a15abacf28bdfb4c8b') HTTP/1.1" 204 0
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4886/19684886/19684886-docs_service_history-modified-1774694987339.jpeg?ixlib=js-3.8.0&auto=format&s=29759ff82a0eb5a15abacf28bdfb4c8b saved to cache
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74f39e53-da8c-5155-9d52-4526635c8769
2026-03-29 20:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84de7d0>
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7203%252F18987203%252Fdocs_service_history-1774627429434.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D38836813acb98b27dcc1c0006bc5d0db') HTTP/1.1" 204 0
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7203/18987203/docs_service_history-1774627429434.jpg?ixlib=js-3.8.0&auto=format&s=38836813acb98b27dcc1c0006bc5d0db saved to cache
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2345849f-d8ac-55cb-95be-1ed8429984c7
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faff9c90>
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3801%252F20453801%252Fdocs_service_history-1774781838817.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D761c92404ef4179832ee00e65cc4066b') HTTP/1.1" 204 0
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3801/20453801/docs_service_history-1774781838817.jpg?ixlib=js-3.8.0&auto=format&s=761c92404ef4179832ee00e65cc4066b saved to cache
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e912281f-4476-5bdc-af72-fa9417500154
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9449110>
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5903%252F20405903%252Fdocs_service_history-1774696208570.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcce9c1ebb4b423b85e3a5df4f5e89527') HTTP/1.1" 204 0
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5903/20405903/docs_service_history-1774696208570.jpg?ixlib=js-3.8.0&auto=format&s=cce9c1ebb4b423b85e3a5df4f5e89527 saved to cache
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9314e08-4e07-5cf0-9461-c3e95cec9593
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0e6e10>
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7082%252F20487082%252Fdocs_service_history-1774712188615.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da2db15aa9c56308bb5c1761d0f5e2240') HTTP/1.1" 204 0
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7082/20487082/docs_service_history-1774712188615.jpg?ixlib=js-3.8.0&auto=format&s=a2db15aa9c56308bb5c1761d0f5e2240 saved to cache
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca4125e8-1e35-5063-86dc-574ceda4cf5c
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84dd610>
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4886%252F19684886%252Finterior_boot-1774514623318.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4886/19684886/interior_boot-1774514623318.jpg saved to cache
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74f39e53-da8c-5155-9d52-4526635c8769
2026-03-29 20:06:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 74f39e53-da8c-5155-9d52-4526635c8769 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_front_driver-1774447666055.jpg> (referer: None)
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4886/19684886/interior_rear_seats-1774514448762.jpg> (referer: None)
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0543/17190543/docs_service_history-1774697592679.jpg?ixlib=js-3.8.0&auto=format&s=4afa988e7d2cd7e5cecb8bea4f1fa856> (referer: None)
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0543/17190543/docs_service_history-1774697592733.jpg?ixlib=js-3.8.0&auto=format&s=82fbb9664002c4f85220c84bdc45e955> (referer: None)
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7082/20487082/interior_boot-1774711575489.jpg> (referer: None)
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4886/19684886/interior_dashboard-1774514486333.jpg> (referer: None)
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7203/18987203/interior_boot-1774627004283.jpg> (referer: None)
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5903/20405903/interior_boot-1774273717384.jpg> (referer: None)
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4226/20484226/interior_boot-1774691354714.jpg> (referer: None)
2026-03-29 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3801/20453801/interior_boot-1774781426487.jpg> (referer: None)
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f86fe310>
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4886%252F19684886%252Fexterior_front_driver-1774447666055.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_front_driver-1774447666055.jpg saved to cache
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74f39e53-da8c-5155-9d52-4526635c8769
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9098790>
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4886%252F19684886%252Finterior_rear_seats-1774514448762.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4886/19684886/interior_rear_seats-1774514448762.jpg saved to cache
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74f39e53-da8c-5155-9d52-4526635c8769
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ea7710>
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0543%252F17190543%252Fdocs_service_history-1774697592679.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4afa988e7d2cd7e5cecb8bea4f1fa856') HTTP/1.1" 204 0
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0543/17190543/docs_service_history-1774697592679.jpg?ixlib=js-3.8.0&auto=format&s=4afa988e7d2cd7e5cecb8bea4f1fa856 saved to cache
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2dd847c2-5725-5f6e-b509-5a9602b2b059
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf90b10>
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0543%252F17190543%252Fdocs_service_history-1774697592733.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D82fbb9664002c4f85220c84bdc45e955') HTTP/1.1" 204 0
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0543/17190543/docs_service_history-1774697592733.jpg?ixlib=js-3.8.0&auto=format&s=82fbb9664002c4f85220c84bdc45e955 saved to cache
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2dd847c2-5725-5f6e-b509-5a9602b2b059
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fe5a50>
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7082%252F20487082%252Finterior_boot-1774711575489.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7082/20487082/interior_boot-1774711575489.jpg saved to cache
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ca4125e8-1e35-5063-86dc-574ceda4cf5c
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95d7d50>
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4886%252F19684886%252Finterior_dashboard-1774514486333.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4886/19684886/interior_dashboard-1774514486333.jpg saved to cache
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74f39e53-da8c-5155-9d52-4526635c8769
2026-03-29 20:06:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74f39e53-da8c-5155-9d52-4526635c8769, skipping ID generation
2026-03-29 20:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74f39e53-da8c-5155-9d52-4526635c8769 with scrape type 1
2026-03-29 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74f39e53-da8c-5155-9d52-4526635c8769 sending to next pipeline
2026-03-29 20:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 74f39e53-da8c-5155-9d52-4526635c8769, identifier: 19684886
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88d8090>
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7203%252F18987203%252Finterior_boot-1774627004283.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7203/18987203/interior_boot-1774627004283.jpg saved to cache
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2345849f-d8ac-55cb-95be-1ed8429984c7
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf69050>
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5903%252F20405903%252Finterior_boot-1774273717384.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5903/20405903/interior_boot-1774273717384.jpg saved to cache
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9314e08-4e07-5cf0-9461-c3e95cec9593
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafd5450>
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4226%252F20484226%252Finterior_boot-1774691354714.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4226/20484226/interior_boot-1774691354714.jpg saved to cache
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad73250>
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3801%252F20453801%252Finterior_boot-1774781426487.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3801/20453801/interior_boot-1774781426487.jpg saved to cache
2026-03-29 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e912281f-4476-5bdc-af72-fa9417500154
2026-03-29 20:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 74f39e53-da8c-5155-9d52-4526635c8769 with identifier: 19684886
2026-03-29 20:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 74f39e53-da8c-5155-9d52-4526635c8769 with identifier: 19684886
2026-03-29 20:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 74f39e53-da8c-5155-9d52-4526635c8769 with identifier: 19684886 to the API
2026-03-29 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4886/19684886/interior_dashboard-1774514486333.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '74f39e53-da8c-5155-9d52-4526635c8769',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KO17 VLR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19684886',
'listing': 'auction',
'location': 'Cardiff Cardiff',
'make': 'Mercedes',
'model': 'CLA Class',
'odometer': 42038,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 596142,
'Height': 1977,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_front_driver-1774447666055.jpg',
'Width': 2636},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 626063,
'Height': 1949,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_rear_driver-1774448592881.jpg',
'Width': 2598},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639536,
'Height': 1952,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_front_passenger-1774448533108.jpg',
'Width': 2602},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 857024,
'Height': 2155,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4886/19684886/exterior_rear_passenger-1774448548622.jpg',
'Width': 2873},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1166614,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/4886/19684886/interior_front_seats-1774448671878.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1515996,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/4886/19684886/interior_rear_seats-1774514448762.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1959830,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4886/19684886/interior_dashboard-1774514486333.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2414555,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/4886/19684886/interior_boot-1774514623318.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74f39e53-da8c-5155-9d52-4526635c8769/74f39e53-da8c-5155-9d52-4526635c8769_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 885466,
'Height': 4096,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4886/19684886/19684886-docs_service_history-modified-1774694987339.jpeg?ixlib=js-3.8.0&auto=format&s=29759ff82a0eb5a15abacf28bdfb4c8b',
'Width': 3072}],
'price': 11339,
'price_includes_vat': False,
'registration_date': '2017-06-19',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes CLA 220 Sport D Auto',
'transmission': 'automatic',
'trim': 'CLA 220 Sport D Auto',
'vin': 'WDD1179032N544624',
'year': 2017}
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719684886%27 HTTP/1.1" 200 None
2026-03-29 20:06:42 [motorway.uk] INFO: Saving data for 19684886: {'created_time': 1774814802.249564, 'last_price_update_time': 1774814802.249574, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19684886') HTTP/1.1" 204 0
2026-03-29 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7082/20487082/instrument_cluster-1774711616505.jpg> (referer: None)
2026-03-29 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4226/20484226/instrument_cluster-1774691369785.jpg> (referer: None)
2026-03-29 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5903/20405903/instrument_cluster-1774273714847.jpg> (referer: None)
2026-03-29 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7082/20487082/interior_dashboard-1774714905276.jpg> (referer: None)
2026-03-29 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5903/20405903/interior_dashboard-1774273745602.jpg> (referer: None)
2026-03-29 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3801/20453801/interior_dashboard-1774785787347.jpg> (referer: None)
2026-03-29 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7203/18987203/instrument_cluster-1774627086219.jpg> (referer: None)
2026-03-29 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3801/20453801/instrument_cluster-1774781303066.jpg> (referer: None)
2026-03-29 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0543/17190543/interior_boot-1774706736059.jpg> (referer: None)
2026-03-29 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7203/18987203/interior_dashboard-1774627132715.jpg> (referer: None)
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f74a50>
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7082%252F20487082%252Finstrument_cluster-1774711616505.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7082/20487082/instrument_cluster-1774711616505.jpg saved to cache
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca4125e8-1e35-5063-86dc-574ceda4cf5c
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f944bc10>
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4226%252F20484226%252Finstrument_cluster-1774691369785.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4226/20484226/instrument_cluster-1774691369785.jpg saved to cache
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0e7c50>
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5903%252F20405903%252Finstrument_cluster-1774273714847.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5903/20405903/instrument_cluster-1774273714847.jpg saved to cache
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9314e08-4e07-5cf0-9461-c3e95cec9593
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95d7990>
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7082%252F20487082%252Finterior_dashboard-1774714905276.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7082/20487082/interior_dashboard-1774714905276.jpg saved to cache
2026-03-29 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca4125e8-1e35-5063-86dc-574ceda4cf5c
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f909bd90>
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5903%252F20405903%252Finterior_dashboard-1774273745602.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5903/20405903/interior_dashboard-1774273745602.jpg saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9314e08-4e07-5cf0-9461-c3e95cec9593
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ea5cd0>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3801%252F20453801%252Finterior_dashboard-1774785787347.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3801/20453801/interior_dashboard-1774785787347.jpg saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e912281f-4476-5bdc-af72-fa9417500154
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9098ed0>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7203%252F18987203%252Finstrument_cluster-1774627086219.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7203/18987203/instrument_cluster-1774627086219.jpg saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2345849f-d8ac-55cb-95be-1ed8429984c7
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ea53d0>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3801%252F20453801%252Finstrument_cluster-1774781303066.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3801/20453801/instrument_cluster-1774781303066.jpg saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e912281f-4476-5bdc-af72-fa9417500154
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f86fc190>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0543%252F17190543%252Finterior_boot-1774706736059.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0543/17190543/interior_boot-1774706736059.jpg saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2dd847c2-5725-5f6e-b509-5a9602b2b059
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d4510>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7203%252F18987203%252Finterior_dashboard-1774627132715.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7203/18987203/interior_dashboard-1774627132715.jpg saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2345849f-d8ac-55cb-95be-1ed8429984c7
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_rear_passenger-1774780128876.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4226/20484226/interior_dashboard-1774691400517.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0543/17190543/interior_dashboard-1774696300992.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7082/20487082/interior_rear_seats-1774711684863.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5903/20405903/interior_rear_seats-1774273719118.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7203/18987203/interior_rear_seats-1774626975279.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7203/18987203/interior_front_seats-1774626953269.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3801/20453801/interior_front_seats-1774781245614.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4226/20484226/interior_rear_seats-1774691295817.jpg> (referer: None)
2026-03-29 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0543/17190543/interior_rear_seats-1774696250896.jpg> (referer: None)
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8953490>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3801%252F20453801%252Fexterior_rear_passenger-1774780128876.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_rear_passenger-1774780128876.jpg saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e912281f-4476-5bdc-af72-fa9417500154
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8953590>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4226%252F20484226%252Finterior_dashboard-1774691400517.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4226/20484226/interior_dashboard-1774691400517.jpg saved to cache
2026-03-29 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90b8550>
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0543%252F17190543%252Finterior_dashboard-1774696300992.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0543/17190543/interior_dashboard-1774696300992.jpg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2dd847c2-5725-5f6e-b509-5a9602b2b059
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a93690>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7082%252F20487082%252Finterior_rear_seats-1774711684863.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7082/20487082/interior_rear_seats-1774711684863.jpg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca4125e8-1e35-5063-86dc-574ceda4cf5c
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ab1d90>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5903%252F20405903%252Finterior_rear_seats-1774273719118.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5903/20405903/interior_rear_seats-1774273719118.jpg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9314e08-4e07-5cf0-9461-c3e95cec9593
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90b87d0>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7203%252F18987203%252Finterior_rear_seats-1774626975279.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7203/18987203/interior_rear_seats-1774626975279.jpg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2345849f-d8ac-55cb-95be-1ed8429984c7
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8458550>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7203%252F18987203%252Finterior_front_seats-1774626953269.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7203/18987203/interior_front_seats-1774626953269.jpg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2345849f-d8ac-55cb-95be-1ed8429984c7
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90bbb90>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3801%252F20453801%252Finterior_front_seats-1774781245614.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3801/20453801/interior_front_seats-1774781245614.jpg saved to cache
2026-03-29 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e912281f-4476-5bdc-af72-fa9417500154
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f894fc90>
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4226%252F20484226%252Finterior_rear_seats-1774691295817.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4226/20484226/interior_rear_seats-1774691295817.jpg saved to cache
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f962a7d0>
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0543%252F17190543%252Finterior_rear_seats-1774696250896.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0543/17190543/interior_rear_seats-1774696250896.jpg saved to cache
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2dd847c2-5725-5f6e-b509-5a9602b2b059
2026-03-29 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7082/20487082/exterior_rear_passenger-1774714923302.jpg> (referer: None)
2026-03-29 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_rear_passenger-1774273371466.jpg> (referer: None)
2026-03-29 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_rear_passenger-1774625978391.jpg> (referer: None)
2026-03-29 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5903/20405903/interior_front_seats-1774273721445.jpg> (referer: None)
2026-03-29 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_front_passenger-1774780155579.jpg> (referer: None)
2026-03-29 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7082/20487082/interior_front_seats-1774711609966.jpg> (referer: None)
2026-03-29 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4226/20484226/interior_front_seats-1774691278089.jpg> (referer: None)
2026-03-29 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0543/17190543/interior_front_seats-1774697641236.jpg> (referer: None)
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a93b50>
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7082%252F20487082%252Fexterior_rear_passenger-1774714923302.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7082/20487082/exterior_rear_passenger-1774714923302.jpg saved to cache
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca4125e8-1e35-5063-86dc-574ceda4cf5c
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8715d90>
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5903%252F20405903%252Fexterior_rear_passenger-1774273371466.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_rear_passenger-1774273371466.jpg saved to cache
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9314e08-4e07-5cf0-9461-c3e95cec9593
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89e6c10>
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7203%252F18987203%252Fexterior_rear_passenger-1774625978391.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_rear_passenger-1774625978391.jpg saved to cache
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2345849f-d8ac-55cb-95be-1ed8429984c7
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ea6390>
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5903%252F20405903%252Finterior_front_seats-1774273721445.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5903/20405903/interior_front_seats-1774273721445.jpg saved to cache
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9314e08-4e07-5cf0-9461-c3e95cec9593
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf63350>
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3801%252F20453801%252Fexterior_front_passenger-1774780155579.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_front_passenger-1774780155579.jpg saved to cache
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e912281f-4476-5bdc-af72-fa9417500154
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf7e910>
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7082%252F20487082%252Finterior_front_seats-1774711609966.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7082/20487082/interior_front_seats-1774711609966.jpg saved to cache
2026-03-29 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca4125e8-1e35-5063-86dc-574ceda4cf5c
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d3ed0>
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4226%252F20484226%252Finterior_front_seats-1774691278089.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4226/20484226/interior_front_seats-1774691278089.jpg saved to cache
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9448a90>
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0543%252F17190543%252Finterior_front_seats-1774697641236.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0543/17190543/interior_front_seats-1774697641236.jpg saved to cache
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2dd847c2-5725-5f6e-b509-5a9602b2b059
2026-03-29 20:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7082/20487082/exterior_rear_driver-1774711206197.jpg> (referer: None)
2026-03-29 20:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_rear_driver-1774780102522.jpg> (referer: None)
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_front_driver-1774273367975.jpg> (referer: None)
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_rear_driver-1774690504595.jpg> (referer: None)
2026-03-29 20:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_rear_passenger-1774690555747.jpg> (referer: None)
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_front_driver-1774625958768.jpg> (referer: None)
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_rear_passenger-1774695645904.jpg> (referer: None)
2026-03-29 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_rear_driver-1774695625352.jpg> (referer: None)
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa16b710>
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7082%252F20487082%252Fexterior_rear_driver-1774711206197.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7082/20487082/exterior_rear_driver-1774711206197.jpg saved to cache
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca4125e8-1e35-5063-86dc-574ceda4cf5c
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f864de10>
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3801%252F20453801%252Fexterior_rear_driver-1774780102522.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_rear_driver-1774780102522.jpg saved to cache
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e912281f-4476-5bdc-af72-fa9417500154
2026-03-29 20:06:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e912281f-4476-5bdc-af72-fa9417500154, skipping ID generation
2026-03-29 20:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e912281f-4476-5bdc-af72-fa9417500154 with scrape type 1
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e912281f-4476-5bdc-af72-fa9417500154 sending to next pipeline
2026-03-29 20:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e912281f-4476-5bdc-af72-fa9417500154, identifier: 20453801
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0a5b50>
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5903%252F20405903%252Fexterior_front_driver-1774273367975.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_front_driver-1774273367975.jpg saved to cache
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9314e08-4e07-5cf0-9461-c3e95cec9593
2026-03-29 20:06:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9314e08-4e07-5cf0-9461-c3e95cec9593, skipping ID generation
2026-03-29 20:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9314e08-4e07-5cf0-9461-c3e95cec9593 with scrape type 1
2026-03-29 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9314e08-4e07-5cf0-9461-c3e95cec9593 sending to next pipeline
2026-03-29 20:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a9314e08-4e07-5cf0-9461-c3e95cec9593, identifier: 20405903
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf62bd0>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4226%252F20484226%252Fexterior_rear_driver-1774690504595.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_rear_driver-1774690504595.jpg saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadbcad0>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4226%252F20484226%252Fexterior_rear_passenger-1774690555747.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_rear_passenger-1774690555747.jpg saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89e5f90>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7203%252F18987203%252Fexterior_front_driver-1774625958768.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_front_driver-1774625958768.jpg saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2345849f-d8ac-55cb-95be-1ed8429984c7
2026-03-29 20:06:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2345849f-d8ac-55cb-95be-1ed8429984c7, skipping ID generation
2026-03-29 20:06:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2345849f-d8ac-55cb-95be-1ed8429984c7 with scrape type 1
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2345849f-d8ac-55cb-95be-1ed8429984c7 sending to next pipeline
2026-03-29 20:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2345849f-d8ac-55cb-95be-1ed8429984c7, identifier: 18987203
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89a4c50>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0543%252F17190543%252Fexterior_rear_passenger-1774695645904.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_rear_passenger-1774695645904.jpg saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2dd847c2-5725-5f6e-b509-5a9602b2b059
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94f0350>
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0543%252F17190543%252Fexterior_rear_driver-1774695625352.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_rear_driver-1774695625352.jpg saved to cache
2026-03-29 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2dd847c2-5725-5f6e-b509-5a9602b2b059
2026-03-29 20:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e912281f-4476-5bdc-af72-fa9417500154 with identifier: 20453801
2026-03-29 20:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e912281f-4476-5bdc-af72-fa9417500154 with identifier: 20453801
2026-03-29 20:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e912281f-4476-5bdc-af72-fa9417500154 with identifier: 20453801 to the API
2026-03-29 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_rear_driver-1774780102522.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e912281f-4476-5bdc-af72-fa9417500154',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HN08 BDF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20453801',
'listing': 'auction',
'location': 'Swindon Swindon',
'make': 'Mercedes',
'model': 'SLK',
'odometer': 76500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1754728,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_front_driver-1774780063914.jpg',
'Width': 3454},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1231627,
'Height': 2063,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_rear_driver-1774780102522.jpg',
'Width': 2750},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1717323,
'Height': 2513,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_front_passenger-1774780155579.jpg',
'Width': 3351},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1340073,
'Height': 2200,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3801/20453801/exterior_rear_passenger-1774780128876.jpg',
'Width': 2933},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3564922,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3801/20453801/interior_front_seats-1774781245614.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2302234,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3801/20453801/interior_dashboard-1774785787347.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3109830,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3801/20453801/instrument_cluster-1774781303066.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3406822,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3801/20453801/interior_boot-1774781426487.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1270482,
'Height': 1855,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3801/20453801/docs_service_history-1774781838817.jpg?ixlib=js-3.8.0&auto=format&s=761c92404ef4179832ee00e65cc4066b',
'Width': 6456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e912281f-4476-5bdc-af72-fa9417500154/e912281f-4476-5bdc-af72-fa9417500154_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 796625,
'Height': 4371,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/3801/20453801/docs_service_history-1774786360884.jpg?ixlib=js-3.8.0&auto=format&s=bb743cf060952967fddc846fe20e7d79',
'Width': 5828}],
'price': 1936,
'price_includes_vat': False,
'registration_date': '2008-03-28',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes SLK 200 Kompressor Auto',
'transmission': 'automatic',
'trim': '200 Kompressor Auto',
'vin': 'WDB1714422F185089',
'year': 2008}
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720453801%27 HTTP/1.1" 200 None
2026-03-29 20:06:48 [motorway.uk] INFO: Saving data for 20453801: {'created_time': 1774814808.158964, 'last_price_update_time': 1774814808.158975, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20453801') HTTP/1.1" 204 0
2026-03-29 20:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a9314e08-4e07-5cf0-9461-c3e95cec9593 with identifier: 20405903
2026-03-29 20:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a9314e08-4e07-5cf0-9461-c3e95cec9593 with identifier: 20405903
2026-03-29 20:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a9314e08-4e07-5cf0-9461-c3e95cec9593 with identifier: 20405903 to the API
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_front_driver-1774273367975.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a9314e08-4e07-5cf0-9461-c3e95cec9593',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AP22 LHJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20405903',
'listing': 'auction',
'location': 'Greater Manchester Manchester',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 18152,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1274680,
'Height': 2368,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_front_driver-1774273367975.jpg',
'Width': 3157},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1315295,
'Height': 2256,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_rear_driver-1774273378499.jpg',
'Width': 3008},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1439947,
'Height': 2377,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_front_passenger-1774273379552.jpg',
'Width': 3169},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 942069,
'Height': 1990,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5903/20405903/exterior_rear_passenger-1774273371466.jpg',
'Width': 2653},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2265704,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5903/20405903/interior_front_seats-1774273721445.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2145871,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5903/20405903/interior_rear_seats-1774273719118.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1550866,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5903/20405903/interior_dashboard-1774273745602.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1246494,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5903/20405903/instrument_cluster-1774273714847.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3111096,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5903/20405903/interior_boot-1774273717384.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9314e08-4e07-5cf0-9461-c3e95cec9593/a9314e08-4e07-5cf0-9461-c3e95cec9593_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1265201,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5903/20405903/docs_service_history-1774696208570.jpg?ixlib=js-3.8.0&auto=format&s=cce9c1ebb4b423b85e3a5df4f5e89527',
'Width': 2880}],
'price': 18667,
'price_includes_vat': False,
'registration_date': '2022-08-05',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 200 AMG Line Executive Auto',
'transmission': 'automatic',
'trim': 'A 200 AMG Line Executive Auto',
'vin': 'W1K3F8HB9PN294257',
'year': 2022}
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720405903%27 HTTP/1.1" 200 None
2026-03-29 20:06:48 [motorway.uk] INFO: Saving data for 20405903: {'created_time': 1774814808.528574, 'last_price_update_time': 1774814808.528585, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20405903') HTTP/1.1" 204 0
2026-03-29 20:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2345849f-d8ac-55cb-95be-1ed8429984c7 with identifier: 18987203
2026-03-29 20:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2345849f-d8ac-55cb-95be-1ed8429984c7 with identifier: 18987203
2026-03-29 20:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2345849f-d8ac-55cb-95be-1ed8429984c7 with identifier: 18987203 to the API
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_front_driver-1774625958768.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '4.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2345849f-d8ac-55cb-95be-1ed8429984c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'A17 MNN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18987203',
'listing': 'auction',
'location': 'Middlesbrough Middlesbrough',
'make': 'Mercedes',
'model': 'AMG',
'odometer': 60300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1612444,
'Height': 2676,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_front_driver-1774625958768.jpg',
'Width': 3568},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1714602,
'Height': 2697,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_rear_driver-1774625969359.jpg',
'Width': 3596},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1482200,
'Height': 2641,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_front_passenger-1774626051014.jpg',
'Width': 3521},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1331664,
'Height': 2546,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7203/18987203/exterior_rear_passenger-1774625978391.jpg',
'Width': 3394},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3187379,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7203/18987203/interior_front_seats-1774626953269.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2829210,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7203/18987203/interior_rear_seats-1774626975279.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3366622,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7203/18987203/interior_dashboard-1774627132715.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2906376,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7203/18987203/instrument_cluster-1774627086219.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2410870,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7203/18987203/interior_boot-1774627004283.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2345849f-d8ac-55cb-95be-1ed8429984c7/2345849f-d8ac-55cb-95be-1ed8429984c7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1148022,
'Height': 2173,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7203/18987203/docs_service_history-1774627429434.jpg?ixlib=js-3.8.0&auto=format&s=38836813acb98b27dcc1c0006bc5d0db',
'Width': 1564}],
'price': 26261,
'price_includes_vat': False,
'registration_date': '2017-10-13',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes AMG C 63 S Premium Auto',
'transmission': 'automatic',
'trim': 'C 63 S Premium Auto',
'vin': 'WDD2054872F608668',
'year': 2017}
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718987203%27 HTTP/1.1" 200 None
2026-03-29 20:06:48 [motorway.uk] INFO: Saving data for 18987203: {'created_time': 1774814808.975686, 'last_price_update_time': 1774814808.975697, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18987203') HTTP/1.1" 204 0
2026-03-29 20:06:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7082/20487082/exterior_front_driver-1774711205397.jpg> (referer: None)
2026-03-29 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7569/20497569/interior_boot-1774777276357.jpg> (referer: None)
2026-03-29 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7569/20497569/instrument_cluster-1774776636399.jpg> (referer: None)
2026-03-29 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7569/20497569/wheels_front_driver-1774776285162.jpg> (referer: None)
2026-03-29 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_front_driver-1774690487008.jpg> (referer: None)
2026-03-29 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_front_driver-1774695536287.jpg> (referer: None)
2026-03-29 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6408/20456408/docs_service_history-1774699671692.jpg?ixlib=js-3.8.0&auto=format&s=2448867cab4f8d8cc7733ca7ff24f134> (referer: None)
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f946b750>
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7082%252F20487082%252Fexterior_front_driver-1774711205397.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7082/20487082/exterior_front_driver-1774711205397.jpg saved to cache
2026-03-29 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca4125e8-1e35-5063-86dc-574ceda4cf5c
2026-03-29 20:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca4125e8-1e35-5063-86dc-574ceda4cf5c, skipping ID generation
2026-03-29 20:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca4125e8-1e35-5063-86dc-574ceda4cf5c with scrape type 1
2026-03-29 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca4125e8-1e35-5063-86dc-574ceda4cf5c sending to next pipeline
2026-03-29 20:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ca4125e8-1e35-5063-86dc-574ceda4cf5c, identifier: 20487082
2026-03-29 20:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ca4125e8-1e35-5063-86dc-574ceda4cf5c with identifier: 20487082
2026-03-29 20:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ca4125e8-1e35-5063-86dc-574ceda4cf5c with identifier: 20487082
2026-03-29 20:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ca4125e8-1e35-5063-86dc-574ceda4cf5c with identifier: 20487082 to the API
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7082/20487082/exterior_front_driver-1774711205397.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'ca4125e8-1e35-5063-86dc-574ceda4cf5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MC71 NHX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487082',
'listing': 'auction',
'location': 'None None',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 27296,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1163217,
'Height': 2485,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7082/20487082/exterior_front_driver-1774711205397.jpg',
'Width': 3313},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 684751,
'Height': 2456,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7082/20487082/exterior_rear_driver-1774711206197.jpg',
'Width': 3274},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561027,
'Height': 1544,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7082/20487082/exterior_front_passenger-1774711213663.jpg',
'Width': 2059},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1112683,
'Height': 2202,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7082/20487082/exterior_rear_passenger-1774714923302.jpg',
'Width': 2936},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1824236,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7082/20487082/interior_front_seats-1774711609966.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1937716,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7082/20487082/interior_rear_seats-1774711684863.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1348827,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7082/20487082/interior_dashboard-1774714905276.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1045742,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7082/20487082/instrument_cluster-1774711616505.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2089895,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7082/20487082/interior_boot-1774711575489.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca4125e8-1e35-5063-86dc-574ceda4cf5c/ca4125e8-1e35-5063-86dc-574ceda4cf5c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1274075,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7082/20487082/docs_service_history-1774712188615.jpg?ixlib=js-3.8.0&auto=format&s=a2db15aa9c56308bb5c1761d0f5e2240',
'Width': 3840}],
'price': 13489,
'price_includes_vat': False,
'registration_date': '2021-09-17',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai Premiere ED DiG-T MHEV',
'transmission': 'manual',
'trim': 'Premiere ED DiG-T MHEV',
'vin': 'SJNTAAJ12U1026014',
'year': 2021}
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487082%27 HTTP/1.1" 200 None
2026-03-29 20:06:49 [motorway.uk] INFO: Saving data for 20487082: {'created_time': 1774814809.692883, 'last_price_update_time': 1774814809.692892, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487082') HTTP/1.1" 204 0
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9170790>
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7569%252F20497569%252Finterior_boot-1774777276357.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7569/20497569/interior_boot-1774777276357.jpg saved to cache
2026-03-29 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f914b750>
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Finstrument_cluster-1774776636399.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/instrument_cluster-1774776636399.jpg saved to cache
2026-03-29 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8202590>
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Fwheels_front_driver-1774776285162.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/wheels_front_driver-1774776285162.jpg saved to cache
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89aee90>
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4226%252F20484226%252Fexterior_front_driver-1774690487008.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_front_driver-1774690487008.jpg saved to cache
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d
2026-03-29 20:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f0a5390-9f4b-582b-8d5d-f092773ea91d, skipping ID generation
2026-03-29 20:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d with scrape type 1
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f0a5390-9f4b-582b-8d5d-f092773ea91d sending to next pipeline
2026-03-29 20:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6f0a5390-9f4b-582b-8d5d-f092773ea91d, identifier: 20484226
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95315d0>
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0543%252F17190543%252Fexterior_front_driver-1774695536287.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_front_driver-1774695536287.jpg saved to cache
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dd847c2-5725-5f6e-b509-5a9602b2b059
2026-03-29 20:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dd847c2-5725-5f6e-b509-5a9602b2b059, skipping ID generation
2026-03-29 20:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd847c2-5725-5f6e-b509-5a9602b2b059 with scrape type 1
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dd847c2-5725-5f6e-b509-5a9602b2b059 sending to next pipeline
2026-03-29 20:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2dd847c2-5725-5f6e-b509-5a9602b2b059, identifier: 17190543
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9388790>
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5/ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6408%252F20456408%252Fdocs_service_history-1774699671692.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2448867cab4f8d8cc7733ca7ff24f134') HTTP/1.1" 204 0
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6408/20456408/docs_service_history-1774699671692.jpg?ixlib=js-3.8.0&auto=format&s=2448867cab4f8d8cc7733ca7ff24f134 saved to cache
2026-03-29 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5
2026-03-29 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6408/20456408/docs_service_history-1774699661485.jpg?ixlib=js-3.8.0&auto=format&s=421aff9f781dbcf6075c5104dffaa69b> (referer: None)
2026-03-29 20:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6f0a5390-9f4b-582b-8d5d-f092773ea91d with identifier: 20484226
2026-03-29 20:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6f0a5390-9f4b-582b-8d5d-f092773ea91d with identifier: 20484226
2026-03-29 20:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6f0a5390-9f4b-582b-8d5d-f092773ea91d with identifier: 20484226 to the API
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_front_driver-1774690487008.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '6f0a5390-9f4b-582b-8d5d-f092773ea91d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YY71 BNZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20484226',
'listing': 'auction',
'location': 'Derby Derby',
'make': 'BMW',
'model': '3 Series',
'odometer': 25317,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1681656,
'Height': 2545,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_front_driver-1774690487008.jpg',
'Width': 3393},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1301549,
'Height': 2418,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_rear_driver-1774690504595.jpg',
'Width': 3224},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1478891,
'Height': 2438,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_front_passenger-1774690551157.jpg',
'Width': 3251},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1369478,
'Height': 2409,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4226/20484226/exterior_rear_passenger-1774690555747.jpg',
'Width': 3212},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3397393,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4226/20484226/interior_front_seats-1774691278089.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3757854,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4226/20484226/interior_rear_seats-1774691295817.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1669873,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4226/20484226/interior_dashboard-1774691400517.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1206768,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4226/20484226/instrument_cluster-1774691369785.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a5390-9f4b-582b-8d5d-f092773ea91d/6f0a5390-9f4b-582b-8d5d-f092773ea91d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3235864,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4226/20484226/interior_boot-1774691354714.jpg',
'Width': 4032}],
'price': 20962,
'price_includes_vat': False,
'registration_date': '2021-10-26',
'seats_number': None,
'seller_name': None,
'title': 'BMW 330E M Sport Auto',
'transmission': 'automatic',
'trim': '330E M Sport Auto',
'vin': 'WBA6N32080FL91628',
'year': 2021}
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484226%27 HTTP/1.1" 200 None
2026-03-29 20:06:50 [motorway.uk] INFO: Saving data for 20484226: {'created_time': 1774814810.916589, 'last_price_update_time': 1774814810.9166, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20484226') HTTP/1.1" 204 0
2026-03-29 20:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2dd847c2-5725-5f6e-b509-5a9602b2b059 with identifier: 17190543
2026-03-29 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Brown HTTP/1.1" 200 None
2026-03-29 20:06:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2dd847c2-5725-5f6e-b509-5a9602b2b059 with identifier: 17190543
2026-03-29 20:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2dd847c2-5725-5f6e-b509-5a9602b2b059 with identifier: 17190543 to the API
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_front_driver-1774695536287.jpg>
{'auction_title': '',
'category': None,
'color': 'Brown',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '2dd847c2-5725-5f6e-b509-5a9602b2b059',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'E5 AJJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17190543',
'listing': 'auction',
'location': 'Leicestershire Coalville',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 88500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2657732,
'Height': 2757,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_front_driver-1774695536287.jpg',
'Width': 3676},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2353876,
'Height': 2711,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_rear_driver-1774695625352.jpg',
'Width': 3615},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2149947,
'Height': 2696,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_front_passenger-1774695646634.jpg',
'Width': 3594},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1958253,
'Height': 2560,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0543/17190543/exterior_rear_passenger-1774695645904.jpg',
'Width': 3413},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3813653,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0543/17190543/interior_front_seats-1774697641236.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3896149,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0543/17190543/interior_rear_seats-1774696250896.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1936936,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0543/17190543/interior_dashboard-1774696300992.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3320611,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0543/17190543/interior_boot-1774706736059.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 946222,
'Height': 3639,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0543/17190543/docs_service_history-1774697592679.jpg?ixlib=js-3.8.0&auto=format&s=4afa988e7d2cd7e5cecb8bea4f1fa856',
'Width': 2412},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd847c2-5725-5f6e-b509-5a9602b2b059/2dd847c2-5725-5f6e-b509-5a9602b2b059_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1171689,
'Height': 3752,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0543/17190543/docs_service_history-1774697592733.jpg?ixlib=js-3.8.0&auto=format&s=82fbb9664002c4f85220c84bdc45e955',
'Width': 2721}],
'price': 11790,
'price_includes_vat': False,
'registration_date': '2016-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Sport HSE Dynam SDV6 A',
'transmission': 'automatic',
'trim': 'Sport HSE Dynam SDV6 A',
'vin': 'SALWA2KE6GA592481',
'year': 2016}
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717190543%27 HTTP/1.1" 200 None
2026-03-29 20:06:51 [motorway.uk] INFO: Saving data for 17190543: {'created_time': 1774814811.477571, 'last_price_update_time': 1774814811.477581, 'auction_closing_time': 1774884600.0}
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17190543') HTTP/1.1" 204 0
2026-03-29 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7733/18037733/docs_service_history-1774713801273.jpg?ixlib=js-3.8.0&auto=format&s=3dbbb65ff6f6a9ec773888393be66491> (referer: None)
2026-03-29 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1224&page=34&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f949a9d0>
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5/ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6408%252F20456408%252Fdocs_service_history-1774699661485.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D421aff9f781dbcf6075c5104dffaa69b') HTTP/1.1" 204 0
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6408/20456408/docs_service_history-1774699661485.jpg?ixlib=js-3.8.0&auto=format&s=421aff9f781dbcf6075c5104dffaa69b saved to cache
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5
2026-03-29 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7733/18037733/interior_boot-1774204228985.jpg> (referer: None)
2026-03-29 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7569/20497569/interior_rear_seats-1774776620232.jpg> (referer: None)
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f949a890>
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01c56b0d-c369-5d23-8859-4dd29187bd3b/01c56b0d-c369-5d23-8859-4dd29187bd3b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7733%252F18037733%252Fdocs_service_history-1774713801273.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3dbbb65ff6f6a9ec773888393be66491') HTTP/1.1" 204 0
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7733/18037733/docs_service_history-1774713801273.jpg?ixlib=js-3.8.0&auto=format&s=3dbbb65ff6f6a9ec773888393be66491 saved to cache
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01c56b0d-c369-5d23-8859-4dd29187bd3b
2026-03-29 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13044273.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20481158.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:51 [motorway.uk] INFO: Found listing with ID: 19861645
2026-03-29 20:06:51 [motorway.uk] INFO: Found listing with ID: 20152688
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720152688%27 HTTP/1.1" 200 None
2026-03-29 20:06:51 [motorway.uk] INFO: Scrape type for 20152688: 1
2026-03-29 20:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81be890>
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01c56b0d-c369-5d23-8859-4dd29187bd3b/01c56b0d-c369-5d23-8859-4dd29187bd3b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7733%252F18037733%252Finterior_boot-1774204228985.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7733/18037733/interior_boot-1774204228985.jpg saved to cache
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01c56b0d-c369-5d23-8859-4dd29187bd3b
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0e65d0>
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7569%252F20497569%252Finterior_rear_seats-1774776620232.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7569/20497569/interior_rear_seats-1774776620232.jpg saved to cache
2026-03-29 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 18699505
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718699505%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [motorway.uk] INFO: Scrape type for 18699505: 1
2026-03-29 20:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20455511
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 19242613
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 17909162
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717909162%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [motorway.uk] INFO: Scrape type for 17909162: 1
2026-03-29 20:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9933259e-95b8-575f-8507-f6f4cbe0d31b with identifier: 13044273
2026-03-29 20:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9933259e-95b8-575f-8507-f6f4cbe0d31b with scrape type 1
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9933259e-95b8-575f-8507-f6f4cbe0d31b
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4273%252F13044273%252Fexterior_front_driver-1774625798712.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_front_driver-1774625798712.jpg not downloaded yet
2026-03-29 20:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7 with identifier: 20481158
2026-03-29 20:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7 with scrape type 1
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1158%252F20481158%252Fexterior_front_driver-1774682438509.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_front_driver-1774682438509.jpg not downloaded yet
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 8203355
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20378089
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20299221
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 18086482
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 19449183
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20485669
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20451319
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20410678
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 13676396
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713676396%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [motorway.uk] INFO: Scrape type for 13676396: 1
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4273%252F13044273%252Fexterior_rear_driver-1774625829656.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_rear_driver-1774625829656.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1158%252F20481158%252Fexterior_rear_driver-1774682447940.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_rear_driver-1774682447940.jpg not downloaded yet
2026-03-29 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20009659.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20388349.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 2387574
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 13149221
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20498874
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 19958948
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20435928
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20487335
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20279875
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 11436867
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20385406
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 19712537
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 17056470
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 19080843
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20261314
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 19037322
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 10154809
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 17587362
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20488866
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488866%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [motorway.uk] INFO: Scrape type for 20488866: 1
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4273%252F13044273%252Fexterior_front_passenger-1774625863614.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_front_passenger-1774625863614.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1158%252F20481158%252Fexterior_front_passenger-1774682451692.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_front_passenger-1774682451692.jpg not downloaded yet
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20475825
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20485471
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485471%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [motorway.uk] INFO: Scrape type for 20485471: 1
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4273%252F13044273%252Fexterior_rear_passenger-1774625846481.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_rear_passenger-1774625846481.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1158%252F20481158%252Fexterior_rear_passenger-1774682458339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_rear_passenger-1774682458339.jpg not downloaded yet
2026-03-29 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19873015.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 19631185
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719631185%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [motorway.uk] INFO: Scrape type for 19631185: 1
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4273%252F13044273%252Finterior_front_seats-1774626309705.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4273/13044273/interior_front_seats-1774626309705.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1158%252F20481158%252Finterior_front_seats-1774682864816.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1158/20481158/interior_front_seats-1774682864816.jpg not downloaded yet
2026-03-29 20:06:52 [motorway.uk] INFO: Found listing with ID: 20482587
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4273%252F13044273%252Finterior_rear_seats-1774626329461.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4273/13044273/interior_rear_seats-1774626329461.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1158%252F20481158%252Finterior_rear_seats-1774682869182.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1158/20481158/interior_rear_seats-1774682869182.jpg not downloaded yet
2026-03-29 20:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb with identifier: 20009659
2026-03-29 20:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb with scrape type 1
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9659%252F20009659%252Fexterior_front_driver-1774715273339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9659/20009659/exterior_front_driver-1774715273339.jpg not downloaded yet
2026-03-29 20:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ca406a8-3992-58fc-b802-55ff1840e4dc with identifier: 20388349
2026-03-29 20:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca406a8-3992-58fc-b802-55ff1840e4dc with scrape type 1
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ca406a8-3992-58fc-b802-55ff1840e4dc
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8349%252F20388349%252Fexterior_front_driver-1774188662802.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_front_driver-1774188662802.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4273%252F13044273%252Finterior_dashboard-1774626634567.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4273/13044273/interior_dashboard-1774626634567.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1158%252F20481158%252Finterior_dashboard-1774692169892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1158/20481158/interior_dashboard-1774692169892.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9659%252F20009659%252Fexterior_rear_driver-1774708496209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9659/20009659/exterior_rear_driver-1774708496209.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8349%252F20388349%252Fexterior_rear_driver-1774188655702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_rear_driver-1774188655702.jpg not downloaded yet
2026-03-29 20:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a87269b-eb10-5d84-a9b3-096b8e0f4464 with identifier: 19873015
2026-03-29 20:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464 with scrape type 1
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3015%252F19873015%252Fexterior_front_driver-1774715134982.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3015/19873015/exterior_front_driver-1774715134982.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4273%252F13044273%252Finterior_boot-1774626376328.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4273/13044273/interior_boot-1774626376328.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1158%252F20481158%252Finstrument_cluster-1774682914685.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1158/20481158/instrument_cluster-1774682914685.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9659%252F20009659%252Fexterior_front_passenger-1774708552291.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9659/20009659/exterior_front_passenger-1774708552291.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8349%252F20388349%252Fexterior_front_passenger-1774188658058.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_front_passenger-1774188658058.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3015%252F19873015%252Fexterior_rear_driver-1773769907988.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3015/19873015/exterior_rear_driver-1773769907988.jpg not downloaded yet
2026-03-29 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6408/20456408/interior_dashboard-1774697594737.jpg> (referer: None)
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4273%252F13044273%252Fdocs_service_history-1774626824143.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df4eb17217e7fbf4b3ab7245233302549%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4273/13044273/docs_service_history-1774626824143.jpg?ixlib=js-3.8.0&auto=format&s=f4eb17217e7fbf4b3ab7245233302549 not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1158%252F20481158%252Finterior_boot-1774682875078.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1158/20481158/interior_boot-1774682875078.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9659%252F20009659%252Fexterior_rear_passenger-1774708515768.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9659/20009659/exterior_rear_passenger-1774708515768.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8349%252F20388349%252Fexterior_rear_passenger-1774188663380.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_rear_passenger-1774188663380.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3015%252F19873015%252Fexterior_front_passenger-1774715397100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3015/19873015/exterior_front_passenger-1774715397100.jpg not downloaded yet
2026-03-29 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4273%252F13044273%252Fdocs_service_history-1774628234604.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0afa1384f9479f770f9e9fd1e9eb34a5%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4273/13044273/docs_service_history-1774628234604.jpg?ixlib=js-3.8.0&auto=format&s=0afa1384f9479f770f9e9fd1e9eb34a5 not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1158%252F20481158%252Fwheels_front_driver-1774682618514.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1158/20481158/wheels_front_driver-1774682618514.jpg not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9659%252F20009659%252Finterior_front_seats-1774709165496.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9659/20009659/interior_front_seats-1774709165496.jpg not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8349%252F20388349%252Finterior_front_seats-1774189345036.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8349/20388349/interior_front_seats-1774189345036.jpg not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3015%252F19873015%252Fexterior_rear_passenger-1773769830791.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3015/19873015/exterior_rear_passenger-1773769830791.jpg not downloaded yet
2026-03-29 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_rear_passenger-1774776910755.jpg> (referer: None)
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f91690d0>
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5/ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20456408%252Finterior_dashboard-1774697594737.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20456408/interior_dashboard-1774697594737.jpg saved to cache
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9659%252F20009659%252Finterior_rear_seats-1774709185041.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9659/20009659/interior_rear_seats-1774709185041.jpg not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8349%252F20388349%252Finterior_rear_seats-1774189345824.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8349/20388349/interior_rear_seats-1774189345824.jpg not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3015%252F19873015%252Finterior_front_seats-1774713429579.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3015/19873015/interior_front_seats-1774713429579.jpg not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9659%252F20009659%252Finterior_dashboard-1774715261503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9659/20009659/interior_dashboard-1774715261503.jpg not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8349%252F20388349%252Finterior_dashboard-1774189355130.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8349/20388349/interior_dashboard-1774189355130.jpg not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3015%252F19873015%252Finterior_rear_seats-1774713498950.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3015/19873015/interior_rear_seats-1774713498950.jpg not downloaded yet
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfb8610>
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Fexterior_rear_passenger-1774776910755.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_rear_passenger-1774776910755.jpg saved to cache
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a
2026-03-29 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_front_passenger-1774776942870.jpg> (referer: None)
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9659%252F20009659%252Finstrument_cluster-1774709253420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9659/20009659/instrument_cluster-1774709253420.jpg not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8349%252F20388349%252Finterior_boot-1774189344095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8349/20388349/interior_boot-1774189344095.jpg not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3015%252F19873015%252Finterior_dashboard-1774713553872.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3015/19873015/interior_dashboard-1774713553872.jpg not downloaded yet
2026-03-29 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6408/20456408/interior_boot-1774697577775.jpg> (referer: None)
2026-03-29 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7733/18037733/interior_rear_seats-1774204310690.jpg> (referer: None)
2026-03-29 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7733/18037733/instrument_cluster-1774204350912.jpg> (referer: None)
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9659%252F20009659%252Finterior_boot-1774709239778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9659/20009659/interior_boot-1774709239778.jpg not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8349%252F20388349%252Fdamage_scratches-1774188806758.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8349/20388349/damage_scratches-1774188806758.jpg not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3015%252F19873015%252Finstrument_cluster-1774713524506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3015/19873015/instrument_cluster-1774713524506.jpg not downloaded yet
2026-03-29 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_rear_driver-1774682447940.jpg> (referer: None)
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9659%252F20009659%252Fdocs_service_history-1774710084383.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D081159dacfc62f83db6751565dbd6c68%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9659/20009659/docs_service_history-1774710084383.jpg?ixlib=js-3.8.0&auto=format&s=081159dacfc62f83db6751565dbd6c68 not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8349%252F20388349%252Fdamage_dents-1774694668156.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8349/20388349/damage_dents-1774694668156.jpg not downloaded yet
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3015%252F19873015%252Finterior_boot-1774713773856.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3015/19873015/interior_boot-1774713773856.jpg not downloaded yet
2026-03-29 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_rear_passenger-1774682458339.jpg> (referer: None)
2026-03-29 20:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7569/20497569/interior_front_seats-1774776617909.jpg> (referer: None)
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3015%252F19873015%252Fdocs_service_history-1774714085575.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D18c62fa37e44a1c749605fb1578640bf%27 HTTP/1.1" 200 None
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3015/19873015/docs_service_history-1774714085575.jpg?ixlib=js-3.8.0&auto=format&s=18c62fa37e44a1c749605fb1578640bf not downloaded yet
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad6cd10>
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Fexterior_front_passenger-1774776942870.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_front_passenger-1774776942870.jpg saved to cache
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0cbad0>
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5/ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20456408%252Finterior_boot-1774697577775.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20456408/interior_boot-1774697577775.jpg saved to cache
2026-03-29 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5
2026-03-29 20:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad2ef90>
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01c56b0d-c369-5d23-8859-4dd29187bd3b/01c56b0d-c369-5d23-8859-4dd29187bd3b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7733%252F18037733%252Finterior_rear_seats-1774204310690.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7733/18037733/interior_rear_seats-1774204310690.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01c56b0d-c369-5d23-8859-4dd29187bd3b
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8265fd0>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01c56b0d-c369-5d23-8859-4dd29187bd3b/01c56b0d-c369-5d23-8859-4dd29187bd3b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7733%252F18037733%252Finstrument_cluster-1774204350912.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7733/18037733/instrument_cluster-1774204350912.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01c56b0d-c369-5d23-8859-4dd29187bd3b
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20435647.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6408/20456408/interior_rear_seats-1774697575539.jpg> (referer: None)
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8968610>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1158%252F20481158%252Fexterior_rear_driver-1774682447940.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_rear_driver-1774682447940.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadba250>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1158%252F20481158%252Fexterior_rear_passenger-1774682458339.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_rear_passenger-1774682458339.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f9fed0>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7569%252F20497569%252Finterior_front_seats-1774776617909.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7569/20497569/interior_front_seats-1774776617909.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7733/18037733/interior_dashboard-1774203241481.jpg> (referer: None)
2026-03-29 20:06:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01169dea-f718-5be9-8612-367ea356ce39 with identifier: 20435647
2026-03-29 20:06:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01169dea-f718-5be9-8612-367ea356ce39 with scrape type 1
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01169dea-f718-5be9-8612-367ea356ce39
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5647%252F20435647%252Fexterior_front_driver-1774719060689.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_front_driver-1774719060689.jpg not downloaded yet
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab7f790>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5/ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20456408%252Finterior_rear_seats-1774697575539.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20456408/interior_rear_seats-1774697575539.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6408/20456408/interior_front_seats-1774697579854.jpg> (referer: None)
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5647%252F20435647%252Fexterior_rear_driver-1774719101675.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_rear_driver-1774719101675.jpg not downloaded yet
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5647%252F20435647%252Fexterior_front_passenger-1774719070810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_front_passenger-1774719070810.jpg not downloaded yet
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9547750>
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01c56b0d-c369-5d23-8859-4dd29187bd3b/01c56b0d-c369-5d23-8859-4dd29187bd3b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7733%252F18037733%252Finterior_dashboard-1774203241481.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7733/18037733/interior_dashboard-1774203241481.jpg saved to cache
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01c56b0d-c369-5d23-8859-4dd29187bd3b
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5647%252F20435647%252Fexterior_rear_passenger-1774719086228.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_rear_passenger-1774719086228.jpg not downloaded yet
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_rear_driver-1774625829656.jpg> (referer: None)
2026-03-29 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3015/19873015/exterior_rear_driver-1773769907988.jpg> (referer: None)
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5647%252F20435647%252Finterior_front_seats-1774719226006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5647/20435647/interior_front_seats-1774719226006.jpg not downloaded yet
2026-03-29 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20152688.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7733/18037733/interior_front_seats-1774203153059.jpg> (referer: None)
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5647%252F20435647%252Finterior_rear_seats-1774719283556.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5647/20435647/interior_rear_seats-1774719283556.jpg not downloaded yet
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9662e10>
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5/ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20456408%252Finterior_front_seats-1774697579854.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20456408/interior_front_seats-1774697579854.jpg saved to cache
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5647%252F20435647%252F20435647-interior_dashboard-modified-1774775878910.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5647/20435647/20435647-interior_dashboard-modified-1774775878910.jpeg not downloaded yet
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5647%252F20435647%252Finstrument_cluster-1774719403899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5647/20435647/instrument_cluster-1774719403899.jpg not downloaded yet
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faab5dd0>
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4273%252F13044273%252Fexterior_rear_driver-1774625829656.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_rear_driver-1774625829656.jpg saved to cache
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9933259e-95b8-575f-8507-f6f4cbe0d31b
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0b7dd0>
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3015%252F19873015%252Fexterior_rear_driver-1773769907988.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3015/19873015/exterior_rear_driver-1773769907988.jpg saved to cache
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464
2026-03-29 20:06:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30c92ea5-576a-5d83-9660-8753583eed95 with identifier: 20152688
2026-03-29 20:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30c92ea5-576a-5d83-9660-8753583eed95 with scrape type 1
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30c92ea5-576a-5d83-9660-8753583eed95
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2688%252F20152688%252Fexterior_front_driver-1774783405074.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_front_driver-1774783405074.jpg not downloaded yet
2026-03-29 20:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf6ff50>
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01c56b0d-c369-5d23-8859-4dd29187bd3b/01c56b0d-c369-5d23-8859-4dd29187bd3b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7733%252F18037733%252Finterior_front_seats-1774203153059.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7733/18037733/interior_front_seats-1774203153059.jpg saved to cache
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01c56b0d-c369-5d23-8859-4dd29187bd3b
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5647%252F20435647%252Finterior_boot-1774719389329.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5647/20435647/interior_boot-1774719389329.jpg not downloaded yet
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2688%252F20152688%252Fexterior_rear_driver-1774783383340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_rear_driver-1774783383340.jpg not downloaded yet
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5647%252F20435647%252Fdocs_service_history-1774721311663.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4291b4b1eb74121ad69ed0f74fdb3ee7%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5647/20435647/docs_service_history-1774721311663.jpg?ixlib=js-3.8.0&auto=format&s=4291b4b1eb74121ad69ed0f74fdb3ee7 not downloaded yet
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2688%252F20152688%252Fexterior_front_passenger-1774783400162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_front_passenger-1774783400162.jpg not downloaded yet
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2688%252F20152688%252Fexterior_rear_passenger-1774783395585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_rear_passenger-1774783395585.jpg not downloaded yet
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2688%252F20152688%252Finterior_front_seats-1774784376794.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2688/20152688/interior_front_seats-1774784376794.jpg not downloaded yet
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2688%252F20152688%252Finterior_rear_seats-1774784027466.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2688/20152688/interior_rear_seats-1774784027466.jpg not downloaded yet
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2688%252F20152688%252Finterior_dashboard-1774784418719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2688/20152688/interior_dashboard-1774784418719.jpg not downloaded yet
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2688%252F20152688%252Finstrument_cluster-1774784114534.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2688/20152688/instrument_cluster-1774784114534.jpg not downloaded yet
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2688%252F20152688%252Finterior_boot-1774784420474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2688/20152688/interior_boot-1774784420474.jpg not downloaded yet
2026-03-29 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8349/20388349/damage_dents-1774694668156.jpg> (referer: None)
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2688%252F20152688%252Fdocs_service_history-1774785354472.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc5ce27f78098c55f380819772fcf72dc%27 HTTP/1.1" 200 None
2026-03-29 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2688/20152688/docs_service_history-1774785354472.jpg?ixlib=js-3.8.0&auto=format&s=c5ce27f78098c55f380819772fcf72dc not downloaded yet
2026-03-29 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_front_driver-1774719060689.jpg> (referer: None)
2026-03-29 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3015/19873015/interior_front_seats-1774713429579.jpg> (referer: None)
2026-03-29 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5647/20435647/interior_rear_seats-1774719283556.jpg> (referer: None)
2026-03-29 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5647/20435647/interior_boot-1774719389329.jpg> (referer: None)
2026-03-29 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5647/20435647/instrument_cluster-1774719403899.jpg> (referer: None)
2026-03-29 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_front_passenger-1774719070810.jpg> (referer: None)
2026-03-29 20:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5647/20435647/interior_front_seats-1774719226006.jpg> (referer: None)
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebbdfb50>
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8349%252F20388349%252Fdamage_dents-1774694668156.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8349/20388349/damage_dents-1774694668156.jpg saved to cache
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ca406a8-3992-58fc-b802-55ff1840e4dc
2026-03-29 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_rear_passenger-1774719086228.jpg> (referer: None)
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94cd910>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5647%252F20435647%252Fexterior_front_driver-1774719060689.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_front_driver-1774719060689.jpg saved to cache
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01169dea-f718-5be9-8612-367ea356ce39
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8862010>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3015%252F19873015%252Finterior_front_seats-1774713429579.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3015/19873015/interior_front_seats-1774713429579.jpg saved to cache
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca0ad0>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5647%252F20435647%252Finterior_rear_seats-1774719283556.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5647/20435647/interior_rear_seats-1774719283556.jpg saved to cache
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01169dea-f718-5be9-8612-367ea356ce39
2026-03-29 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_rear_driver-1774719101675.jpg> (referer: None)
2026-03-29 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_front_driver-1774783405074.jpg> (referer: None)
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf55f10>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5647%252F20435647%252Finterior_boot-1774719389329.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5647/20435647/interior_boot-1774719389329.jpg saved to cache
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01169dea-f718-5be9-8612-367ea356ce39
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90009d0>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5647%252F20435647%252Finstrument_cluster-1774719403899.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5647/20435647/instrument_cluster-1774719403899.jpg saved to cache
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01169dea-f718-5be9-8612-367ea356ce39
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae9a5d0>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5647%252F20435647%252Fexterior_front_passenger-1774719070810.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_front_passenger-1774719070810.jpg saved to cache
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01169dea-f718-5be9-8612-367ea356ce39
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac7dd10>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5647%252F20435647%252Finterior_front_seats-1774719226006.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5647/20435647/interior_front_seats-1774719226006.jpg saved to cache
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01169dea-f718-5be9-8612-367ea356ce39
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96cdb90>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5647%252F20435647%252Fexterior_rear_passenger-1774719086228.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_rear_passenger-1774719086228.jpg saved to cache
2026-03-29 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01169dea-f718-5be9-8612-367ea356ce39
2026-03-29 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2688/20152688/docs_service_history-1774785354472.jpg?ixlib=js-3.8.0&auto=format&s=c5ce27f78098c55f380819772fcf72dc> (referer: None)
2026-03-29 20:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3015/19873015/docs_service_history-1774714085575.jpg?ixlib=js-3.8.0&auto=format&s=18c62fa37e44a1c749605fb1578640bf> (referer: None)
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f905d210>
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5647%252F20435647%252Fexterior_rear_driver-1774719101675.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_rear_driver-1774719101675.jpg saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01169dea-f718-5be9-8612-367ea356ce39
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8883390>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2688%252F20152688%252Fexterior_front_driver-1774783405074.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_front_driver-1774783405074.jpg saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30c92ea5-576a-5d83-9660-8753583eed95
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5647/20435647/20435647-interior_dashboard-modified-1774775878910.jpeg> (referer: None)
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0c0c10>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2688%252F20152688%252Fdocs_service_history-1774785354472.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc5ce27f78098c55f380819772fcf72dc') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2688/20152688/docs_service_history-1774785354472.jpg?ixlib=js-3.8.0&auto=format&s=c5ce27f78098c55f380819772fcf72dc saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30c92ea5-576a-5d83-9660-8753583eed95
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f919f0d0>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3015%252F19873015%252Fdocs_service_history-1774714085575.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D18c62fa37e44a1c749605fb1578640bf') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3015/19873015/docs_service_history-1774714085575.jpg?ixlib=js-3.8.0&auto=format&s=18c62fa37e44a1c749605fb1578640bf saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8647910>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5647%252F20435647%252F20435647-interior_dashboard-modified-1774775878910.jpeg') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5647/20435647/20435647-interior_dashboard-modified-1774775878910.jpeg saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01169dea-f718-5be9-8612-367ea356ce39
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3015/19873015/instrument_cluster-1774713524506.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5647/20435647/docs_service_history-1774721311663.jpg?ixlib=js-3.8.0&auto=format&s=4291b4b1eb74121ad69ed0f74fdb3ee7> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_front_passenger-1774783400162.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8349/20388349/damage_scratches-1774188806758.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_rear_passenger-1774783395585.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9659/20009659/docs_service_history-1774710084383.jpg?ixlib=js-3.8.0&auto=format&s=081159dacfc62f83db6751565dbd6c68> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2688/20152688/instrument_cluster-1774784114534.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_rear_driver-1774783383340.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3015/19873015/interior_boot-1774713773856.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2688/20152688/interior_front_seats-1774784376794.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2688/20152688/interior_boot-1774784420474.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9659/20009659/interior_boot-1774709239778.jpg> (referer: None)
2026-03-29 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2688/20152688/interior_dashboard-1774784418719.jpg> (referer: None)
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88ef6d0>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3015%252F19873015%252Finstrument_cluster-1774713524506.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3015/19873015/instrument_cluster-1774713524506.jpg saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebbdf210>
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5647%252F20435647%252Fdocs_service_history-1774721311663.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4291b4b1eb74121ad69ed0f74fdb3ee7') HTTP/1.1" 204 0
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5647/20435647/docs_service_history-1774721311663.jpg?ixlib=js-3.8.0&auto=format&s=4291b4b1eb74121ad69ed0f74fdb3ee7 saved to cache
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01169dea-f718-5be9-8612-367ea356ce39
2026-03-29 20:06:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01169dea-f718-5be9-8612-367ea356ce39, skipping ID generation
2026-03-29 20:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01169dea-f718-5be9-8612-367ea356ce39 with scrape type 1
2026-03-29 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01169dea-f718-5be9-8612-367ea356ce39 sending to next pipeline
2026-03-29 20:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 01169dea-f718-5be9-8612-367ea356ce39, identifier: 20435647
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8883c90>
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2688%252F20152688%252Fexterior_front_passenger-1774783400162.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_front_passenger-1774783400162.jpg saved to cache
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30c92ea5-576a-5d83-9660-8753583eed95
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae08a90>
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8349%252F20388349%252Fdamage_scratches-1774188806758.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8349/20388349/damage_scratches-1774188806758.jpg saved to cache
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ca406a8-3992-58fc-b802-55ff1840e4dc
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca2190>
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2688%252F20152688%252Fexterior_rear_passenger-1774783395585.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_rear_passenger-1774783395585.jpg saved to cache
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30c92ea5-576a-5d83-9660-8753583eed95
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8955f90>
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9659%252F20009659%252Fdocs_service_history-1774710084383.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D081159dacfc62f83db6751565dbd6c68') HTTP/1.1" 204 0
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9659/20009659/docs_service_history-1774710084383.jpg?ixlib=js-3.8.0&auto=format&s=081159dacfc62f83db6751565dbd6c68 saved to cache
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9320190>
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2688%252F20152688%252Finstrument_cluster-1774784114534.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2688/20152688/instrument_cluster-1774784114534.jpg saved to cache
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30c92ea5-576a-5d83-9660-8753583eed95
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae99610>
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2688%252F20152688%252Fexterior_rear_driver-1774783383340.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_rear_driver-1774783383340.jpg saved to cache
2026-03-29 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30c92ea5-576a-5d83-9660-8753583eed95
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa12050>
2026-03-29 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3015%252F19873015%252Finterior_boot-1774713773856.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3015/19873015/interior_boot-1774713773856.jpg saved to cache
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9003d10>
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2688%252F20152688%252Finterior_front_seats-1774784376794.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2688/20152688/interior_front_seats-1774784376794.jpg saved to cache
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30c92ea5-576a-5d83-9660-8753583eed95
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9421090>
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2688%252F20152688%252Finterior_boot-1774784420474.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2688/20152688/interior_boot-1774784420474.jpg saved to cache
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30c92ea5-576a-5d83-9660-8753583eed95
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa153d50>
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9659%252F20009659%252Finterior_boot-1774709239778.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9659/20009659/interior_boot-1774709239778.jpg saved to cache
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae982d0>
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2688%252F20152688%252Finterior_dashboard-1774784418719.jpg') HTTP/1.1" 204 0
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2688/20152688/interior_dashboard-1774784418719.jpg saved to cache
2026-03-29 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30c92ea5-576a-5d83-9660-8753583eed95
2026-03-29 20:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 01169dea-f718-5be9-8612-367ea356ce39 with identifier: 20435647
2026-03-29 20:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 01169dea-f718-5be9-8612-367ea356ce39 with identifier: 20435647
2026-03-29 20:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 01169dea-f718-5be9-8612-367ea356ce39 with identifier: 20435647 to the API
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-service-history-photos.imgix.net/redacted/oriented/5647/20435647/docs_service_history-1774721311663.jpg?ixlib=js-3.8.0&auto=format&s=4291b4b1eb74121ad69ed0f74fdb3ee7>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '01169dea-f718-5be9-8612-367ea356ce39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AE63 EXN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20435647',
'listing': 'auction',
'location': 'Buckinghamshire Slough',
'make': 'Audi',
'model': 'SQ5',
'odometer': 127577,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 60,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 562839,
'Height': 1589,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_front_driver-1774719060689.jpg',
'Width': 2119},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 588491,
'Height': 1648,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_rear_driver-1774719101675.jpg',
'Width': 2197},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520712,
'Height': 1519,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_front_passenger-1774719070810.jpg',
'Width': 2025},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 506825,
'Height': 1496,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5647/20435647/exterior_rear_passenger-1774719086228.jpg',
'Width': 1994},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1937864,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/5647/20435647/interior_front_seats-1774719226006.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2085917,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/5647/20435647/interior_rear_seats-1774719283556.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2551718,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5647/20435647/20435647-interior_dashboard-modified-1774775878910.jpeg',
'Width': 4096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2153132,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5647/20435647/instrument_cluster-1774719403899.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1903068,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/5647/20435647/interior_boot-1774719389329.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01169dea-f718-5be9-8612-367ea356ce39/01169dea-f718-5be9-8612-367ea356ce39_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1001452,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5647/20435647/docs_service_history-1774721311663.jpg?ixlib=js-3.8.0&auto=format&s=4291b4b1eb74121ad69ed0f74fdb3ee7',
'Width': 3072}],
'price': 6806,
'price_includes_vat': False,
'registration_date': '2013-09-12',
'seats_number': None,
'seller_name': None,
'title': 'Audi SQ5 TDI Quattro Auto',
'transmission': 'automatic',
'trim': 'TDI Quattro Auto',
'vin': 'WAUZZZ8R1EA028599',
'year': 2013}
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720435647%27 HTTP/1.1" 200 None
2026-03-29 20:07:00 [motorway.uk] INFO: Saving data for 20435647: {'created_time': 1774814820.077458, 'last_price_update_time': 1774814820.077473, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20435647') HTTP/1.1" 204 0
2026-03-29 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8349/20388349/interior_dashboard-1774189355130.jpg> (referer: None)
2026-03-29 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8349/20388349/interior_boot-1774189344095.jpg> (referer: None)
2026-03-29 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3015/19873015/interior_dashboard-1774713553872.jpg> (referer: None)
2026-03-29 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2688/20152688/interior_rear_seats-1774784027466.jpg> (referer: None)
2026-03-29 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9659/20009659/instrument_cluster-1774709253420.jpg> (referer: None)
2026-03-29 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3015/19873015/interior_rear_seats-1774713498950.jpg> (referer: None)
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94b1c50>
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8349%252F20388349%252Finterior_dashboard-1774189355130.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8349/20388349/interior_dashboard-1774189355130.jpg saved to cache
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ca406a8-3992-58fc-b802-55ff1840e4dc
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f820d910>
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8349%252F20388349%252Finterior_boot-1774189344095.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8349/20388349/interior_boot-1774189344095.jpg saved to cache
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ca406a8-3992-58fc-b802-55ff1840e4dc
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9592f90>
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3015%252F19873015%252Finterior_dashboard-1774713553872.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3015/19873015/interior_dashboard-1774713553872.jpg saved to cache
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88fb550>
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2688%252F20152688%252Finterior_rear_seats-1774784027466.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2688/20152688/interior_rear_seats-1774784027466.jpg saved to cache
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30c92ea5-576a-5d83-9660-8753583eed95
2026-03-29 20:07:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30c92ea5-576a-5d83-9660-8753583eed95, skipping ID generation
2026-03-29 20:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30c92ea5-576a-5d83-9660-8753583eed95 with scrape type 1
2026-03-29 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30c92ea5-576a-5d83-9660-8753583eed95 sending to next pipeline
2026-03-29 20:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 30c92ea5-576a-5d83-9660-8753583eed95, identifier: 20152688
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faef3c10>
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9659%252F20009659%252Finstrument_cluster-1774709253420.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9659/20009659/instrument_cluster-1774709253420.jpg saved to cache
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb
2026-03-29 20:07:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88fbed0>
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3015%252F19873015%252Finterior_rear_seats-1774713498950.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3015/19873015/interior_rear_seats-1774713498950.jpg saved to cache
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464
2026-03-29 20:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 30c92ea5-576a-5d83-9660-8753583eed95 with identifier: 20152688
2026-03-29 20:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 30c92ea5-576a-5d83-9660-8753583eed95 with identifier: 20152688
2026-03-29 20:07:01 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 30c92ea5-576a-5d83-9660-8753583eed95 with identifier: 20152688 to the API
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2688/20152688/interior_rear_seats-1774784027466.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '30c92ea5-576a-5d83-9660-8753583eed95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FH13 FVS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20152688',
'listing': 'auction',
'location': 'Northamptonshire Wellingborough',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 41000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1406155,
'Height': 2507,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_front_driver-1774783405074.jpg',
'Width': 3342},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1276545,
'Height': 2393,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_rear_driver-1774783383340.jpg',
'Width': 3191},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1102557,
'Height': 2408,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_front_passenger-1774783400162.jpg',
'Width': 3211},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1236546,
'Height': 2381,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2688/20152688/exterior_rear_passenger-1774783395585.jpg',
'Width': 3175},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3422502,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2688/20152688/interior_front_seats-1774784376794.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3504096,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2688/20152688/interior_rear_seats-1774784027466.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1849190,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2688/20152688/interior_dashboard-1774784418719.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2618400,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2688/20152688/instrument_cluster-1774784114534.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4719511,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2688/20152688/interior_boot-1774784420474.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30c92ea5-576a-5d83-9660-8753583eed95/30c92ea5-576a-5d83-9660-8753583eed95_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389466,
'Height': 2267,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2688/20152688/docs_service_history-1774785354472.jpg?ixlib=js-3.8.0&auto=format&s=c5ce27f78098c55f380819772fcf72dc',
'Width': 1601}],
'price': 5989,
'price_includes_vat': False,
'registration_date': '2013-07-15',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Zetec Auto',
'transmission': 'automatic',
'trim': 'Zetec Auto',
'vin': 'WF0DXXGAKDCS59241',
'year': 2013}
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720152688%27 HTTP/1.1" 200 None
2026-03-29 20:07:01 [motorway.uk] INFO: Saving data for 20152688: {'created_time': 1774814821.569169, 'last_price_update_time': 1774814821.569179, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20152688') HTTP/1.1" 204 0
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9659/20009659/interior_dashboard-1774715261503.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3015/19873015/exterior_front_passenger-1774715397100.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_rear_passenger-1774188663380.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4273/13044273/docs_service_history-1774628234604.jpg?ixlib=js-3.8.0&auto=format&s=0afa1384f9479f770f9e9fd1e9eb34a5> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3015/19873015/exterior_rear_passenger-1773769830791.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8349/20388349/interior_rear_seats-1774189345824.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1158/20481158/interior_boot-1774682875078.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1158/20481158/wheels_front_driver-1774682618514.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9659/20009659/exterior_rear_passenger-1774708515768.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8349/20388349/interior_front_seats-1774189345036.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9659/20009659/interior_rear_seats-1774709185041.jpg> (referer: None)
2026-03-29 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9659/20009659/interior_front_seats-1774709165496.jpg> (referer: None)
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8239550>
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9659%252F20009659%252Finterior_dashboard-1774715261503.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9659/20009659/interior_dashboard-1774715261503.jpg saved to cache
2026-03-29 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae63590>
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3015%252F19873015%252Fexterior_front_passenger-1774715397100.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3015/19873015/exterior_front_passenger-1774715397100.jpg saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9422790>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8349%252F20388349%252Fexterior_rear_passenger-1774188663380.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_rear_passenger-1774188663380.jpg saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ca406a8-3992-58fc-b802-55ff1840e4dc
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f32b90>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4273%252F13044273%252Fdocs_service_history-1774628234604.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0afa1384f9479f770f9e9fd1e9eb34a5') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4273/13044273/docs_service_history-1774628234604.jpg?ixlib=js-3.8.0&auto=format&s=0afa1384f9479f770f9e9fd1e9eb34a5 saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9933259e-95b8-575f-8507-f6f4cbe0d31b
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa48990>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3015%252F19873015%252Fexterior_rear_passenger-1773769830791.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3015/19873015/exterior_rear_passenger-1773769830791.jpg saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f925b010>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8349%252F20388349%252Finterior_rear_seats-1774189345824.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8349/20388349/interior_rear_seats-1774189345824.jpg saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ca406a8-3992-58fc-b802-55ff1840e4dc
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9117c50>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1158%252F20481158%252Finterior_boot-1774682875078.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1158/20481158/interior_boot-1774682875078.jpg saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f934e750>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1158%252F20481158%252Fwheels_front_driver-1774682618514.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1158/20481158/wheels_front_driver-1774682618514.jpg saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f33750>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9659%252F20009659%252Fexterior_rear_passenger-1774708515768.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9659/20009659/exterior_rear_passenger-1774708515768.jpg saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87011a0510>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8349%252F20388349%252Finterior_front_seats-1774189345036.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8349/20388349/interior_front_seats-1774189345036.jpg saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ca406a8-3992-58fc-b802-55ff1840e4dc
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96cf050>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9659%252F20009659%252Finterior_rear_seats-1774709185041.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9659/20009659/interior_rear_seats-1774709185041.jpg saved to cache
2026-03-29 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa49610>
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9659%252F20009659%252Finterior_front_seats-1774709165496.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9659/20009659/interior_front_seats-1774709165496.jpg saved to cache
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb
2026-03-29 20:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_front_passenger-1774188658058.jpg> (referer: None)
2026-03-29 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1158/20481158/instrument_cluster-1774682914685.jpg> (referer: None)
2026-03-29 20:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4273/13044273/docs_service_history-1774626824143.jpg?ixlib=js-3.8.0&auto=format&s=f4eb17217e7fbf4b3ab7245233302549> (referer: None)
2026-03-29 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3015/19873015/exterior_front_driver-1774715134982.jpg> (referer: None)
2026-03-29 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9659/20009659/exterior_front_passenger-1774708552291.jpg> (referer: None)
2026-03-29 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4273/13044273/interior_boot-1774626376328.jpg> (referer: None)
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabb0750>
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8349%252F20388349%252Fexterior_front_passenger-1774188658058.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_front_passenger-1774188658058.jpg saved to cache
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ca406a8-3992-58fc-b802-55ff1840e4dc
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88e7050>
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1158%252F20481158%252Finstrument_cluster-1774682914685.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1158/20481158/instrument_cluster-1774682914685.jpg saved to cache
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fba2d0>
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4273%252F13044273%252Fdocs_service_history-1774626824143.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df4eb17217e7fbf4b3ab7245233302549') HTTP/1.1" 204 0
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4273/13044273/docs_service_history-1774626824143.jpg?ixlib=js-3.8.0&auto=format&s=f4eb17217e7fbf4b3ab7245233302549 saved to cache
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9933259e-95b8-575f-8507-f6f4cbe0d31b
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae6bbd0>
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3015%252F19873015%252Fexterior_front_driver-1774715134982.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3015/19873015/exterior_front_driver-1774715134982.jpg saved to cache
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464
2026-03-29 20:07:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a87269b-eb10-5d84-a9b3-096b8e0f4464, skipping ID generation
2026-03-29 20:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464 with scrape type 1
2026-03-29 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a87269b-eb10-5d84-a9b3-096b8e0f4464 sending to next pipeline
2026-03-29 20:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0a87269b-eb10-5d84-a9b3-096b8e0f4464, identifier: 19873015
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9571bd0>
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9659%252F20009659%252Fexterior_front_passenger-1774708552291.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9659/20009659/exterior_front_passenger-1774708552291.jpg saved to cache
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb
2026-03-29 20:07:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebbce690>
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4273%252F13044273%252Finterior_boot-1774626376328.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4273/13044273/interior_boot-1774626376328.jpg saved to cache
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9933259e-95b8-575f-8507-f6f4cbe0d31b
2026-03-29 20:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0a87269b-eb10-5d84-a9b3-096b8e0f4464 with identifier: 19873015
2026-03-29 20:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0a87269b-eb10-5d84-a9b3-096b8e0f4464 with identifier: 19873015
2026-03-29 20:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0a87269b-eb10-5d84-a9b3-096b8e0f4464 with identifier: 19873015 to the API
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/3015/19873015/exterior_front_driver-1774715134982.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '0a87269b-eb10-5d84-a9b3-096b8e0f4464',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HY17 XER',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19873015',
'listing': 'auction',
'location': 'Lincolnshire Stamford',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 49714,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2258688,
'Height': 2744,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3015/19873015/exterior_front_driver-1774715134982.jpg',
'Width': 3659},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1753672,
'Height': 2967,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3015/19873015/exterior_rear_driver-1773769907988.jpg',
'Width': 3956},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1588269,
'Height': 2231,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3015/19873015/exterior_front_passenger-1774715397100.jpg',
'Width': 2975},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1358390,
'Height': 2474,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3015/19873015/exterior_rear_passenger-1773769830791.jpg',
'Width': 3298},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3270400,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3015/19873015/interior_front_seats-1774713429579.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3175556,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3015/19873015/interior_rear_seats-1774713498950.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2911419,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3015/19873015/interior_dashboard-1774713553872.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2034907,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3015/19873015/instrument_cluster-1774713524506.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2841133,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3015/19873015/interior_boot-1774713773856.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a87269b-eb10-5d84-a9b3-096b8e0f4464/0a87269b-eb10-5d84-a9b3-096b8e0f4464_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663858,
'Height': 2038,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3015/19873015/docs_service_history-1774714085575.jpg?ixlib=js-3.8.0&auto=format&s=18c62fa37e44a1c749605fb1578640bf',
'Width': 2919}],
'price': 4361,
'price_includes_vat': False,
'registration_date': '2017-03-16',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Zetec Turbo',
'transmission': 'manual',
'trim': 'Zetec Turbo',
'vin': 'WF0DXXGAKDHU46973',
'year': 2017}
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719873015%27 HTTP/1.1" 200 None
2026-03-29 20:07:04 [motorway.uk] INFO: Saving data for 19873015: {'created_time': 1774814824.533929, 'last_price_update_time': 1774814824.533939, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19873015') HTTP/1.1" 204 0
2026-03-29 20:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_rear_driver-1774188655702.jpg> (referer: None)
2026-03-29 20:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1158/20481158/interior_dashboard-1774692169892.jpg> (referer: None)
2026-03-29 20:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9659/20009659/exterior_front_driver-1774715273339.jpg> (referer: None)
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4273/13044273/interior_dashboard-1774626634567.jpg> (referer: None)
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_rear_passenger-1774625846481.jpg> (referer: None)
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_front_driver-1774188662802.jpg> (referer: None)
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9659/20009659/exterior_rear_driver-1774708496209.jpg> (referer: None)
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1158/20481158/interior_front_seats-1774682864816.jpg> (referer: None)
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1158/20481158/interior_rear_seats-1774682869182.jpg> (referer: None)
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4273/13044273/interior_rear_seats-1774626329461.jpg> (referer: None)
2026-03-29 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4273/13044273/interior_front_seats-1774626309705.jpg> (referer: None)
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90d4910>
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8349%252F20388349%252Fexterior_rear_driver-1774188655702.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_rear_driver-1774188655702.jpg saved to cache
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ca406a8-3992-58fc-b802-55ff1840e4dc
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8882c90>
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1158%252F20481158%252Finterior_dashboard-1774692169892.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1158/20481158/interior_dashboard-1774692169892.jpg saved to cache
2026-03-29 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8855250>
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9659%252F20009659%252Fexterior_front_driver-1774715273339.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9659/20009659/exterior_front_driver-1774715273339.jpg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca1c10>
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4273%252F13044273%252Finterior_dashboard-1774626634567.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4273/13044273/interior_dashboard-1774626634567.jpg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9933259e-95b8-575f-8507-f6f4cbe0d31b
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f35750>
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4273%252F13044273%252Fexterior_rear_passenger-1774625846481.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_rear_passenger-1774625846481.jpg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9933259e-95b8-575f-8507-f6f4cbe0d31b
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f963c710>
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8349%252F20388349%252Fexterior_front_driver-1774188662802.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_front_driver-1774188662802.jpg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ca406a8-3992-58fc-b802-55ff1840e4dc
2026-03-29 20:07:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ca406a8-3992-58fc-b802-55ff1840e4dc, skipping ID generation
2026-03-29 20:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca406a8-3992-58fc-b802-55ff1840e4dc with scrape type 1
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ca406a8-3992-58fc-b802-55ff1840e4dc sending to next pipeline
2026-03-29 20:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8ca406a8-3992-58fc-b802-55ff1840e4dc, identifier: 20388349
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95c51d0>
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9659%252F20009659%252Fexterior_rear_driver-1774708496209.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9659/20009659/exterior_rear_driver-1774708496209.jpg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb
2026-03-29 20:07:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb, skipping ID generation
2026-03-29 20:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb with scrape type 1
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb sending to next pipeline
2026-03-29 20:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb, identifier: 20009659
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ad1050>
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1158%252F20481158%252Finterior_front_seats-1774682864816.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1158/20481158/interior_front_seats-1774682864816.jpg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa48210>
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1158%252F20481158%252Finterior_rear_seats-1774682869182.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1158/20481158/interior_rear_seats-1774682869182.jpg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7
2026-03-29 20:07:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f963df10>
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4273%252F13044273%252Finterior_rear_seats-1774626329461.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4273/13044273/interior_rear_seats-1774626329461.jpg saved to cache
2026-03-29 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9933259e-95b8-575f-8507-f6f4cbe0d31b
2026-03-29 20:07:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8856450>
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4273%252F13044273%252Finterior_front_seats-1774626309705.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4273/13044273/interior_front_seats-1774626309705.jpg saved to cache
2026-03-29 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9933259e-95b8-575f-8507-f6f4cbe0d31b
2026-03-29 20:07:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8ca406a8-3992-58fc-b802-55ff1840e4dc with identifier: 20388349
2026-03-29 20:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8ca406a8-3992-58fc-b802-55ff1840e4dc with identifier: 20388349
2026-03-29 20:07:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8ca406a8-3992-58fc-b802-55ff1840e4dc with identifier: 20388349 to the API
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_front_driver-1774188662802.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8ca406a8-3992-58fc-b802-55ff1840e4dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NK67 YML',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20388349',
'listing': 'auction',
'location': 'Stockton-on-Tees Billingham',
'make': 'Infiniti',
'model': 'Q30',
'odometer': 65388,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1835891,
'Height': 2791,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_front_driver-1774188662802.jpg',
'Width': 3721},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1058210,
'Height': 2338,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_rear_driver-1774188655702.jpg',
'Width': 3117},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1178184,
'Height': 2764,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_front_passenger-1774188658058.jpg',
'Width': 3685},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1358820,
'Height': 2837,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8349/20388349/exterior_rear_passenger-1774188663380.jpg',
'Width': 3783},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2202513,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8349/20388349/interior_front_seats-1774189345036.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1835114,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8349/20388349/interior_rear_seats-1774189345824.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1867281,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8349/20388349/interior_dashboard-1774189355130.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2270240,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8349/20388349/interior_boot-1774189344095.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1370093,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8349/20388349/damage_scratches-1774188806758.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca406a8-3992-58fc-b802-55ff1840e4dc/8ca406a8-3992-58fc-b802-55ff1840e4dc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 25338,
'Height': 301,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8349/20388349/damage_dents-1774694668156.jpg',
'Width': 401}],
'price': 5993,
'price_includes_vat': False,
'registration_date': '2017-11-17',
'seats_number': None,
'seller_name': None,
'title': 'Infiniti Q30 Premium Intouch D S-A',
'transmission': 'automatic',
'trim': 'Premium Intouch D S-A',
'vin': 'SJKDAAH15U1013952',
'year': 2017}
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720388349%27 HTTP/1.1" 200 None
2026-03-29 20:07:06 [motorway.uk] INFO: Saving data for 20388349: {'created_time': 1774814826.596478, 'last_price_update_time': 1774814826.59649, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20388349') HTTP/1.1" 204 0
2026-03-29 20:07:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb with identifier: 20009659
2026-03-29 20:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb with identifier: 20009659
2026-03-29 20:07:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb with identifier: 20009659 to the API
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9659/20009659/exterior_rear_driver-1774708496209.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'K23 BEN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20009659',
'listing': 'auction',
'location': 'East Sussex Battle',
'make': 'Mercedes',
'model': 'AMG',
'odometer': 37000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2725774,
'Height': 2366,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9659/20009659/exterior_front_driver-1774715273339.jpg',
'Width': 3155},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2150842,
'Height': 2433,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9659/20009659/exterior_rear_driver-1774708496209.jpg',
'Width': 3244},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1984720,
'Height': 2592,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9659/20009659/exterior_front_passenger-1774708552291.jpg',
'Width': 3456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1964594,
'Height': 2456,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9659/20009659/exterior_rear_passenger-1774708515768.jpg',
'Width': 3274},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3780758,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9659/20009659/interior_front_seats-1774709165496.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2810301,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9659/20009659/interior_rear_seats-1774709185041.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2348935,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9659/20009659/interior_dashboard-1774715261503.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2204209,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9659/20009659/instrument_cluster-1774709253420.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3371560,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9659/20009659/interior_boot-1774709239778.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb/f41ee5f4-1978-5e1c-89f0-f2f5e00cc9eb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2745528,
'Height': 3710,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9659/20009659/docs_service_history-1774710084383.jpg?ixlib=js-3.8.0&auto=format&s=081159dacfc62f83db6751565dbd6c68',
'Width': 2096}],
'price': 22576,
'price_includes_vat': False,
'registration_date': '2020-02-16',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes AMG A 35 4MATIC Premium + Auto',
'transmission': 'automatic',
'trim': 'A 35 4MATIC Premium + Auto',
'vin': 'W1K1770512J205737',
'year': 2020}
2026-03-29 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720009659%27 HTTP/1.1" 200 None
2026-03-29 20:07:07 [motorway.uk] INFO: Saving data for 20009659: {'created_time': 1774814827.003401, 'last_price_update_time': 1774814827.003413, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20009659') HTTP/1.1" 204 0
2026-03-29 20:07:07 [scrapy.extensions.logstats] INFO: Crawled 299 pages (at 46 pages/min), scraped 160 items (at 21 items/min)
2026-03-29 20:07:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 309MiB
2026-03-29 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1260&page=35&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_front_passenger-1774682451692.jpg> (referer: None)
2026-03-29 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_front_passenger-1774625863614.jpg> (referer: None)
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20375931
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20325750
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 16691958
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20470450
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20395403
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720395403%27 HTTP/1.1" 200 None
2026-03-29 20:07:07 [motorway.uk] INFO: Scrape type for 20395403: 1
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20474722
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20492344
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20114932
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20501015
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20491170
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20436771
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 19695598
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 16059595
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 13977118
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20488360
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488360%27 HTTP/1.1" 200 None
2026-03-29 20:07:07 [motorway.uk] INFO: Scrape type for 20488360: 1
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 19261388
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719261388%27 HTTP/1.1" 200 None
2026-03-29 20:07:07 [motorway.uk] INFO: Scrape type for 19261388: 1
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f824dad0>
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1158%252F20481158%252Fexterior_front_passenger-1774682451692.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_front_passenger-1774682451692.jpg saved to cache
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f824f3d0>
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4273%252F13044273%252Fexterior_front_passenger-1774625863614.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_front_passenger-1774625863614.jpg saved to cache
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9933259e-95b8-575f-8507-f6f4cbe0d31b
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20480811
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20315252
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20021276
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 19370870
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20363809
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 19748283
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20492678
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20327541
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 17627913
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20405306
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20485412
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 14166490
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714166490%27 HTTP/1.1" 200 None
2026-03-29 20:07:07 [motorway.uk] INFO: Scrape type for 14166490: 1
2026-03-29 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_front_driver-1774682438509.jpg> (referer: None)
2026-03-29 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19631185.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20405002
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720405002%27 HTTP/1.1" 200 None
2026-03-29 20:07:07 [motorway.uk] INFO: Scrape type for 20405002: 2
2026-03-29 20:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 17362621
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717362621%27 HTTP/1.1" 200 None
2026-03-29 20:07:07 [motorway.uk] INFO: Scrape type for 17362621: 1
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 19486204
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 18339762
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20441350
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 11446328
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711446328%27 HTTP/1.1" 200 None
2026-03-29 20:07:07 [motorway.uk] INFO: Scrape type for 11446328: 1
2026-03-29 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_front_driver-1774776865155.jpg> (referer: None)
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 19699748
2026-03-29 20:07:07 [motorway.uk] INFO: Found listing with ID: 20357195
2026-03-29 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1380/17811380/docs_service_history-1774689377683.jpg?ixlib=js-3.8.0&auto=format&s=bf2cfb3ed75f36ac7f7706f4ba797af3> (referer: None)
2026-03-29 20:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_front_driver-1774625798712.jpg> (referer: None)
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94aa050>
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1158%252F20481158%252Fexterior_front_driver-1774682438509.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_front_driver-1774682438509.jpg saved to cache
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7
2026-03-29 20:07:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7, skipping ID generation
2026-03-29 20:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7 with scrape type 1
2026-03-29 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7 sending to next pipeline
2026-03-29 20:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7, identifier: 20481158
2026-03-29 20:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7 with identifier: 20481158
2026-03-29 20:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7 with identifier: 20481158
2026-03-29 20:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7 with identifier: 20481158 to the API
2026-03-29 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_front_driver-1774682438509.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EG10 BUS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20481158',
'listing': 'auction',
'location': 'None None',
'make': 'Mercedes',
'model': 'Vito',
'odometer': 138529,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1253952,
'Height': 2711,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_front_driver-1774682438509.jpg',
'Width': 3614},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1026187,
'Height': 2238,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_rear_driver-1774682447940.jpg',
'Width': 2984},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1279581,
'Height': 2501,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_front_passenger-1774682451692.jpg',
'Width': 3334},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1007489,
'Height': 2518,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1158/20481158/exterior_rear_passenger-1774682458339.jpg',
'Width': 3357},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2051802,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1158/20481158/interior_front_seats-1774682864816.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2284958,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1158/20481158/interior_rear_seats-1774682869182.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1670796,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1158/20481158/interior_dashboard-1774692169892.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1207275,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1158/20481158/instrument_cluster-1774682914685.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1994612,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1158/20481158/interior_boot-1774682875078.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7/3d9d7f5b-1e0b-5285-acc3-b1f8cea3f6e7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1933842,
'Height': 2839,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1158/20481158/wheels_front_driver-1774682618514.jpg',
'Width': 3785}],
'price': 9427,
'price_includes_vat': False,
'registration_date': '2016-08-09',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes Vito 119 Sport Bluetec Auto',
'transmission': 'automatic',
'trim': '119 Sport Bluetec Auto',
'vin': 'WDF44770123188084',
'year': 2016}
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720481158%27 HTTP/1.1" 200 None
2026-03-29 20:07:08 [motorway.uk] INFO: Saving data for 20481158: {'created_time': 1774814828.27364, 'last_price_update_time': 1774814828.273649, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20481158') HTTP/1.1" 204 0
2026-03-29 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6408/20456408/exterior_front_passenger-1774697016810.jpg> (referer: None)
2026-03-29 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7733/18037733/exterior_front_passenger-1774202357918.jpg> (referer: None)
2026-03-29 20:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 688d4b9e-59cf-5268-a349-40e730d92795 with identifier: 19631185
2026-03-29 20:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 688d4b9e-59cf-5268-a349-40e730d92795 with scrape type 1
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 688d4b9e-59cf-5268-a349-40e730d92795
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1185%252F19631185%252Fexterior_front_driver-1774705745328.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1185/19631185/exterior_front_driver-1774705745328.jpg not downloaded yet
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ade150>
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7569%252F20497569%252Fexterior_front_driver-1774776865155.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_front_driver-1774776865155.jpg saved to cache
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a
2026-03-29 20:07:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdd5cf2c-181d-5a44-8387-f7dcd89ae15a, skipping ID generation
2026-03-29 20:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a with scrape type 1
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdd5cf2c-181d-5a44-8387-f7dcd89ae15a sending to next pipeline
2026-03-29 20:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cdd5cf2c-181d-5a44-8387-f7dcd89ae15a, identifier: 20497569
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f75510>
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bbd0d7-b060-5708-a5f8-37095bde5b2e/a0bbd0d7-b060-5708-a5f8-37095bde5b2e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1380%252F17811380%252Fdocs_service_history-1774689377683.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbf2cfb3ed75f36ac7f7706f4ba797af3') HTTP/1.1" 204 0
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1380/17811380/docs_service_history-1774689377683.jpg?ixlib=js-3.8.0&auto=format&s=bf2cfb3ed75f36ac7f7706f4ba797af3 saved to cache
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0bbd0d7-b060-5708-a5f8-37095bde5b2e
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94b2cd0>
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4273%252F13044273%252Fexterior_front_driver-1774625798712.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_front_driver-1774625798712.jpg saved to cache
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9933259e-95b8-575f-8507-f6f4cbe0d31b
2026-03-29 20:07:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9933259e-95b8-575f-8507-f6f4cbe0d31b, skipping ID generation
2026-03-29 20:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9933259e-95b8-575f-8507-f6f4cbe0d31b with scrape type 1
2026-03-29 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9933259e-95b8-575f-8507-f6f4cbe0d31b sending to next pipeline
2026-03-29 20:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9933259e-95b8-575f-8507-f6f4cbe0d31b, identifier: 13044273
2026-03-29 20:07:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cdd5cf2c-181d-5a44-8387-f7dcd89ae15a with identifier: 20497569
2026-03-29 20:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cdd5cf2c-181d-5a44-8387-f7dcd89ae15a with identifier: 20497569
2026-03-29 20:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cdd5cf2c-181d-5a44-8387-f7dcd89ae15a with identifier: 20497569 to the API
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_front_driver-1774776865155.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'cdd5cf2c-181d-5a44-8387-f7dcd89ae15a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK26 CNJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20497569',
'listing': 'auction',
'location': 'Merseyside Liverpool',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 250,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1111122,
'Height': 2470,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_front_driver-1774776865155.jpg',
'Width': 3293},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1566806,
'Height': 2771,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_rear_driver-1774776890403.jpg',
'Width': 3695},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2056485,
'Height': 2684,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_front_passenger-1774776942870.jpg',
'Width': 3578},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1731674,
'Height': 2633,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7569/20497569/exterior_rear_passenger-1774776910755.jpg',
'Width': 3510},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2432143,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7569/20497569/interior_front_seats-1774776617909.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3103213,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7569/20497569/interior_rear_seats-1774776620232.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1669572,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7569/20497569/interior_dashboard-1774776631248.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1711739,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7569/20497569/instrument_cluster-1774776636399.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2499229,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7569/20497569/interior_boot-1774777276357.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdd5cf2c-181d-5a44-8387-f7dcd89ae15a/cdd5cf2c-181d-5a44-8387-f7dcd89ae15a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1570262,
'Height': 2750,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7569/20497569/wheels_front_driver-1774776285162.jpg',
'Width': 3667}],
'price': 24825,
'price_includes_vat': False,
'registration_date': '2026-03-18',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf R-LINE TSI',
'transmission': 'manual',
'trim': 'R-LINE TSI',
'vin': 'WVWZZZCD2TW224789',
'year': 2026}
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720497569%27 HTTP/1.1" 200 None
2026-03-29 20:07:09 [motorway.uk] INFO: Saving data for 20497569: {'created_time': 1774814829.424549, 'last_price_update_time': 1774814829.424604, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20497569') HTTP/1.1" 204 0
2026-03-29 20:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9933259e-95b8-575f-8507-f6f4cbe0d31b with identifier: 13044273
2026-03-29 20:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9933259e-95b8-575f-8507-f6f4cbe0d31b with identifier: 13044273
2026-03-29 20:07:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9933259e-95b8-575f-8507-f6f4cbe0d31b with identifier: 13044273 to the API
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_front_driver-1774625798712.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9933259e-95b8-575f-8507-f6f4cbe0d31b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HF73 YDD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13044273',
'listing': 'auction',
'location': 'Dorset Poole',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 19403,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1743719,
'Height': 2477,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_front_driver-1774625798712.jpg',
'Width': 3303},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2219340,
'Height': 2902,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_rear_driver-1774625829656.jpg',
'Width': 3869},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1914389,
'Height': 2644,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_front_passenger-1774625863614.jpg',
'Width': 3525},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1881121,
'Height': 2687,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4273/13044273/exterior_rear_passenger-1774625846481.jpg',
'Width': 3582},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4266484,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4273/13044273/interior_front_seats-1774626309705.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3949590,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4273/13044273/interior_rear_seats-1774626329461.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1980839,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4273/13044273/interior_dashboard-1774626634567.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4308409,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4273/13044273/interior_boot-1774626376328.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1266045,
'Height': 4044,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4273/13044273/docs_service_history-1774626824143.jpg?ixlib=js-3.8.0&auto=format&s=f4eb17217e7fbf4b3ab7245233302549',
'Width': 2636},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9933259e-95b8-575f-8507-f6f4cbe0d31b/9933259e-95b8-575f-8507-f6f4cbe0d31b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1251740,
'Height': 2205,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4273/13044273/docs_service_history-1774628234604.jpg?ixlib=js-3.8.0&auto=format&s=0afa1384f9479f770f9e9fd1e9eb34a5',
'Width': 2941}],
'price': 20750,
'price_includes_vat': False,
'registration_date': '2023-09-01',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Tucson N Line S T-GDi',
'transmission': 'manual',
'trim': 'N Line S T-GDi',
'vin': 'TMAJB81BLPJ379780',
'year': 2023}
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713044273%27 HTTP/1.1" 200 None
2026-03-29 20:07:09 [motorway.uk] INFO: Saving data for 13044273: {'created_time': 1774814829.843478, 'last_price_update_time': 1774814829.843487, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13044273') HTTP/1.1" 204 0
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1185%252F19631185%252Fexterior_rear_driver-1774703891027.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1185/19631185/exterior_rear_driver-1774703891027.jpg not downloaded yet
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad4f010>
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5/ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20456408%252Fexterior_front_passenger-1774697016810.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20456408/exterior_front_passenger-1774697016810.jpg saved to cache
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef2c0a2f-6ce0-5d7a-9b2d-65ff350a7dd5
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94b0610>
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01c56b0d-c369-5d23-8859-4dd29187bd3b/01c56b0d-c369-5d23-8859-4dd29187bd3b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7733%252F18037733%252Fexterior_front_passenger-1774202357918.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7733/18037733/exterior_front_passenger-1774202357918.jpg saved to cache
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01c56b0d-c369-5d23-8859-4dd29187bd3b
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1185%252F19631185%252Fexterior_front_passenger-1774703918879.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1185/19631185/exterior_front_passenger-1774703918879.jpg not downloaded yet
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7733/18037733/exterior_rear_passenger-1774202397504.jpg> (referer: None)
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1185%252F19631185%252Fexterior_rear_passenger-1774703904669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1185/19631185/exterior_rear_passenger-1774703904669.jpg not downloaded yet
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17909162.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485471.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488866.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1185%252F19631185%252Finterior_front_seats-1774704586608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1185/19631185/interior_front_seats-1774704586608.jpg not downloaded yet
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18699505.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1185%252F19631185%252Finterior_rear_seats-1774704618347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1185/19631185/interior_rear_seats-1774704618347.jpg not downloaded yet
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1185%252F19631185%252Finterior_dashboard-1774704653434.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1185/19631185/interior_dashboard-1774704653434.jpg not downloaded yet
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1185%252F19631185%252Finterior_boot-1774704680659.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1185/19631185/interior_boot-1774704680659.jpg not downloaded yet
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab9ea90>
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01c56b0d-c369-5d23-8859-4dd29187bd3b/01c56b0d-c369-5d23-8859-4dd29187bd3b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7733%252F18037733%252Fexterior_rear_passenger-1774202397504.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7733/18037733/exterior_rear_passenger-1774202397504.jpg saved to cache
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01c56b0d-c369-5d23-8859-4dd29187bd3b
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6969/20466969/docs_service_history-1774716759438.jpg?ixlib=js-3.8.0&auto=format&s=d6c083080ab705454df33588aa1db718> (referer: None)
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1185%252F19631185%252Fdocs_service_history-1774705317779.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D62541e71d89c7c3aa1cffdcf70dcffae%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1185/19631185/docs_service_history-1774705317779.jpg?ixlib=js-3.8.0&auto=format&s=62541e71d89c7c3aa1cffdcf70dcffae not downloaded yet
2026-03-29 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13676396.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1185%252F19631185%252Fdocs_service_history-1774705934731.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfbbe44818dcb6e2862951895435c2664%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1185/19631185/docs_service_history-1774705934731.jpg?ixlib=js-3.8.0&auto=format&s=fbbe44818dcb6e2862951895435c2664 not downloaded yet
2026-03-29 20:07:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1221dddd-9eb0-5d63-bad6-e43949984975 with identifier: 17909162
2026-03-29 20:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1221dddd-9eb0-5d63-bad6-e43949984975 with scrape type 1
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1221dddd-9eb0-5d63-bad6-e43949984975
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9162%252F17909162%252F17909162-exterior_front_driver-default-1774715365809.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9162/17909162/17909162-exterior_front_driver-default-1774715365809.jpg not downloaded yet
2026-03-29 20:07:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 418a0a34-b97e-5147-8baf-3c787f830cae with identifier: 20485471
2026-03-29 20:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 418a0a34-b97e-5147-8baf-3c787f830cae with scrape type 1
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 418a0a34-b97e-5147-8baf-3c787f830cae
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5471%252F20485471%252Fexterior_front_driver-1774714872193.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5471/20485471/exterior_front_driver-1774714872193.jpg not downloaded yet
2026-03-29 20:07:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0198a8bb-17e3-5682-8e96-dadda5dd1f18 with identifier: 20488866
2026-03-29 20:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0198a8bb-17e3-5682-8e96-dadda5dd1f18 with scrape type 1
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0198a8bb-17e3-5682-8e96-dadda5dd1f18
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8866%252F20488866%252Fexterior_front_driver-1774705673784.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8866/20488866/exterior_front_driver-1774705673784.jpg not downloaded yet
2026-03-29 20:07:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e3bbec1-45b0-58fd-8ee1-f8bc6d4de764 with identifier: 18699505
2026-03-29 20:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e3bbec1-45b0-58fd-8ee1-f8bc6d4de764 with scrape type 1
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9e3bbec1-45b0-58fd-8ee1-f8bc6d4de764
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9505%252F18699505%252Fexterior_front_driver-1764507428416.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9505/18699505/exterior_front_driver-1764507428416.jpg not downloaded yet
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9162%252F17909162%252F17909162-exterior_rear_driver-default-1774715330882.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9162/17909162/17909162-exterior_rear_driver-default-1774715330882.jpg not downloaded yet
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5471%252F20485471%252Fexterior_rear_driver-1774714888486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5471/20485471/exterior_rear_driver-1774714888486.jpg not downloaded yet
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8866%252F20488866%252Fexterior_rear_driver-1774705704446.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8866/20488866/exterior_rear_driver-1774705704446.jpg not downloaded yet
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9505%252F18699505%252Fexterior_rear_driver-1764507440189.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9505/18699505/exterior_rear_driver-1764507440189.jpg not downloaded yet
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9162%252F17909162%252F17909162-exterior_front_passenger-default-1774715326908.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9162/17909162/17909162-exterior_front_passenger-default-1774715326908.jpg not downloaded yet
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5471%252F20485471%252Fexterior_front_passenger-1774714911805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5471/20485471/exterior_front_passenger-1774714911805.jpg not downloaded yet
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8866%252F20488866%252Fexterior_front_passenger-1774705733530.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8866/20488866/exterior_front_passenger-1774705733530.jpg not downloaded yet
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9505%252F18699505%252Fexterior_front_passenger-1764507460061.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9505/18699505/exterior_front_passenger-1764507460061.jpg not downloaded yet
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf6c190>
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5/9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6969%252F20466969%252Fdocs_service_history-1774716759438.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd6c083080ab705454df33588aa1db718') HTTP/1.1" 204 0
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6969/20466969/docs_service_history-1774716759438.jpg?ixlib=js-3.8.0&auto=format&s=d6c083080ab705454df33588aa1db718 saved to cache
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5
2026-03-29 20:07:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d41a652-8840-582a-8d3b-6a29cd03a1d6 with identifier: 13676396
2026-03-29 20:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d41a652-8840-582a-8d3b-6a29cd03a1d6 with scrape type 1
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d41a652-8840-582a-8d3b-6a29cd03a1d6
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6396%252F13676396%252Fexterior_front_driver-1774698777038.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6396/13676396/exterior_front_driver-1774698777038.jpg not downloaded yet
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9162%252F17909162%252F17909162-exterior_rear_passenger-default-1774715321926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9162/17909162/17909162-exterior_rear_passenger-default-1774715321926.jpg not downloaded yet
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5471%252F20485471%252Fexterior_rear_passenger-1774714901322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5471/20485471/exterior_rear_passenger-1774714901322.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8866%252F20488866%252Fexterior_rear_passenger-1774705553670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8866/20488866/exterior_rear_passenger-1774705553670.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9505%252F18699505%252Fexterior_rear_passenger-1764507448506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9505/18699505/exterior_rear_passenger-1764507448506.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6396%252F13676396%252Fexterior_rear_driver-1774698962895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6396/13676396/exterior_rear_driver-1774698962895.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9162%252F17909162%252F17909162-interior_front_seats-default-1774715296892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9162/17909162/17909162-interior_front_seats-default-1774715296892.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5471%252F20485471%252Finterior_front_seats-1774715189774.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5471/20485471/interior_front_seats-1774715189774.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8866%252F20488866%252Finterior_front_seats-1774706283138.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8866/20488866/interior_front_seats-1774706283138.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9505%252F18699505%252Finterior_front_seats-1764507971637.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9505/18699505/interior_front_seats-1764507971637.jpg not downloaded yet
2026-03-29 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1380/17811380/interior_boot-1774689024387.jpg> (referer: None)
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6396%252F13676396%252Fexterior_front_passenger-1774698827218.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6396/13676396/exterior_front_passenger-1774698827218.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9162%252F17909162%252F17909162-interior_rear_seats-default-1774715299367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9162/17909162/17909162-interior_rear_seats-default-1774715299367.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5471%252F20485471%252Finterior_rear_seats-1774715203522.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5471/20485471/interior_rear_seats-1774715203522.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8866%252F20488866%252Finterior_rear_seats-1774706180642.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8866/20488866/interior_rear_seats-1774706180642.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9505%252F18699505%252Finterior_rear_seats-1764507983775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9505/18699505/interior_rear_seats-1764507983775.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6396%252F13676396%252Fexterior_rear_passenger-1774698896327.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6396/13676396/exterior_rear_passenger-1774698896327.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9162%252F17909162%252F17909162-interior_dashboard-default-1774715313055.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9162/17909162/17909162-interior_dashboard-default-1774715313055.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5471%252F20485471%252Finterior_dashboard-1774715235965.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5471/20485471/interior_dashboard-1774715235965.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8866%252F20488866%252Finterior_dashboard-1774706202030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8866/20488866/interior_dashboard-1774706202030.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9505%252F18699505%252Finterior_dashboard-1764507998160.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9505/18699505/interior_dashboard-1764507998160.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6396%252F13676396%252Finterior_front_seats-1774699510616.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6396/13676396/interior_front_seats-1774699510616.jpg not downloaded yet
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8adc1d0>
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bbd0d7-b060-5708-a5f8-37095bde5b2e/a0bbd0d7-b060-5708-a5f8-37095bde5b2e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1380%252F17811380%252Finterior_boot-1774689024387.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1380/17811380/interior_boot-1774689024387.jpg saved to cache
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0bbd0d7-b060-5708-a5f8-37095bde5b2e
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9162%252F17909162%252F17909162-instrument_cluster-default-1774715425468.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9162/17909162/17909162-instrument_cluster-default-1774715425468.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5471%252F20485471%252Finstrument_cluster-1774715295044.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5471/20485471/instrument_cluster-1774715295044.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8866%252F20488866%252Finterior_boot-1774706258155.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8866/20488866/interior_boot-1774706258155.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9505%252F18699505%252Finstrument_cluster-1764507951804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9505/18699505/instrument_cluster-1764507951804.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6396%252F13676396%252Finterior_dashboard-1774699574240.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6396/13676396/interior_dashboard-1774699574240.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9162%252F17909162%252F17909162-interior_boot-default-1774715302821.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9162/17909162/17909162-interior_boot-default-1774715302821.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5471%252F20485471%252Finterior_boot-1774715239340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5471/20485471/interior_boot-1774715239340.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8866%252F20488866%252Fdamage_scratches-1774706676250.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8866/20488866/damage_scratches-1774706676250.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9505%252F18699505%252Finterior_boot-1764508015554.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9505/18699505/interior_boot-1764508015554.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6396%252F13676396%252Finstrument_cluster-1774699561855.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6396/13676396/instrument_cluster-1774699561855.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9162%252F17909162%252F17909162-wheels_front_driver-default-1774712071691.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9162/17909162/17909162-wheels_front_driver-default-1774712071691.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5471%252F20485471%252Fdocs_service_history-1774716722638.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd6d0a941a0a08ea6843d6538915484a8%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5471/20485471/docs_service_history-1774716722638.jpg?ixlib=js-3.8.0&auto=format&s=d6d0a941a0a08ea6843d6538915484a8 not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8866%252F20488866%252Fdamage_scratches-1774706702189.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8866/20488866/damage_scratches-1774706702189.jpg not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F9505%252F18699505%252Fdocs_service_history-1764508538499.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D864eb17f7bb877d6d4500c86adcc0933%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/9505/18699505/docs_service_history-1764508538499.jpg?ixlib=js-3.8.0&auto=format&s=864eb17f7bb877d6d4500c86adcc0933 not downloaded yet
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6396%252F13676396%252Finterior_boot-1774778404793.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6396/13676396/interior_boot-1774778404793.jpg not downloaded yet
2026-03-29 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1296&page=36&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6396%252F13676396%252Fdocs_service_history-1774699699303.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De17243c808cabafcf06d9cfa3c56d640%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6396/13676396/docs_service_history-1774699699303.jpg?ixlib=js-3.8.0&auto=format&s=e17243c808cabafcf06d9cfa3c56d640 not downloaded yet
2026-03-29 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6969/20466969/interior_boot-1774716337587.jpg> (referer: None)
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6396%252F13676396%252Fdocs_service_history-1774699700017.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfd284b3020357e7b03c3b15a23c5ae7d%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6396/13676396/docs_service_history-1774699700017.jpg?ixlib=js-3.8.0&auto=format&s=fd284b3020357e7b03c3b15a23c5ae7d not downloaded yet
2026-03-29 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1185/19631185/exterior_rear_driver-1774703891027.jpg> (referer: None)
2026-03-29 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1185/19631185/exterior_front_passenger-1774703918879.jpg> (referer: None)
2026-03-29 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1185/19631185/exterior_rear_passenger-1774703904669.jpg> (referer: None)
2026-03-29 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8866/20488866/exterior_rear_passenger-1774705553670.jpg> (referer: None)
2026-03-29 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1185/19631185/exterior_front_driver-1774705745328.jpg> (referer: None)
2026-03-29 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9505/18699505/exterior_rear_passenger-1764507448506.jpg> (referer: None)
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 20488003
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 17841081
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 19220462
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 17874420
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 12473126
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712473126%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [motorway.uk] INFO: Scrape type for 12473126: 1
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 20404112
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 20463012
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 20141197
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 20384563
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 20411686
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 20130547
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 20484943
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 19189698
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 20485884
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485884%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [motorway.uk] INFO: Scrape type for 20485884: 1
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 7586308
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 19750029
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 20454873
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 19243367
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 13628545
2026-03-29 20:07:11 [motorway.uk] INFO: Found listing with ID: 17857909
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717857909%27 HTTP/1.1" 200 None
2026-03-29 20:07:11 [motorway.uk] INFO: Scrape type for 17857909: 1
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabb1490>
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5/9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6969%252F20466969%252Finterior_boot-1774716337587.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6969/20466969/interior_boot-1774716337587.jpg saved to cache
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9dd5ef8c-e4e8-59f3-9c99-24be12cd05b5
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 19991969
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 20483258
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 7888251
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 20436941
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 20471387
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 16024734
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 20492752
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 20492217
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 20435214
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 20461651
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 3723283
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 19401615
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719401615%27 HTTP/1.1" 200 None
2026-03-29 20:07:12 [motorway.uk] INFO: Scrape type for 19401615: 1
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19261388.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 15388383
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 19433460
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 19935539
2026-03-29 20:07:12 [motorway.uk] INFO: Found listing with ID: 20490910
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490910%27 HTTP/1.1" 200 None
2026-03-29 20:07:12 [motorway.uk] INFO: Scrape type for 20490910: 1
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabb07d0>
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_688d4b9e-59cf-5268-a349-40e730d92795/688d4b9e-59cf-5268-a349-40e730d92795_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1185%252F19631185%252Fexterior_rear_driver-1774703891027.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1185/19631185/exterior_rear_driver-1774703891027.jpg saved to cache
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 688d4b9e-59cf-5268-a349-40e730d92795
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8906a90>
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_688d4b9e-59cf-5268-a349-40e730d92795/688d4b9e-59cf-5268-a349-40e730d92795_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1185%252F19631185%252Fexterior_front_passenger-1774703918879.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1185/19631185/exterior_front_passenger-1774703918879.jpg saved to cache
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 688d4b9e-59cf-5268-a349-40e730d92795
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f905cb50>
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_688d4b9e-59cf-5268-a349-40e730d92795/688d4b9e-59cf-5268-a349-40e730d92795_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1185%252F19631185%252Fexterior_rear_passenger-1774703904669.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1185/19631185/exterior_rear_passenger-1774703904669.jpg saved to cache
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 688d4b9e-59cf-5268-a349-40e730d92795
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95f1950>
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0198a8bb-17e3-5682-8e96-dadda5dd1f18/0198a8bb-17e3-5682-8e96-dadda5dd1f18_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8866%252F20488866%252Fexterior_rear_passenger-1774705553670.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8866/20488866/exterior_rear_passenger-1774705553670.jpg saved to cache
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0198a8bb-17e3-5682-8e96-dadda5dd1f18
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f905c0d0>
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_688d4b9e-59cf-5268-a349-40e730d92795/688d4b9e-59cf-5268-a349-40e730d92795_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1185%252F19631185%252Fexterior_front_driver-1774705745328.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1185/19631185/exterior_front_driver-1774705745328.jpg saved to cache
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 688d4b9e-59cf-5268-a349-40e730d92795
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e65990>
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e3bbec1-45b0-58fd-8ee1-f8bc6d4de764/9e3bbec1-45b0-58fd-8ee1-f8bc6d4de764_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9505%252F18699505%252Fexterior_rear_passenger-1764507448506.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9505/18699505/exterior_rear_passenger-1764507448506.jpg saved to cache
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e3bbec1-45b0-58fd-8ee1-f8bc6d4de764
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/9505/18699505/docs_service_history-1764508538499.jpg?ixlib=js-3.8.0&auto=format&s=864eb17f7bb877d6d4500c86adcc0933> (referer: None)
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11446328.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14166490.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66753701-4812-5472-a1cf-346dc71c407a with identifier: 19261388
2026-03-29 20:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66753701-4812-5472-a1cf-346dc71c407a with scrape type 1
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66753701-4812-5472-a1cf-346dc71c407a
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1388%252F19261388%252Fexterior_front_driver-1774689927411.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1388/19261388/exterior_front_driver-1774689927411.jpeg not downloaded yet
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1388%252F19261388%252Fexterior_rear_driver-1774689990017.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1388/19261388/exterior_rear_driver-1774689990017.jpeg not downloaded yet
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1388%252F19261388%252Fexterior_front_passenger-1774689951398.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1388/19261388/exterior_front_passenger-1774689951398.jpeg not downloaded yet
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1388%252F19261388%252Fexterior_rear_passenger-1774689971005.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1388/19261388/exterior_rear_passenger-1774689971005.jpeg not downloaded yet
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1388%252F19261388%252Finterior_front_seats-1774690250198.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1388/19261388/interior_front_seats-1774690250198.jpeg not downloaded yet
2026-03-29 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8866/20488866/damage_scratches-1774706702189.jpg> (referer: None)
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe1a710>
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e3bbec1-45b0-58fd-8ee1-f8bc6d4de764/9e3bbec1-45b0-58fd-8ee1-f8bc6d4de764_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F9505%252F18699505%252Fdocs_service_history-1764508538499.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D864eb17f7bb877d6d4500c86adcc0933') HTTP/1.1" 204 0
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/9505/18699505/docs_service_history-1764508538499.jpg?ixlib=js-3.8.0&auto=format&s=864eb17f7bb877d6d4500c86adcc0933 saved to cache
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9e3bbec1-45b0-58fd-8ee1-f8bc6d4de764
2026-03-29 20:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3e2f594-0071-53b5-80f7-4df79a5a4171 with identifier: 11446328
2026-03-29 20:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3e2f594-0071-53b5-80f7-4df79a5a4171 with scrape type 1
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3e2f594-0071-53b5-80f7-4df79a5a4171
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6328%252F11446328%252Fexterior_front_driver-1772963666763.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6328/11446328/exterior_front_driver-1772963666763.jpg not downloaded yet
2026-03-29 20:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2789601-0a44-5b29-9bf7-2c5b4dac0169 with identifier: 14166490
2026-03-29 20:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2789601-0a44-5b29-9bf7-2c5b4dac0169 with scrape type 1
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2789601-0a44-5b29-9bf7-2c5b4dac0169
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6490%252F14166490%252Fexterior_front_driver-1774541985993.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6490/14166490/exterior_front_driver-1774541985993.jpg not downloaded yet
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9505/18699505/instrument_cluster-1764507951804.jpg> (referer: None)
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1388%252F19261388%252Finterior_rear_seats-1774690308534.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1388/19261388/interior_rear_seats-1774690308534.jpeg not downloaded yet
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6328%252F11446328%252Fexterior_rear_driver-1772963904468.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6328/11446328/exterior_rear_driver-1772963904468.jpg not downloaded yet
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6490%252F14166490%252Fexterior_rear_driver-1774542119941.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6490/14166490/exterior_rear_driver-1774542119941.jpg not downloaded yet
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488360.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20395403.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1388%252F19261388%252Finterior_dashboard-1774690349979.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1388/19261388/interior_dashboard-1774690349979.jpeg not downloaded yet
2026-03-29 20:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6328%252F11446328%252Fexterior_front_passenger-1772963863780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6328/11446328/exterior_front_passenger-1772963863780.jpg not downloaded yet
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6490%252F14166490%252Fexterior_front_passenger-1774541984267.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6490/14166490/exterior_front_passenger-1774541984267.jpg not downloaded yet
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94a3210>
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0198a8bb-17e3-5682-8e96-dadda5dd1f18/0198a8bb-17e3-5682-8e96-dadda5dd1f18_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8866%252F20488866%252Fdamage_scratches-1774706702189.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8866/20488866/damage_scratches-1774706702189.jpg saved to cache
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0198a8bb-17e3-5682-8e96-dadda5dd1f18
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1388%252F19261388%252Finstrument_cluster-1774690408497.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1388/19261388/instrument_cluster-1774690408497.jpeg not downloaded yet
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6328%252F11446328%252Fexterior_rear_passenger-1772963712175.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6328/11446328/exterior_rear_passenger-1772963712175.jpg not downloaded yet
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6490%252F14166490%252Fexterior_rear_passenger-1774542076690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6490/14166490/exterior_rear_passenger-1774542076690.jpg not downloaded yet
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5471/20485471/docs_service_history-1774716722638.jpg?ixlib=js-3.8.0&auto=format&s=d6d0a941a0a08ea6843d6538915484a8> (referer: None)
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1388%252F19261388%252Finterior_boot-1774690361078.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1388/19261388/interior_boot-1774690361078.jpeg not downloaded yet
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f91cb110>
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e3bbec1-45b0-58fd-8ee1-f8bc6d4de764/9e3bbec1-45b0-58fd-8ee1-f8bc6d4de764_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9505%252F18699505%252Finstrument_cluster-1764507951804.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9505/18699505/instrument_cluster-1764507951804.jpg saved to cache
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9e3bbec1-45b0-58fd-8ee1-f8bc6d4de764
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6328%252F11446328%252Finterior_front_seats-1774697637145.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6328/11446328/interior_front_seats-1774697637145.jpg not downloaded yet
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6490%252F14166490%252Finterior_front_seats-1774611035175.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6490/14166490/interior_front_seats-1774611035175.jpg not downloaded yet
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1388%252F19261388%252Fdocs_service_history-1772812832360.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D42a0769062833c0bc55f693fedab6e00%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1388/19261388/docs_service_history-1772812832360.jpeg?ixlib=js-3.8.0&auto=format&s=42a0769062833c0bc55f693fedab6e00 not downloaded yet
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17362621.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6328%252F11446328%252Finterior_rear_seats-1772964010417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6328/11446328/interior_rear_seats-1772964010417.jpg not downloaded yet
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6490%252F14166490%252Finterior_rear_seats-1774543856558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6490/14166490/interior_rear_seats-1774543856558.jpg not downloaded yet
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20405002.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a91e511d-5852-5351-bcf2-cfd929ade4b7 with identifier: 20488360
2026-03-29 20:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91e511d-5852-5351-bcf2-cfd929ade4b7 with scrape type 1
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a91e511d-5852-5351-bcf2-cfd929ade4b7
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8360%252F20488360%252F20488360-exterior_front_driver-modified-1774715884548.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8360/20488360/20488360-exterior_front_driver-modified-1774715884548.jpeg not downloaded yet
2026-03-29 20:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24ce5086-c3ae-59e8-8d18-cb827b304b65 with identifier: 20395403
2026-03-29 20:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24ce5086-c3ae-59e8-8d18-cb827b304b65 with scrape type 1
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24ce5086-c3ae-59e8-8d18-cb827b304b65
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5403%252F20395403%252Fexterior_front_driver-1774697818671.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5403/20395403/exterior_front_driver-1774697818671.jpg not downloaded yet
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94b1410>
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418a0a34-b97e-5147-8baf-3c787f830cae/418a0a34-b97e-5147-8baf-3c787f830cae_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5471%252F20485471%252Fdocs_service_history-1774716722638.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd6d0a941a0a08ea6843d6538915484a8') HTTP/1.1" 204 0
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5471/20485471/docs_service_history-1774716722638.jpg?ixlib=js-3.8.0&auto=format&s=d6d0a941a0a08ea6843d6538915484a8 saved to cache
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 418a0a34-b97e-5147-8baf-3c787f830cae
2026-03-29 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6396/13676396/docs_service_history-1774699700017.jpg?ixlib=js-3.8.0&auto=format&s=fd284b3020357e7b03c3b15a23c5ae7d> (referer: None)
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6328%252F11446328%252Finterior_dashboard-1774699015297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6328/11446328/interior_dashboard-1774699015297.jpg not downloaded yet
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6490%252F14166490%252Finterior_dashboard-1774607989296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6490/14166490/interior_dashboard-1774607989296.jpg not downloaded yet
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8360%252F20488360%252Fexterior_rear_driver-1774705673123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8360/20488360/exterior_rear_driver-1774705673123.jpg not downloaded yet
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5403%252F20395403%252Fexterior_rear_driver-1774706055085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5403/20395403/exterior_rear_driver-1774706055085.jpg not downloaded yet
2026-03-29 20:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81564603-3cfb-51db-b531-bf5ba9bc5adb with identifier: 17362621
2026-03-29 20:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81564603-3cfb-51db-b531-bf5ba9bc5adb with scrape type 1
2026-03-29 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81564603-3cfb-51db-b531-bf5ba9bc5adb
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2621%252F17362621%252Fexterior_front_driver-1774721808419.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_front_driver-1774721808419.jpg not downloaded yet
2026-03-29 20:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0695a402-e3e9-566d-9c6d-5544041a915c with identifier: 20405002
2026-03-29 20:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0695a402-e3e9-566d-9c6d-5544041a915c with scrape type 2
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0695a402-e3e9-566d-9c6d-5544041a915c with scrape type 2
2026-03-29 20:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0695a402-e3e9-566d-9c6d-5544041a915c, identifier: 20405002
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6328%252F11446328%252Finstrument_cluster-1772962644915.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6328/11446328/instrument_cluster-1772962644915.jpg not downloaded yet
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6490%252F14166490%252Finstrument_cluster-1774694322561.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6490/14166490/instrument_cluster-1774694322561.jpg not downloaded yet
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8360%252F20488360%252Fexterior_front_passenger-1774705652311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8360/20488360/exterior_front_passenger-1774705652311.jpg not downloaded yet
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5403%252F20395403%252Fexterior_front_passenger-1774706038256.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5403/20395403/exterior_front_passenger-1774706038256.jpg not downloaded yet
2026-03-29 20:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0695a402-e3e9-566d-9c6d-5544041a915c with identifier: 20405002
2026-03-29 20:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0695a402-e3e9-566d-9c6d-5544041a915c with identifier: 20405002
2026-03-29 20:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0695a402-e3e9-566d-9c6d-5544041a915c with identifier: 20405002 to the API
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20405002.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '0695a402-e3e9-566d-9c6d-5544041a915c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DS65 AEK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20405002',
'listing': 'auction',
'location': 'Lincolnshire Gainsborough',
'make': 'Volkswagen',
'model': 'Transporter',
'odometer': 157320,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 9500,
'price_includes_vat': False,
'registration_date': '2015-12-07',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Transporter T30 ST-LN TDI BMT',
'transmission': 'manual',
'trim': 'T30 ST-LN TDI BMT',
'vin': 'WV1ZZZ7HZGH046524',
'year': 2015}
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720405002%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [motorway.uk] INFO: Saving data for 20405002: {'auction_closing_time': 1774884600.0, 'created_time': 1774469091.87623, 'last_price_update_time': 1774814835.072265}
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20405002') HTTP/1.1" 204 0
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2621%252F17362621%252Fexterior_rear_driver-1774721822006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_rear_driver-1774721822006.jpg not downloaded yet
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6328%252F11446328%252Finterior_boot-1774698345286.png%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6328/11446328/interior_boot-1774698345286.png not downloaded yet
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6490%252F14166490%252Finterior_boot-1774543863183.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6490/14166490/interior_boot-1774543863183.jpg not downloaded yet
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8360%252F20488360%252F20488360-exterior_rear_passenger-modified-1774715904636.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8360/20488360/20488360-exterior_rear_passenger-modified-1774715904636.jpeg not downloaded yet
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5403%252F20395403%252Fexterior_rear_passenger-1774697817700.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5403/20395403/exterior_rear_passenger-1774697817700.jpg not downloaded yet
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1332&page=37&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1b6e90>
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d41a652-8840-582a-8d3b-6a29cd03a1d6/1d41a652-8840-582a-8d3b-6a29cd03a1d6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6396%252F13676396%252Fdocs_service_history-1774699700017.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfd284b3020357e7b03c3b15a23c5ae7d') HTTP/1.1" 204 0
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6396/13676396/docs_service_history-1774699700017.jpg?ixlib=js-3.8.0&auto=format&s=fd284b3020357e7b03c3b15a23c5ae7d saved to cache
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d41a652-8840-582a-8d3b-6a29cd03a1d6
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2621%252F17362621%252Fexterior_front_passenger-1774721851154.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_front_passenger-1774721851154.jpg not downloaded yet
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1388/19261388/docs_service_history-1772812832360.jpeg?ixlib=js-3.8.0&auto=format&s=42a0769062833c0bc55f693fedab6e00> (referer: None)
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6328%252F11446328%252Fdocs_service_history-1772963403348.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfeba23badc46c507c6d090d8e7b718a1%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6328/11446328/docs_service_history-1772963403348.jpg?ixlib=js-3.8.0&auto=format&s=feba23badc46c507c6d090d8e7b718a1 not downloaded yet
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6490%252F14166490%252Fdocs_service_history-1774694290216.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De6e6246fe4d571b724fcde30ff3641d2%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6490/14166490/docs_service_history-1774694290216.jpg?ixlib=js-3.8.0&auto=format&s=e6e6246fe4d571b724fcde30ff3641d2 not downloaded yet
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8360%252F20488360%252F20488360-interior_front_seats-modified-1774715919819.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8360/20488360/20488360-interior_front_seats-modified-1774715919819.jpeg not downloaded yet
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5403%252F20395403%252Finterior_front_seats-1774698727189.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5403/20395403/interior_front_seats-1774698727189.jpg not downloaded yet
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2621%252F17362621%252Fexterior_rear_passenger-1774721832336.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_rear_passenger-1774721832336.jpg not downloaded yet
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6396/13676396/docs_service_history-1774699699303.jpg?ixlib=js-3.8.0&auto=format&s=e17243c808cabafcf06d9cfa3c56d640> (referer: None)
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8360%252F20488360%252Finterior_rear_seats-1774705691272.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8360/20488360/interior_rear_seats-1774705691272.jpg not downloaded yet
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5403%252F20395403%252Finterior_rear_seats-1774698664763.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5403/20395403/interior_rear_seats-1774698664763.jpg not downloaded yet
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2621%252F17362621%252Finterior_front_seats-1774722092515.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2621/17362621/interior_front_seats-1774722092515.jpg not downloaded yet
2026-03-29 20:07:15 [motorway.uk] INFO: Found listing with ID: 1393364
2026-03-29 20:07:15 [motorway.uk] INFO: Found listing with ID: 18170236
2026-03-29 20:07:15 [motorway.uk] INFO: Found listing with ID: 19713905
2026-03-29 20:07:15 [motorway.uk] INFO: Found listing with ID: 20474485
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720474485%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [motorway.uk] INFO: Scrape type for 20474485: 1
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8360%252F20488360%252Finterior_dashboard-1774705834322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8360/20488360/interior_dashboard-1774705834322.jpg not downloaded yet
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5403%252F20395403%252Finterior_dashboard-1774706015817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5403/20395403/interior_dashboard-1774706015817.jpg not downloaded yet
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2621%252F17362621%252Finterior_rear_seats-1774722106390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2621/17362621/interior_rear_seats-1774722106390.jpg not downloaded yet
2026-03-29 20:07:15 [motorway.uk] INFO: Found listing with ID: 20298443
2026-03-29 20:07:15 [motorway.uk] INFO: Found listing with ID: 20477842
2026-03-29 20:07:15 [motorway.uk] INFO: Found listing with ID: 17624223
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717624223%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [motorway.uk] INFO: Scrape type for 17624223: 1
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17857909.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8360%252F20488360%252Finstrument_cluster-1774705801465.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8360/20488360/instrument_cluster-1774705801465.jpg not downloaded yet
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5403%252F20395403%252Finstrument_cluster-1774698533488.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5403/20395403/instrument_cluster-1774698533488.jpg not downloaded yet
2026-03-29 20:07:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94c2590>
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66753701-4812-5472-a1cf-346dc71c407a/66753701-4812-5472-a1cf-346dc71c407a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1388%252F19261388%252Fdocs_service_history-1772812832360.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D42a0769062833c0bc55f693fedab6e00') HTTP/1.1" 204 0
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1388/19261388/docs_service_history-1772812832360.jpeg?ixlib=js-3.8.0&auto=format&s=42a0769062833c0bc55f693fedab6e00 saved to cache
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66753701-4812-5472-a1cf-346dc71c407a
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94c0350>
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d41a652-8840-582a-8d3b-6a29cd03a1d6/1d41a652-8840-582a-8d3b-6a29cd03a1d6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6396%252F13676396%252Fdocs_service_history-1774699699303.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De17243c808cabafcf06d9cfa3c56d640') HTTP/1.1" 204 0
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6396/13676396/docs_service_history-1774699699303.jpg?ixlib=js-3.8.0&auto=format&s=e17243c808cabafcf06d9cfa3c56d640 saved to cache
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d41a652-8840-582a-8d3b-6a29cd03a1d6
2026-03-29 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6490/14166490/exterior_rear_driver-1774542119941.jpg> (referer: None)
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2621%252F17362621%252Finterior_dashboard-1774722131743.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2621/17362621/interior_dashboard-1774722131743.jpg not downloaded yet
2026-03-29 20:07:15 [motorway.uk] INFO: Found listing with ID: 18291869
2026-03-29 20:07:15 [motorway.uk] INFO: Found listing with ID: 19097600
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719097600%27 HTTP/1.1" 200 None
2026-03-29 20:07:15 [motorway.uk] INFO: Scrape type for 19097600: 1
2026-03-29 20:07:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8360%252F20488360%252Finterior_boot-1774705838992.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8360/20488360/interior_boot-1774705838992.jpg not downloaded yet
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5403%252F20395403%252Finterior_boot-1774705749575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5403/20395403/interior_boot-1774705749575.jpg not downloaded yet
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2621%252F17362621%252Finstrument_cluster-1774722181157.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2621/17362621/instrument_cluster-1774722181157.jpg not downloaded yet
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 9530683
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279530683%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [motorway.uk] INFO: Scrape type for 9530683: 1
2026-03-29 20:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c71c4f63-179e-5786-a4e7-ffc8d824b5fc with identifier: 17857909
2026-03-29 20:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc with scrape type 1
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7909%252F17857909%252Fexterior_front_driver-1774779427209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7909/17857909/exterior_front_driver-1774779427209.jpg not downloaded yet
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8360%252F20488360%252F20488360-docs_service_history-modified-1774716006916.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D249bbc83863982e4769bfe0616f2507d%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8360/20488360/20488360-docs_service_history-modified-1774716006916.jpeg?ixlib=js-3.8.0&auto=format&s=249bbc83863982e4769bfe0616f2507d not downloaded yet
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5403%252F20395403%252Fdocs_service_history-1774701135237.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc7b54b42eb8f04acfbca7880f6379fe8%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5403/20395403/docs_service_history-1774701135237.jpg?ixlib=js-3.8.0&auto=format&s=c7b54b42eb8f04acfbca7880f6379fe8 not downloaded yet
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2621%252F17362621%252Finterior_boot-1774722134560.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2621/17362621/interior_boot-1774722134560.jpg not downloaded yet
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 20452858
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 20455993
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 11012278
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711012278%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [motorway.uk] INFO: Scrape type for 11012278: 1
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7909%252F17857909%252Fexterior_rear_driver-1774719401283.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7909/17857909/exterior_rear_driver-1774719401283.jpg not downloaded yet
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfed910>
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2789601-0a44-5b29-9bf7-2c5b4dac0169/f2789601-0a44-5b29-9bf7-2c5b4dac0169_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6490%252F14166490%252Fexterior_rear_driver-1774542119941.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6490/14166490/exterior_rear_driver-1774542119941.jpg saved to cache
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2789601-0a44-5b29-9bf7-2c5b4dac0169
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2621%252F17362621%252Fdocs_service_history-1774722366703.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dff4e75e1df5f91a1b18ebe1064e1f296%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2621/17362621/docs_service_history-1774722366703.jpg?ixlib=js-3.8.0&auto=format&s=ff4e75e1df5f91a1b18ebe1064e1f296 not downloaded yet
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 18039395
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 18741336
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 20303325
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720303325%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [motorway.uk] INFO: Scrape type for 20303325: 1
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7909%252F17857909%252Fexterior_front_passenger-1774779451965.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7909/17857909/exterior_front_passenger-1774779451965.jpg not downloaded yet
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19401615.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490910.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 19210640
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 18047844
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 3222560
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 19609067
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719609067%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [motorway.uk] INFO: Scrape type for 19609067: 1
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7909%252F17857909%252Fexterior_rear_passenger-1774719425570.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7909/17857909/exterior_rear_passenger-1774719425570.jpg not downloaded yet
2026-03-29 20:07:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 19886187
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 19659666
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 20424304
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 17898601
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717898601%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [motorway.uk] INFO: Scrape type for 17898601: 1
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7909%252F17857909%252Finterior_front_seats-1774720281690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7909/17857909/interior_front_seats-1774720281690.jpg not downloaded yet
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 14573343
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 19859082
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 20450166
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 18005774
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 17064602
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717064602%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [motorway.uk] INFO: Scrape type for 17064602: 1
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7909%252F17857909%252Finterior_rear_seats-1774720327973.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7909/17857909/interior_rear_seats-1774720327973.jpg not downloaded yet
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 20473269
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473269%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [motorway.uk] INFO: Scrape type for 20473269: 1
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7909%252F17857909%252Finterior_dashboard-1774779474996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7909/17857909/interior_dashboard-1774779474996.jpg not downloaded yet
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6396/13676396/interior_boot-1774778404793.jpg> (referer: None)
2026-03-29 20:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00adaa46-fb19-5029-a781-b8cf7ebe9bbc with identifier: 19401615
2026-03-29 20:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc with scrape type 1
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1615%252F19401615%252Fexterior_front_driver-1774712703849.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_front_driver-1774712703849.jpeg not downloaded yet
2026-03-29 20:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c276091b-8744-508a-a0fa-b66e4398ec5d with identifier: 20490910
2026-03-29 20:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c276091b-8744-508a-a0fa-b66e4398ec5d with scrape type 1
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c276091b-8744-508a-a0fa-b66e4398ec5d
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0910%252F20490910%252Fexterior_front_driver-1774717214592.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_front_driver-1774717214592.jpeg not downloaded yet
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1388/19261388/exterior_rear_passenger-1774689971005.jpeg> (referer: None)
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8360/20488360/20488360-exterior_rear_passenger-modified-1774715904636.jpeg> (referer: None)
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 19371488
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 10398218
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 20445276
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 16325362
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 17674234
2026-03-29 20:07:16 [motorway.uk] INFO: Found listing with ID: 20319628
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7909%252F17857909%252Finstrument_cluster-1774720370087.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7909/17857909/instrument_cluster-1774720370087.jpg not downloaded yet
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1615%252F19401615%252Fexterior_rear_driver-1774712732515.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_rear_driver-1774712732515.jpeg not downloaded yet
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0910%252F20490910%252Fexterior_rear_driver-1774717242264.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_rear_driver-1774717242264.jpeg not downloaded yet
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7909%252F17857909%252Finterior_boot-1774720436156.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7909/17857909/interior_boot-1774720436156.jpg not downloaded yet
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1615%252F19401615%252Fexterior_front_passenger-1774712713011.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_front_passenger-1774712713011.jpeg not downloaded yet
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0910%252F20490910%252Fexterior_front_passenger-1774717213197.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_front_passenger-1774717213197.jpeg not downloaded yet
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7909%252F17857909%252Fdocs_service_history-1774720742141.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da22c5630fbbb8eb8f060419166f81893%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7909/17857909/docs_service_history-1774720742141.jpg?ixlib=js-3.8.0&auto=format&s=a22c5630fbbb8eb8f060419166f81893 not downloaded yet
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1615%252F19401615%252Fexterior_rear_passenger-1774712726071.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_rear_passenger-1774712726071.jpeg not downloaded yet
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0910%252F20490910%252Fexterior_rear_passenger-1774717227248.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_rear_passenger-1774717227248.jpeg not downloaded yet
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa182d10>
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d41a652-8840-582a-8d3b-6a29cd03a1d6/1d41a652-8840-582a-8d3b-6a29cd03a1d6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6396%252F13676396%252Finterior_boot-1774778404793.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6396/13676396/interior_boot-1774778404793.jpg saved to cache
2026-03-29 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d41a652-8840-582a-8d3b-6a29cd03a1d6
2026-03-29 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5403/20395403/exterior_front_driver-1774697818671.jpg> (referer: None)
2026-03-29 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1615%252F19401615%252Finterior_front_seats-1774713247538.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1615/19401615/interior_front_seats-1774713247538.jpeg not downloaded yet
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0910%252F20490910%252Finterior_front_seats-1774717277501.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0910/20490910/interior_front_seats-1774717277501.jpeg not downloaded yet
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c5cb50>
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66753701-4812-5472-a1cf-346dc71c407a/66753701-4812-5472-a1cf-346dc71c407a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1388%252F19261388%252Fexterior_rear_passenger-1774689971005.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1388/19261388/exterior_rear_passenger-1774689971005.jpeg saved to cache
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66753701-4812-5472-a1cf-346dc71c407a
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8caf490>
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8360%252F20488360%252F20488360-exterior_rear_passenger-modified-1774715904636.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8360/20488360/20488360-exterior_rear_passenger-modified-1774715904636.jpeg saved to cache
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a91e511d-5852-5351-bcf2-cfd929ade4b7
2026-03-29 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1388/19261388/instrument_cluster-1774690408497.jpeg> (referer: None)
2026-03-29 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485884.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6328/11446328/exterior_rear_driver-1772963904468.jpg> (referer: None)
2026-03-29 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_rear_passenger-1774721832336.jpg> (referer: None)
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1615%252F19401615%252Finterior_rear_seats-1774712877088.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1615/19401615/interior_rear_seats-1774712877088.jpeg not downloaded yet
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0910%252F20490910%252Finterior_dashboard-1774717391556.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0910/20490910/interior_dashboard-1774717391556.jpeg not downloaded yet
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf246d0>
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5403%252F20395403%252Fexterior_front_driver-1774697818671.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5403/20395403/exterior_front_driver-1774697818671.jpg saved to cache
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24ce5086-c3ae-59e8-8d18-cb827b304b65
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1615%252F19401615%252F19401615-interior_dashboard-modified-1774714922751.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1615/19401615/19401615-interior_dashboard-modified-1774714922751.jpeg not downloaded yet
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0910%252F20490910%252Finstrument_cluster-1774717421281.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0910/20490910/instrument_cluster-1774717421281.jpeg not downloaded yet
2026-03-29 20:07:17 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (11765881) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/6490/14166490/interior_front_seats-1774611035175.jpg>.
2026-03-29 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12473126.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5403/20395403/exterior_rear_passenger-1774697817700.jpg> (referer: None)
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1615%252F19401615%252Finstrument_cluster-1774712966862.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1615/19401615/instrument_cluster-1774712966862.jpeg not downloaded yet
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0910%252F20490910%252Finterior_boot-1774717349559.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0910/20490910/interior_boot-1774717349559.jpeg not downloaded yet
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1615%252F19401615%252Finterior_boot-1774713046664.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1615/19401615/interior_boot-1774713046664.jpeg not downloaded yet
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0910%252F20490910%252Fdocs_service_history-1774718193467.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D27b9c28ffa45e03acfa0ae1f6b2aae4d%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0910/20490910/docs_service_history-1774718193467.jpeg?ixlib=js-3.8.0&auto=format&s=27b9c28ffa45e03acfa0ae1f6b2aae4d not downloaded yet
2026-03-29 20:07:17 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:17 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:17 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00!\xb5\xc4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xd4H\x00!\xab\xf0\x00\x00\x00\x00'
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8807050>
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66753701-4812-5472-a1cf-346dc71c407a/66753701-4812-5472-a1cf-346dc71c407a_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1388%252F19261388%252Finstrument_cluster-1774690408497.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1388/19261388/instrument_cluster-1774690408497.jpeg saved to cache
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66753701-4812-5472-a1cf-346dc71c407a
2026-03-29 20:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f59ec9ad-b792-555d-8d7c-4572c7312b38 with identifier: 20485884
2026-03-29 20:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59ec9ad-b792-555d-8d7c-4572c7312b38 with scrape type 1
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f59ec9ad-b792-555d-8d7c-4572c7312b38
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5884%252F20485884%252Fexterior_front_driver-1774782820588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_front_driver-1774782820588.jpg not downloaded yet
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8657bd0>
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e2f594-0071-53b5-80f7-4df79a5a4171/c3e2f594-0071-53b5-80f7-4df79a5a4171_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6328%252F11446328%252Fexterior_rear_driver-1772963904468.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6328/11446328/exterior_rear_driver-1772963904468.jpg saved to cache
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3e2f594-0071-53b5-80f7-4df79a5a4171
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfe3550>
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2621%252F17362621%252Fexterior_rear_passenger-1774721832336.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_rear_passenger-1774721832336.jpg saved to cache
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81564603-3cfb-51db-b531-bf5ba9bc5adb
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1615%252F19401615%252Fdocs_service_history-1774713960980.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbf080719e6d5e6e7946791b4f06feecc%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1615/19401615/docs_service_history-1774713960980.jpeg?ixlib=js-3.8.0&auto=format&s=bf080719e6d5e6e7946791b4f06feecc not downloaded yet
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0910%252F20490910%252Fdocs_service_history-1774718193533.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc187cf19b258bb4f4bf3f688bfdf0c91%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0910/20490910/docs_service_history-1774718193533.jpeg?ixlib=js-3.8.0&auto=format&s=c187cf19b258bb4f4bf3f688bfdf0c91 not downloaded yet
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5884%252F20485884%252Fexterior_rear_driver-1774782900769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_rear_driver-1774782900769.jpg not downloaded yet
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5884%252F20485884%252Fexterior_front_passenger-1774782881593.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_front_passenger-1774782881593.jpg not downloaded yet
2026-03-29 20:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 542c1d94-2c35-5b06-9b2c-e6c524c8f85f with identifier: 12473126
2026-03-29 20:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f with scrape type 1
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3126%252F12473126%252Fexterior_front_driver-1774619957417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_front_driver-1774619957417.jpg not downloaded yet
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ac5510>
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5403%252F20395403%252Fexterior_rear_passenger-1774697817700.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5403/20395403/exterior_rear_passenger-1774697817700.jpg saved to cache
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24ce5086-c3ae-59e8-8d18-cb827b304b65
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5884%252F20485884%252Fexterior_rear_passenger-1774782867727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_rear_passenger-1774782867727.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3126%252F12473126%252Fexterior_rear_driver-1774619916097.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_rear_driver-1774619916097.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5884%252F20485884%252F20485884-interior_front_seats-modified-1774784910542.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5884/20485884/20485884-interior_front_seats-modified-1774784910542.jpeg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3126%252F12473126%252Fexterior_front_passenger-1774619940774.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_front_passenger-1774619940774.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5884%252F20485884%252Finterior_rear_seats-1774783260506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5884/20485884/interior_rear_seats-1774783260506.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3126%252F12473126%252Fexterior_rear_passenger-1774619926000.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_rear_passenger-1774619926000.jpg not downloaded yet
2026-03-29 20:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17624223.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5884%252F20485884%252Finterior_dashboard-1774783334485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5884/20485884/interior_dashboard-1774783334485.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3126%252F12473126%252Finterior_front_seats-1774620293745.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3126/12473126/interior_front_seats-1774620293745.jpg not downloaded yet
2026-03-29 20:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1388/19261388/interior_front_seats-1774690250198.jpeg> (referer: None)
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5884%252F20485884%252Finstrument_cluster-1774783428310.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5884/20485884/instrument_cluster-1774783428310.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3126%252F12473126%252Finterior_rear_seats-1774620323090.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3126/12473126/interior_rear_seats-1774620323090.jpg not downloaded yet
2026-03-29 20:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5403/20395403/interior_dashboard-1774706015817.jpg> (referer: None)
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5884%252F20485884%252Finterior_boot-1774783283568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5884/20485884/interior_boot-1774783283568.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3126%252F12473126%252Finterior_dashboard-1774620347282.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3126/12473126/interior_dashboard-1774620347282.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5884%252F20485884%252F20485884-docs_service_history-default-1774784859390.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dee1c4b6500345ec4bfd3c1beb4be4ed8%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5884/20485884/20485884-docs_service_history-default-1774784859390.png?ixlib=js-3.8.0&auto=format&s=ee1c4b6500345ec4bfd3c1beb4be4ed8 not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3126%252F12473126%252Finstrument_cluster-1774621097379.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3126/12473126/instrument_cluster-1774621097379.jpg not downloaded yet
2026-03-29 20:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30a2b71f-9389-5749-8046-522ea2302195 with identifier: 17624223
2026-03-29 20:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30a2b71f-9389-5749-8046-522ea2302195 with scrape type 1
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30a2b71f-9389-5749-8046-522ea2302195
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4223%252F17624223%252Fexterior_front_driver-1774694976713.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_front_driver-1774694976713.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3126%252F12473126%252Finterior_boot-1774620357035.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3126/12473126/interior_boot-1774620357035.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4223%252F17624223%252Fexterior_rear_driver-1774695056883.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_rear_driver-1774695056883.jpg not downloaded yet
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x008,p\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02!H\x008"\x9c\x00\x00\x00\x00'
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ccc110>
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66753701-4812-5472-a1cf-346dc71c407a/66753701-4812-5472-a1cf-346dc71c407a_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1388%252F19261388%252Finterior_front_seats-1774690250198.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1388/19261388/interior_front_seats-1774690250198.jpeg saved to cache
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66753701-4812-5472-a1cf-346dc71c407a
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3126%252F12473126%252Fdocs_service_history-1774620628968.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D852ee87106f5a9b18af9126e675dead1%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3126/12473126/docs_service_history-1774620628968.jpg?ixlib=js-3.8.0&auto=format&s=852ee87106f5a9b18af9126e675dead1 not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4223%252F17624223%252Fexterior_front_passenger-1774694997250.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_front_passenger-1774694997250.jpg not downloaded yet
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf29750>
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5403%252F20395403%252Finterior_dashboard-1774706015817.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5403/20395403/interior_dashboard-1774706015817.jpg saved to cache
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24ce5086-c3ae-59e8-8d18-cb827b304b65
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4223%252F17624223%252Fexterior_rear_passenger-1774695026742.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_rear_passenger-1774695026742.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4223%252F17624223%252Finterior_front_seats-1774632763750.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4223/17624223/interior_front_seats-1774632763750.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4223%252F17624223%252Finterior_rear_seats-1774632942779.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4223/17624223/interior_rear_seats-1774632942779.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4223%252F17624223%252Finterior_dashboard-1774632885739.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4223/17624223/interior_dashboard-1774632885739.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4223%252F17624223%252Finstrument_cluster-1774632841817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4223/17624223/instrument_cluster-1774632841817.jpg not downloaded yet
2026-03-29 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4223%252F17624223%252Finterior_boot-1774632888264.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4223/17624223/interior_boot-1774632888264.jpg not downloaded yet
2026-03-29 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_front_driver-1774782820588.jpg> (referer: None)
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4223%252F17624223%252Fdocs_service_history-1774633496691.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db45e618c71f2a4cdd0a8ff09d0960386%27 HTTP/1.1" 200 None
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4223/17624223/docs_service_history-1774633496691.jpg?ixlib=js-3.8.0&auto=format&s=b45e618c71f2a4cdd0a8ff09d0960386 not downloaded yet
2026-03-29 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0910/20490910/docs_service_history-1774718193467.jpeg?ixlib=js-3.8.0&auto=format&s=27b9c28ffa45e03acfa0ae1f6b2aae4d> (referer: None)
2026-03-29 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0910/20490910/instrument_cluster-1774717421281.jpeg> (referer: None)
2026-03-29 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1615/19401615/instrument_cluster-1774712966862.jpeg> (referer: None)
2026-03-29 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0910/20490910/interior_dashboard-1774717391556.jpeg> (referer: None)
2026-03-29 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0910/20490910/interior_front_seats-1774717277501.jpeg> (referer: None)
2026-03-29 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1615/19401615/interior_boot-1774713046664.jpeg> (referer: None)
2026-03-29 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1615/19401615/interior_rear_seats-1774712877088.jpeg> (referer: None)
2026-03-29 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_front_passenger-1774619940774.jpg> (referer: None)
2026-03-29 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0910/20490910/interior_boot-1774717349559.jpeg> (referer: None)
2026-03-29 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3126/12473126/docs_service_history-1774620628968.jpg?ixlib=js-3.8.0&auto=format&s=852ee87106f5a9b18af9126e675dead1> (referer: None)
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa18f190>
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5884%252F20485884%252Fexterior_front_driver-1774782820588.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_front_driver-1774782820588.jpg saved to cache
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f59ec9ad-b792-555d-8d7c-4572c7312b38
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9604e10>
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0910%252F20490910%252Fdocs_service_history-1774718193467.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D27b9c28ffa45e03acfa0ae1f6b2aae4d') HTTP/1.1" 204 0
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0910/20490910/docs_service_history-1774718193467.jpeg?ixlib=js-3.8.0&auto=format&s=27b9c28ffa45e03acfa0ae1f6b2aae4d saved to cache
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c276091b-8744-508a-a0fa-b66e4398ec5d
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00 \xa7n\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x03\x0c\x00 \x9d\xdc\x00\x00\x00\x00'
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf6f4d0>
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0910%252F20490910%252Finstrument_cluster-1774717421281.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0910/20490910/instrument_cluster-1774717421281.jpeg saved to cache
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c276091b-8744-508a-a0fa-b66e4398ec5d
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1c/[\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01Z\xd9\x00\x1c$\xbd\x00\x00\x00\x00'
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81c15d0>
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1615%252F19401615%252Finstrument_cluster-1774712966862.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1615/19401615/instrument_cluster-1774712966862.jpeg saved to cache
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b"\x00\x03\x00\x00\x00'\x03;\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xb0*\x00&\xf9\xa9\x00\x00\x00\x00"
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9356c10>
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0910%252F20490910%252Finterior_dashboard-1774717391556.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0910/20490910/interior_dashboard-1774717391556.jpeg saved to cache
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c276091b-8744-508a-a0fa-b66e4398ec5d
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*,4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02/\xc6\x00*"\xa2\x00\x00\x00\x00'
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81c0cd0>
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0910%252F20490910%252Finterior_front_seats-1774717277501.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0910/20490910/interior_front_seats-1774717277501.jpeg saved to cache
2026-03-29 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c276091b-8744-508a-a0fa-b66e4398ec5d
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:19 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003\xd2K\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02Rf\x003\xc7\xad\x00\x00\x00\x00'
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9476010>
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1615%252F19401615%252Finterior_boot-1774713046664.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1615/19401615/interior_boot-1774713046664.jpeg saved to cache
2026-03-29 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc
2026-03-29 20:07:20 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:20 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:20 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003q\xb1\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x92@\x003g\x13\x00\x00\x00\x00'
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81c2150>
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1615%252F19401615%252Finterior_rear_seats-1774712877088.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1615/19401615/interior_rear_seats-1774712877088.jpeg saved to cache
2026-03-29 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81c3e90>
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3126%252F12473126%252Fexterior_front_passenger-1774619940774.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_front_passenger-1774619940774.jpg saved to cache
2026-03-29 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f
2026-03-29 20:07:20 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:20 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:20 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00N\xf7_\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\xbb\x90\x00N\xed\xcd\x00\x00\x00\x00'
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9355910>
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0910%252F20490910%252Finterior_boot-1774717349559.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0910/20490910/interior_boot-1774717349559.jpeg saved to cache
2026-03-29 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c276091b-8744-508a-a0fa-b66e4398ec5d
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f85910>
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3126%252F12473126%252Fdocs_service_history-1774620628968.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D852ee87106f5a9b18af9126e675dead1') HTTP/1.1" 204 0
2026-03-29 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3126/12473126/docs_service_history-1774620628968.jpg?ixlib=js-3.8.0&auto=format&s=852ee87106f5a9b18af9126e675dead1 saved to cache
2026-03-29 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f
2026-03-29 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7909/17857909/exterior_front_passenger-1774779451965.jpg> (referer: None)
2026-03-29 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1615/19401615/19401615-interior_dashboard-modified-1774714922751.jpeg> (referer: None)
2026-03-29 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_rear_driver-1774695056883.jpg> (referer: None)
2026-03-29 20:07:20 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/6490/14166490/interior_front_seats-1774611035175.jpg>.
2026-03-29 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6490/14166490/interior_front_seats-1774611035175.jpg> (referer: None)
2026-03-29 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4223/17624223/interior_boot-1774632888264.jpg> (referer: None)
2026-03-29 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4223/17624223/docs_service_history-1774633496691.jpg?ixlib=js-3.8.0&auto=format&s=b45e618c71f2a4cdd0a8ff09d0960386> (referer: None)
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9579810>
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7909%252F17857909%252Fexterior_front_passenger-1774779451965.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7909/17857909/exterior_front_passenger-1774779451965.jpg saved to cache
2026-03-29 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc
2026-03-29 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5884/20485884/20485884-docs_service_history-default-1774784859390.png?ixlib=js-3.8.0&auto=format&s=ee1c4b6500345ec4bfd3c1beb4be4ed8> (referer: None)
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8658550>
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1615%252F19401615%252F19401615-interior_dashboard-modified-1774714922751.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1615/19401615/19401615-interior_dashboard-modified-1774714922751.jpeg saved to cache
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae0af90>
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4223%252F17624223%252Fexterior_rear_driver-1774695056883.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_rear_driver-1774695056883.jpg saved to cache
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30a2b71f-9389-5749-8046-522ea2302195
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x1f\xe0'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x18\x00'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: Copyright (33432) - type: string (2) - value: b'\x00'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) - value: b'\x00'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 206 - value: b'Blackview\x00'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 94 - Data Location: 216 - value: b'SHARK 9\x00'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) - value: b'\x00'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x00'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 224 - value: b'2026:03:13 12:10:55\x00'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x01\x04'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\xdd'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 178 - Data Location: 244 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: Artist (315) - type: string (2) - value: b'\x00'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 202 - Data Location: 252 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f825d910>
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2789601-0a44-5b29-9bf7-2c5b4dac0169/f2789601-0a44-5b29-9bf7-2c5b4dac0169_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6490%252F14166490%252Finterior_front_seats-1774611035175.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6490/14166490/interior_front_seats-1774611035175.jpg saved to cache
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2789601-0a44-5b29-9bf7-2c5b4dac0169
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f13750>
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4223%252F17624223%252Finterior_boot-1774632888264.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4223/17624223/interior_boot-1774632888264.jpg saved to cache
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30a2b71f-9389-5749-8046-522ea2302195
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f825ded0>
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4223%252F17624223%252Fdocs_service_history-1774633496691.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db45e618c71f2a4cdd0a8ff09d0960386') HTTP/1.1" 204 0
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4223/17624223/docs_service_history-1774633496691.jpg?ixlib=js-3.8.0&auto=format&s=b45e618c71f2a4cdd0a8ff09d0960386 saved to cache
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30a2b71f-9389-5749-8046-522ea2302195
2026-03-29 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3126/12473126/instrument_cluster-1774621097379.jpg> (referer: None)
2026-03-29 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20303325.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:21 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:07:21 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 41 32768
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e4bad0>
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_9.png HTTP/1.1" 201 0
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5884%252F20485884%252F20485884-docs_service_history-default-1774784859390.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dee1c4b6500345ec4bfd3c1beb4be4ed8') HTTP/1.1" 204 0
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5884/20485884/20485884-docs_service_history-default-1774784859390.png?ixlib=js-3.8.0&auto=format&s=ee1c4b6500345ec4bfd3c1beb4be4ed8 saved to cache
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f59ec9ad-b792-555d-8d7c-4572c7312b38
2026-03-29 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_front_driver-1774694976713.jpg> (referer: None)
2026-03-29 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_front_passenger-1774694997250.jpg> (referer: None)
2026-03-29 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_rear_passenger-1774695026742.jpg> (referer: None)
2026-03-29 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4223/17624223/instrument_cluster-1774632841817.jpg> (referer: None)
2026-03-29 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4223/17624223/interior_dashboard-1774632885739.jpg> (referer: None)
2026-03-29 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4223/17624223/interior_front_seats-1774632763750.jpg> (referer: None)
2026-03-29 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4223/17624223/interior_rear_seats-1774632942779.jpg> (referer: None)
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ac3590>
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3126%252F12473126%252Finstrument_cluster-1774621097379.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3126/12473126/instrument_cluster-1774621097379.jpg saved to cache
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f
2026-03-29 20:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 251494c3-a929-5bda-b63d-791724f3566f with identifier: 20303325
2026-03-29 20:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 251494c3-a929-5bda-b63d-791724f3566f with scrape type 1
2026-03-29 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 251494c3-a929-5bda-b63d-791724f3566f
2026-03-29 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3325%252F20303325%252Fexterior_front_driver-1773941787311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3325/20303325/exterior_front_driver-1773941787311.jpg already downloaded
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3325%252F20303325%252Fexterior_rear_driver-1773941788816.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3325/20303325/exterior_rear_driver-1773941788816.jpg already downloaded
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3325%252F20303325%252Fexterior_front_passenger-1773941787602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3325/20303325/exterior_front_passenger-1773941787602.jpg already downloaded
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3325%252F20303325%252Fexterior_rear_passenger-1773941788918.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3325/20303325/exterior_rear_passenger-1773941788918.jpg already downloaded
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3325%252F20303325%252Finterior_front_seats-1773942464777.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3325/20303325/interior_front_seats-1773942464777.jpg not downloaded yet
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa188b10>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4223%252F17624223%252Fexterior_front_driver-1774694976713.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_front_driver-1774694976713.jpg saved to cache
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30a2b71f-9389-5749-8046-522ea2302195
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfe3dd0>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4223%252F17624223%252Fexterior_front_passenger-1774694997250.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_front_passenger-1774694997250.jpg saved to cache
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30a2b71f-9389-5749-8046-522ea2302195
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f847bed0>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4223%252F17624223%252Fexterior_rear_passenger-1774695026742.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_rear_passenger-1774695026742.jpg saved to cache
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30a2b71f-9389-5749-8046-522ea2302195
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81f0b10>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4223%252F17624223%252Finstrument_cluster-1774632841817.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4223/17624223/instrument_cluster-1774632841817.jpg saved to cache
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30a2b71f-9389-5749-8046-522ea2302195
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfe3910>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4223%252F17624223%252Finterior_dashboard-1774632885739.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4223/17624223/interior_dashboard-1774632885739.jpg saved to cache
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30a2b71f-9389-5749-8046-522ea2302195
2026-03-29 20:07:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89afd10>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4223%252F17624223%252Finterior_front_seats-1774632763750.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4223/17624223/interior_front_seats-1774632763750.jpg saved to cache
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30a2b71f-9389-5749-8046-522ea2302195
2026-03-29 20:07:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa040fd0>
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4223%252F17624223%252Finterior_rear_seats-1774632942779.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4223/17624223/interior_rear_seats-1774632942779.jpg saved to cache
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30a2b71f-9389-5749-8046-522ea2302195
2026-03-29 20:07:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30a2b71f-9389-5749-8046-522ea2302195, skipping ID generation
2026-03-29 20:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30a2b71f-9389-5749-8046-522ea2302195 with scrape type 1
2026-03-29 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30a2b71f-9389-5749-8046-522ea2302195 sending to next pipeline
2026-03-29 20:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 30a2b71f-9389-5749-8046-522ea2302195, identifier: 17624223
2026-03-29 20:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 30a2b71f-9389-5749-8046-522ea2302195 with identifier: 17624223
2026-03-29 20:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 30a2b71f-9389-5749-8046-522ea2302195 with identifier: 17624223
2026-03-29 20:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 30a2b71f-9389-5749-8046-522ea2302195 with identifier: 17624223 to the API
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4223/17624223/interior_rear_seats-1774632942779.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '30a2b71f-9389-5749-8046-522ea2302195',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PL20 BHN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17624223',
'listing': 'auction',
'location': 'Edinburgh Edinburgh',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 25897,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1149044,
'Height': 2447,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_front_driver-1774694976713.jpg',
'Width': 3263},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1423544,
'Height': 2863,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_rear_driver-1774695056883.jpg',
'Width': 3817},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1240444,
'Height': 2747,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_front_passenger-1774694997250.jpg',
'Width': 3663},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1328109,
'Height': 2834,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4223/17624223/exterior_rear_passenger-1774695026742.jpg',
'Width': 3778},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3141755,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4223/17624223/interior_front_seats-1774632763750.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3247268,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4223/17624223/interior_rear_seats-1774632942779.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1848420,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4223/17624223/interior_dashboard-1774632885739.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1856684,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4223/17624223/instrument_cluster-1774632841817.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3044925,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4223/17624223/interior_boot-1774632888264.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30a2b71f-9389-5749-8046-522ea2302195/30a2b71f-9389-5749-8046-522ea2302195_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3630988,
'Height': 3314,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4223/17624223/docs_service_history-1774633496691.jpg?ixlib=js-3.8.0&auto=format&s=b45e618c71f2a4cdd0a8ff09d0960386',
'Width': 2541}],
'price': 16502,
'price_includes_vat': False,
'registration_date': '2020-06-03',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 200 AMG Line Premium Auto',
'transmission': 'automatic',
'trim': 'A 200 AMG Line Premium Auto',
'vin': 'WDD1770872V051131',
'year': 2020}
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717624223%27 HTTP/1.1" 200 None
2026-03-29 20:07:23 [motorway.uk] INFO: Saving data for 17624223: {'created_time': 1774814843.660178, 'last_price_update_time': 1774814843.660189, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17624223') HTTP/1.1" 204 0
2026-03-29 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3126/12473126/interior_dashboard-1774620347282.jpg> (referer: None)
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3325%252F20303325%252Finterior_rear_seats-1773942458213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3325/20303325/interior_rear_seats-1773942458213.jpg already downloaded
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3325%252F20303325%252Finterior_dashboard-1773942533506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3325/20303325/interior_dashboard-1773942533506.jpg already downloaded
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3325%252F20303325%252Finterior_boot-1773942460599.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3325/20303325/interior_boot-1773942460599.jpg already downloaded
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3325%252F20303325%252Fdocs_service_history-1773943506259.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da42d827db0317b1afc122b8aba7189e8%27 HTTP/1.1" 200 None
2026-03-29 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3325/20303325/docs_service_history-1773943506259.jpg?ixlib=js-3.8.0&auto=format&s=a42d827db0317b1afc122b8aba7189e8 not downloaded yet
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3325%252F20303325%252Fdamage_scratches-1773941751291.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3325/20303325/damage_scratches-1773941751291.jpg already downloaded
2026-03-29 20:07:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebed4910>
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3126%252F12473126%252Finterior_dashboard-1774620347282.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3126/12473126/interior_dashboard-1774620347282.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f
2026-03-29 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3126/12473126/interior_boot-1774620357035.jpg> (referer: None)
2026-03-29 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_rear_driver-1774619916097.jpg> (referer: None)
2026-03-29 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5884/20485884/interior_dashboard-1774783334485.jpg> (referer: None)
2026-03-29 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_rear_passenger-1774619926000.jpg> (referer: None)
2026-03-29 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_rear_passenger-1774782867727.jpg> (referer: None)
2026-03-29 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5884/20485884/instrument_cluster-1774783428310.jpg> (referer: None)
2026-03-29 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5884/20485884/20485884-interior_front_seats-modified-1774784910542.jpeg> (referer: None)
2026-03-29 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3126/12473126/interior_rear_seats-1774620323090.jpg> (referer: None)
2026-03-29 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3126/12473126/interior_front_seats-1774620293745.jpg> (referer: None)
2026-03-29 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5884/20485884/interior_rear_seats-1774783260506.jpg> (referer: None)
2026-03-29 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5884/20485884/interior_boot-1774783283568.jpg> (referer: None)
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82f26d0>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3126%252F12473126%252Finterior_boot-1774620357035.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3126/12473126/interior_boot-1774620357035.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89a1d90>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3126%252F12473126%252Fexterior_rear_driver-1774619916097.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_rear_driver-1774619916097.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f59250>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5884%252F20485884%252Finterior_dashboard-1774783334485.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5884/20485884/interior_dashboard-1774783334485.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f59ec9ad-b792-555d-8d7c-4572c7312b38
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa07d150>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3126%252F12473126%252Fexterior_rear_passenger-1774619926000.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_rear_passenger-1774619926000.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa07d790>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5884%252F20485884%252Fexterior_rear_passenger-1774782867727.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_rear_passenger-1774782867727.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f59ec9ad-b792-555d-8d7c-4572c7312b38
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae9fc10>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5884%252F20485884%252Finstrument_cluster-1774783428310.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5884/20485884/instrument_cluster-1774783428310.jpg saved to cache
2026-03-29 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f59ec9ad-b792-555d-8d7c-4572c7312b38
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f941ce90>
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5884%252F20485884%252F20485884-interior_front_seats-modified-1774784910542.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5884/20485884/20485884-interior_front_seats-modified-1774784910542.jpeg saved to cache
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f59ec9ad-b792-555d-8d7c-4572c7312b38
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae9da90>
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3126%252F12473126%252Finterior_rear_seats-1774620323090.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3126/12473126/interior_rear_seats-1774620323090.jpg saved to cache
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8eae410>
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3126%252F12473126%252Finterior_front_seats-1774620293745.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3126/12473126/interior_front_seats-1774620293745.jpg saved to cache
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8888dd0>
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5884%252F20485884%252Finterior_rear_seats-1774783260506.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5884/20485884/interior_rear_seats-1774783260506.jpg saved to cache
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f59ec9ad-b792-555d-8d7c-4572c7312b38
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8eae610>
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5884%252F20485884%252Finterior_boot-1774783283568.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5884/20485884/interior_boot-1774783283568.jpg saved to cache
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f59ec9ad-b792-555d-8d7c-4572c7312b38
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3325/20303325/docs_service_history-1773943506259.jpg?ixlib=js-3.8.0&auto=format&s=a42d827db0317b1afc122b8aba7189e8> (referer: None)
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_front_passenger-1774782881593.jpg> (referer: None)
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_front_driver-1774619957417.jpg> (referer: None)
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0910/20490910/docs_service_history-1774718193533.jpeg?ixlib=js-3.8.0&auto=format&s=c187cf19b258bb4f4bf3f688bfdf0c91> (referer: None)
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1615/19401615/docs_service_history-1774713960980.jpeg?ixlib=js-3.8.0&auto=format&s=bf080719e6d5e6e7946791b4f06feecc> (referer: None)
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_rear_driver-1774782900769.jpg> (referer: None)
2026-03-29 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3325/20303325/interior_front_seats-1773942464777.jpg> (referer: None)
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8eae110>
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_251494c3-a929-5bda-b63d-791724f3566f/251494c3-a929-5bda-b63d-791724f3566f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3325%252F20303325%252Fdocs_service_history-1773943506259.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da42d827db0317b1afc122b8aba7189e8') HTTP/1.1" 204 0
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3325/20303325/docs_service_history-1773943506259.jpg?ixlib=js-3.8.0&auto=format&s=a42d827db0317b1afc122b8aba7189e8 saved to cache
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 251494c3-a929-5bda-b63d-791724f3566f
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f896a8d0>
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5884%252F20485884%252Fexterior_front_passenger-1774782881593.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_front_passenger-1774782881593.jpg saved to cache
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f59ec9ad-b792-555d-8d7c-4572c7312b38
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9313910>
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3126%252F12473126%252Fexterior_front_driver-1774619957417.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_front_driver-1774619957417.jpg saved to cache
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f
2026-03-29 20:07:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 542c1d94-2c35-5b06-9b2c-e6c524c8f85f, skipping ID generation
2026-03-29 20:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f with scrape type 1
2026-03-29 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 542c1d94-2c35-5b06-9b2c-e6c524c8f85f sending to next pipeline
2026-03-29 20:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 542c1d94-2c35-5b06-9b2c-e6c524c8f85f, identifier: 12473126
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa07fa10>
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0910%252F20490910%252Fdocs_service_history-1774718193533.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc187cf19b258bb4f4bf3f688bfdf0c91') HTTP/1.1" 204 0
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0910/20490910/docs_service_history-1774718193533.jpeg?ixlib=js-3.8.0&auto=format&s=c187cf19b258bb4f4bf3f688bfdf0c91 saved to cache
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c276091b-8744-508a-a0fa-b66e4398ec5d
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93e1810>
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1615%252F19401615%252Fdocs_service_history-1774713960980.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbf080719e6d5e6e7946791b4f06feecc') HTTP/1.1" 204 0
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1615/19401615/docs_service_history-1774713960980.jpeg?ixlib=js-3.8.0&auto=format&s=bf080719e6d5e6e7946791b4f06feecc saved to cache
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82f9650>
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5884%252F20485884%252Fexterior_rear_driver-1774782900769.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_rear_driver-1774782900769.jpg saved to cache
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f59ec9ad-b792-555d-8d7c-4572c7312b38
2026-03-29 20:07:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f59ec9ad-b792-555d-8d7c-4572c7312b38, skipping ID generation
2026-03-29 20:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f59ec9ad-b792-555d-8d7c-4572c7312b38 with scrape type 1
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f59ec9ad-b792-555d-8d7c-4572c7312b38 sending to next pipeline
2026-03-29 20:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f59ec9ad-b792-555d-8d7c-4572c7312b38, identifier: 20485884
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8969750>
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_251494c3-a929-5bda-b63d-791724f3566f/251494c3-a929-5bda-b63d-791724f3566f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3325%252F20303325%252Finterior_front_seats-1773942464777.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3325/20303325/interior_front_seats-1773942464777.jpg saved to cache
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 251494c3-a929-5bda-b63d-791724f3566f
2026-03-29 20:07:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 251494c3-a929-5bda-b63d-791724f3566f, skipping ID generation
2026-03-29 20:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 251494c3-a929-5bda-b63d-791724f3566f with scrape type 1
2026-03-29 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 251494c3-a929-5bda-b63d-791724f3566f sending to next pipeline
2026-03-29 20:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 251494c3-a929-5bda-b63d-791724f3566f, identifier: 20303325
2026-03-29 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_front_passenger-1774717213197.jpeg> (referer: None)
2026-03-29 20:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 542c1d94-2c35-5b06-9b2c-e6c524c8f85f with identifier: 12473126
2026-03-29 20:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 542c1d94-2c35-5b06-9b2c-e6c524c8f85f with identifier: 12473126
2026-03-29 20:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 542c1d94-2c35-5b06-9b2c-e6c524c8f85f with identifier: 12473126 to the API
2026-03-29 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_front_driver-1774619957417.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '542c1d94-2c35-5b06-9b2c-e6c524c8f85f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD67 YPA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/12473126',
'listing': 'auction',
'location': 'Somerset Frome',
'make': 'Nissan',
'model': 'Juke',
'odometer': 56664,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2022192,
'Height': 2921,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_front_driver-1774619957417.jpg',
'Width': 3894},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1494169,
'Height': 2488,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_rear_driver-1774619916097.jpg',
'Width': 3317},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1995620,
'Height': 2765,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_front_passenger-1774619940774.jpg',
'Width': 3686},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1930138,
'Height': 2867,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3126/12473126/exterior_rear_passenger-1774619926000.jpg',
'Width': 3823},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3570305,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3126/12473126/interior_front_seats-1774620293745.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3536608,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3126/12473126/interior_rear_seats-1774620323090.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3702897,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3126/12473126/interior_dashboard-1774620347282.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 677588,
'Height': 1657,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3126/12473126/instrument_cluster-1774621097379.jpg',
'Width': 2209},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3168424,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3126/12473126/interior_boot-1774620357035.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_542c1d94-2c35-5b06-9b2c-e6c524c8f85f/542c1d94-2c35-5b06-9b2c-e6c524c8f85f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432621,
'Height': 2601,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3126/12473126/docs_service_history-1774620628968.jpg?ixlib=js-3.8.0&auto=format&s=852ee87106f5a9b18af9126e675dead1',
'Width': 3308}],
'price': 4910,
'price_includes_vat': False,
'registration_date': '2017-10-31',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke N-Connecta DiG-T',
'transmission': 'manual',
'trim': 'N-Connecta DiG-T',
'vin': 'SJNFEAF15U7392029',
'year': 2017}
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712473126%27 HTTP/1.1" 200 None
2026-03-29 20:07:27 [motorway.uk] INFO: Saving data for 12473126: {'created_time': 1774814847.200511, 'last_price_update_time': 1774814847.200521, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='12473126') HTTP/1.1" 204 0
2026-03-29 20:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f59ec9ad-b792-555d-8d7c-4572c7312b38 with identifier: 20485884
2026-03-29 20:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f59ec9ad-b792-555d-8d7c-4572c7312b38 with identifier: 20485884
2026-03-29 20:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f59ec9ad-b792-555d-8d7c-4572c7312b38 with identifier: 20485884 to the API
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_rear_driver-1774782900769.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'f59ec9ad-b792-555d-8d7c-4572c7312b38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PA07 BEV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20485884',
'listing': 'auction',
'location': 'Nottinghamshire Mansfield',
'make': 'Jaguar',
'model': 'F-PACE',
'odometer': 86324,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1671733,
'Height': 2442,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_front_driver-1774782820588.jpg',
'Width': 3256},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2073845,
'Height': 2720,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_rear_driver-1774782900769.jpg',
'Width': 3626},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1150402,
'Height': 2098,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_front_passenger-1774782881593.jpg',
'Width': 2797},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2251336,
'Height': 2777,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5884/20485884/exterior_rear_passenger-1774782867727.jpg',
'Width': 3703},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3454395,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5884/20485884/20485884-interior_front_seats-modified-1774784910542.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3850083,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5884/20485884/interior_rear_seats-1774783260506.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1657996,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5884/20485884/interior_dashboard-1774783334485.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2293001,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5884/20485884/instrument_cluster-1774783428310.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3944378,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5884/20485884/interior_boot-1774783283568.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f59ec9ad-b792-555d-8d7c-4572c7312b38/f59ec9ad-b792-555d-8d7c-4572c7312b38_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 63347,
'Height': 358,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5884/20485884/20485884-docs_service_history-default-1774784859390.png?ixlib=js-3.8.0&auto=format&s=ee1c4b6500345ec4bfd3c1beb4be4ed8',
'Width': 719}],
'price': 9880,
'price_includes_vat': False,
'registration_date': '2019-04-17',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar F-PACE R-Sport AWD D Auto',
'transmission': 'automatic',
'trim': 'R-Sport AWD D Auto',
'vin': 'SADCA2AN9KA612490',
'year': 2019}
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485884%27 HTTP/1.1" 200 None
2026-03-29 20:07:27 [motorway.uk] INFO: Saving data for 20485884: {'created_time': 1774814847.599328, 'last_price_update_time': 1774814847.599339, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20485884') HTTP/1.1" 204 0
2026-03-29 20:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 251494c3-a929-5bda-b63d-791724f3566f with identifier: 20303325
2026-03-29 20:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 251494c3-a929-5bda-b63d-791724f3566f with identifier: 20303325
2026-03-29 20:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 251494c3-a929-5bda-b63d-791724f3566f with identifier: 20303325 to the API
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3325/20303325/interior_front_seats-1773942464777.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '251494c3-a929-5bda-b63d-791724f3566f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LV66 OFM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20303325',
'listing': 'auction',
'location': 'Kent Canterbury',
'make': 'MINI',
'model': 'Cooper',
'odometer': 60000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251494c3-a929-5bda-b63d-791724f3566f/251494c3-a929-5bda-b63d-791724f3566f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1325203,
'Height': 2366,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3325/20303325/exterior_front_driver-1773941787311.jpg',
'Width': 3154},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251494c3-a929-5bda-b63d-791724f3566f/251494c3-a929-5bda-b63d-791724f3566f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 944687,
'Height': 2138,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3325/20303325/exterior_rear_driver-1773941788816.jpg',
'Width': 2850},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251494c3-a929-5bda-b63d-791724f3566f/251494c3-a929-5bda-b63d-791724f3566f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 851561,
'Height': 2018,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3325/20303325/exterior_front_passenger-1773941787602.jpg',
'Width': 2691},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251494c3-a929-5bda-b63d-791724f3566f/251494c3-a929-5bda-b63d-791724f3566f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1053458,
'Height': 2196,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3325/20303325/exterior_rear_passenger-1773941788918.jpg',
'Width': 2928},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251494c3-a929-5bda-b63d-791724f3566f/251494c3-a929-5bda-b63d-791724f3566f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3079888,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3325/20303325/interior_front_seats-1773942464777.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251494c3-a929-5bda-b63d-791724f3566f/251494c3-a929-5bda-b63d-791724f3566f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2023936,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3325/20303325/interior_rear_seats-1773942458213.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251494c3-a929-5bda-b63d-791724f3566f/251494c3-a929-5bda-b63d-791724f3566f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1686773,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3325/20303325/interior_dashboard-1773942533506.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251494c3-a929-5bda-b63d-791724f3566f/251494c3-a929-5bda-b63d-791724f3566f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3019270,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3325/20303325/interior_boot-1773942460599.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251494c3-a929-5bda-b63d-791724f3566f/251494c3-a929-5bda-b63d-791724f3566f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 990540,
'Height': 995,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3325/20303325/docs_service_history-1773943506259.jpg?ixlib=js-3.8.0&auto=format&s=a42d827db0317b1afc122b8aba7189e8',
'Width': 1317},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251494c3-a929-5bda-b63d-791724f3566f/251494c3-a929-5bda-b63d-791724f3566f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2136706,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3325/20303325/damage_scratches-1773941751291.jpg',
'Width': 4032}],
'price': 6099,
'price_includes_vat': False,
'registration_date': '2016-10-16',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'manual',
'trim': 'S',
'vin': 'WMWXM720302D58996',
'year': 2016}
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720303325%27 HTTP/1.1" 200 None
2026-03-29 20:07:27 [motorway.uk] INFO: Saving data for 20303325: {'created_time': 1774814847.972149, 'last_price_update_time': 1774814847.972159, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20303325') HTTP/1.1" 204 0
2026-03-29 20:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7909/17857909/docs_service_history-1774720742141.jpg?ixlib=js-3.8.0&auto=format&s=a22c5630fbbb8eb8f060419166f81893> (referer: None)
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f886b250>
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0910%252F20490910%252Fexterior_front_passenger-1774717213197.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_front_passenger-1774717213197.jpeg saved to cache
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c276091b-8744-508a-a0fa-b66e4398ec5d
2026-03-29 20:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfb6450>
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7909%252F17857909%252Fdocs_service_history-1774720742141.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da22c5630fbbb8eb8f060419166f81893') HTTP/1.1" 204 0
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7909/17857909/docs_service_history-1774720742141.jpg?ixlib=js-3.8.0&auto=format&s=a22c5630fbbb8eb8f060419166f81893 saved to cache
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc
2026-03-29 20:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_rear_driver-1774717242264.jpeg> (referer: None)
2026-03-29 20:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_rear_driver-1774712732515.jpeg> (referer: None)
2026-03-29 20:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_rear_passenger-1774717227248.jpeg> (referer: None)
2026-03-29 20:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_rear_passenger-1774712726071.jpeg> (referer: None)
2026-03-29 20:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_front_passenger-1774712713011.jpeg> (referer: None)
2026-03-29 20:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7909/17857909/interior_boot-1774720436156.jpg> (referer: None)
2026-03-29 20:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7909/17857909/instrument_cluster-1774720370087.jpg> (referer: None)
2026-03-29 20:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1615/19401615/interior_front_seats-1774713247538.jpeg> (referer: None)
2026-03-29 20:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_front_driver-1774717214592.jpeg> (referer: None)
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f953e4d0>
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0910%252F20490910%252Fexterior_rear_driver-1774717242264.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_rear_driver-1774717242264.jpeg saved to cache
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c276091b-8744-508a-a0fa-b66e4398ec5d
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab7c750>
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1615%252F19401615%252Fexterior_rear_driver-1774712732515.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_rear_driver-1774712732515.jpeg saved to cache
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f58350>
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0910%252F20490910%252Fexterior_rear_passenger-1774717227248.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_rear_passenger-1774717227248.jpeg saved to cache
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c276091b-8744-508a-a0fa-b66e4398ec5d
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8fba090>
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1615%252F19401615%252Fexterior_rear_passenger-1774712726071.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_rear_passenger-1774712726071.jpeg saved to cache
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c03a90>
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1615%252F19401615%252Fexterior_front_passenger-1774712713011.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_front_passenger-1774712713011.jpeg saved to cache
2026-03-29 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc
2026-03-29 20:07:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf54190>
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7909%252F17857909%252Finterior_boot-1774720436156.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7909/17857909/interior_boot-1774720436156.jpg saved to cache
2026-03-29 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc
2026-03-29 20:07:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c02090>
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7909%252F17857909%252Finstrument_cluster-1774720370087.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7909/17857909/instrument_cluster-1774720370087.jpg saved to cache
2026-03-29 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc
2026-03-29 20:07:29 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:29 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:29 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00-`\x98\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x07\xed\x00-U\xfa\x00\x00\x00\x00'
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f937ec10>
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1615%252F19401615%252Finterior_front_seats-1774713247538.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1615/19401615/interior_front_seats-1774713247538.jpeg saved to cache
2026-03-29 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0cafd0>
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0910%252F20490910%252Fexterior_front_driver-1774717214592.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_front_driver-1774717214592.jpeg saved to cache
2026-03-29 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c276091b-8744-508a-a0fa-b66e4398ec5d
2026-03-29 20:07:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c276091b-8744-508a-a0fa-b66e4398ec5d, skipping ID generation
2026-03-29 20:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c276091b-8744-508a-a0fa-b66e4398ec5d with scrape type 1
2026-03-29 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c276091b-8744-508a-a0fa-b66e4398ec5d sending to next pipeline
2026-03-29 20:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c276091b-8744-508a-a0fa-b66e4398ec5d, identifier: 20490910
2026-03-29 20:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c276091b-8744-508a-a0fa-b66e4398ec5d with identifier: 20490910
2026-03-29 20:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c276091b-8744-508a-a0fa-b66e4398ec5d with identifier: 20490910
2026-03-29 20:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c276091b-8744-508a-a0fa-b66e4398ec5d with identifier: 20490910 to the API
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_front_driver-1774717214592.jpeg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '3.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c276091b-8744-508a-a0fa-b66e4398ec5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'K5 KXB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20490910',
'listing': 'auction',
'location': 'West Yorkshire Bradford',
'make': 'Porsche',
'model': 'Cayman',
'odometer': 78200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 78,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1461460,
'Height': 2467,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_front_driver-1774717214592.jpeg',
'Width': 3289},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1345665,
'Height': 2967,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_rear_driver-1774717242264.jpeg',
'Width': 3956},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1440546,
'Height': 2548,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_front_passenger-1774717213197.jpeg',
'Width': 3397},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1771182,
'Height': 2827,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0910/20490910/exterior_rear_passenger-1774717227248.jpeg',
'Width': 3769},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2907130,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0910/20490910/interior_front_seats-1774717277501.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2732901,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0910/20490910/interior_dashboard-1774717391556.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2271866,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0910/20490910/instrument_cluster-1774717421281.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 5419759,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0910/20490910/interior_boot-1774717349559.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1155269,
'Height': 2268,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0910/20490910/docs_service_history-1774718193467.jpeg?ixlib=js-3.8.0&auto=format&s=27b9c28ffa45e03acfa0ae1f6b2aae4d',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c276091b-8744-508a-a0fa-b66e4398ec5d/c276091b-8744-508a-a0fa-b66e4398ec5d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1192588,
'Height': 2268,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0910/20490910/docs_service_history-1774718193533.jpeg?ixlib=js-3.8.0&auto=format&s=c187cf19b258bb4f4bf3f688bfdf0c91',
'Width': 4032}],
'price': 8811,
'price_includes_vat': False,
'registration_date': '2006-05-26',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Cayman S',
'transmission': 'manual',
'trim': 'S',
'vin': 'WP0ZZZ98Z6U776865',
'year': 2006}
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490910%27 HTTP/1.1" 200 None
2026-03-29 20:07:29 [motorway.uk] INFO: Saving data for 20490910: {'created_time': 1774814849.853414, 'last_price_update_time': 1774814849.853424, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20490910') HTTP/1.1" 204 0
2026-03-29 20:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_front_driver-1774712703849.jpeg> (referer: None)
2026-03-29 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7909/17857909/exterior_rear_passenger-1774719425570.jpg> (referer: None)
2026-03-29 20:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7909/17857909/interior_dashboard-1774779474996.jpg> (referer: None)
2026-03-29 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7909/17857909/interior_rear_seats-1774720327973.jpg> (referer: None)
2026-03-29 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7909/17857909/interior_front_seats-1774720281690.jpg> (referer: None)
2026-03-29 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5403/20395403/docs_service_history-1774701135237.jpg?ixlib=js-3.8.0&auto=format&s=c7b54b42eb8f04acfbca7880f6379fe8> (referer: None)
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe47a50>
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1615%252F19401615%252Fexterior_front_driver-1774712703849.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_front_driver-1774712703849.jpeg saved to cache
2026-03-29 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc
2026-03-29 20:07:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00adaa46-fb19-5029-a781-b8cf7ebe9bbc, skipping ID generation
2026-03-29 20:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc with scrape type 1
2026-03-29 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00adaa46-fb19-5029-a781-b8cf7ebe9bbc sending to next pipeline
2026-03-29 20:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 00adaa46-fb19-5029-a781-b8cf7ebe9bbc, identifier: 19401615
2026-03-29 20:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 00adaa46-fb19-5029-a781-b8cf7ebe9bbc with identifier: 19401615
2026-03-29 20:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 00adaa46-fb19-5029-a781-b8cf7ebe9bbc with identifier: 19401615
2026-03-29 20:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 00adaa46-fb19-5029-a781-b8cf7ebe9bbc with identifier: 19401615 to the API
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_front_driver-1774712703849.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.7L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '00adaa46-fb19-5029-a781-b8cf7ebe9bbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'ET18 RZX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19401615',
'listing': 'auction',
'location': 'Lincolnshire Spalding',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 84123,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1654143,
'Height': 2644,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_front_driver-1774712703849.jpeg',
'Width': 3525},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 975345,
'Height': 2602,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_rear_driver-1774712732515.jpeg',
'Width': 3469},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1918111,
'Height': 2826,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_front_passenger-1774712713011.jpeg',
'Width': 3768},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1504050,
'Height': 2416,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1615/19401615/exterior_rear_passenger-1774712726071.jpeg',
'Width': 3221},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3106949,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1615/19401615/interior_front_seats-1774713247538.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3539953,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1615/19401615/interior_rear_seats-1774712877088.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2195894,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1615/19401615/19401615-interior_dashboard-modified-1774714922751.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1935924,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1615/19401615/instrument_cluster-1774712966862.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3548337,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1615/19401615/interior_boot-1774713046664.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00adaa46-fb19-5029-a781-b8cf7ebe9bbc/00adaa46-fb19-5029-a781-b8cf7ebe9bbc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1483895,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1615/19401615/docs_service_history-1774713960980.jpeg?ixlib=js-3.8.0&auto=format&s=bf080719e6d5e6e7946791b4f06feecc',
'Width': 3024}],
'price': 6273,
'price_includes_vat': False,
'registration_date': '2018-06-28',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Tucson GO SE 2WD CRDI',
'transmission': 'manual',
'trim': 'GO SE 2WD CRDI',
'vin': 'TMAJ3815LJJ682391',
'year': 2018}
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719401615%27 HTTP/1.1" 200 None
2026-03-29 20:07:30 [motorway.uk] INFO: Saving data for 19401615: {'created_time': 1774814850.5782, 'last_price_update_time': 1774814850.578211, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19401615') HTTP/1.1" 204 0
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f6ffd0>
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7909%252F17857909%252Fexterior_rear_passenger-1774719425570.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7909/17857909/exterior_rear_passenger-1774719425570.jpg saved to cache
2026-03-29 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8977410>
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7909%252F17857909%252Finterior_dashboard-1774779474996.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7909/17857909/interior_dashboard-1774779474996.jpg saved to cache
2026-03-29 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc
2026-03-29 20:07:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8237310>
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7909%252F17857909%252Finterior_rear_seats-1774720327973.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7909/17857909/interior_rear_seats-1774720327973.jpg saved to cache
2026-03-29 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc
2026-03-29 20:07:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8237550>
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7909%252F17857909%252Finterior_front_seats-1774720281690.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7909/17857909/interior_front_seats-1774720281690.jpg saved to cache
2026-03-29 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f958a9d0>
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5403%252F20395403%252Fdocs_service_history-1774701135237.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc7b54b42eb8f04acfbca7880f6379fe8') HTTP/1.1" 204 0
2026-03-29 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5403/20395403/docs_service_history-1774701135237.jpg?ixlib=js-3.8.0&auto=format&s=c7b54b42eb8f04acfbca7880f6379fe8 saved to cache
2026-03-29 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24ce5086-c3ae-59e8-8d18-cb827b304b65
2026-03-29 20:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7909/17857909/exterior_rear_driver-1774719401283.jpg> (referer: None)
2026-03-29 20:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7909/17857909/exterior_front_driver-1774779427209.jpg> (referer: None)
2026-03-29 20:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2621/17362621/interior_boot-1774722134560.jpg> (referer: None)
2026-03-29 20:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8360/20488360/20488360-docs_service_history-modified-1774716006916.jpeg?ixlib=js-3.8.0&auto=format&s=249bbc83863982e4769bfe0616f2507d> (referer: None)
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f907c0d0>
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7909%252F17857909%252Fexterior_rear_driver-1774719401283.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7909/17857909/exterior_rear_driver-1774719401283.jpg saved to cache
2026-03-29 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9596650>
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7909%252F17857909%252Fexterior_front_driver-1774779427209.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7909/17857909/exterior_front_driver-1774779427209.jpg saved to cache
2026-03-29 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc
2026-03-29 20:07:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c71c4f63-179e-5786-a4e7-ffc8d824b5fc, skipping ID generation
2026-03-29 20:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc with scrape type 1
2026-03-29 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c71c4f63-179e-5786-a4e7-ffc8d824b5fc sending to next pipeline
2026-03-29 20:07:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c71c4f63-179e-5786-a4e7-ffc8d824b5fc, identifier: 17857909
2026-03-29 20:07:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f907df90>
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2621%252F17362621%252Finterior_boot-1774722134560.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2621/17362621/interior_boot-1774722134560.jpg saved to cache
2026-03-29 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81564603-3cfb-51db-b531-bf5ba9bc5adb
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f927f7d0>
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8360%252F20488360%252F20488360-docs_service_history-modified-1774716006916.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D249bbc83863982e4769bfe0616f2507d') HTTP/1.1" 204 0
2026-03-29 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8360/20488360/20488360-docs_service_history-modified-1774716006916.jpeg?ixlib=js-3.8.0&auto=format&s=249bbc83863982e4769bfe0616f2507d saved to cache
2026-03-29 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a91e511d-5852-5351-bcf2-cfd929ade4b7
2026-03-29 20:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c71c4f63-179e-5786-a4e7-ffc8d824b5fc with identifier: 17857909
2026-03-29 20:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c71c4f63-179e-5786-a4e7-ffc8d824b5fc with identifier: 17857909
2026-03-29 20:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c71c4f63-179e-5786-a4e7-ffc8d824b5fc with identifier: 17857909 to the API
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/7909/17857909/exterior_front_driver-1774779427209.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'c71c4f63-179e-5786-a4e7-ffc8d824b5fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD16 ENH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17857909',
'listing': 'auction',
'location': 'Surrey Camberley',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 89500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2893935,
'Height': 2983,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7909/17857909/exterior_front_driver-1774779427209.jpg',
'Width': 3977},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1432749,
'Height': 2607,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7909/17857909/exterior_rear_driver-1774719401283.jpg',
'Width': 3476},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2673389,
'Height': 2973,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7909/17857909/exterior_front_passenger-1774779451965.jpg',
'Width': 3964},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1364216,
'Height': 2600,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7909/17857909/exterior_rear_passenger-1774719425570.jpg',
'Width': 3467},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4391989,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7909/17857909/interior_front_seats-1774720281690.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3291160,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7909/17857909/interior_rear_seats-1774720327973.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2450779,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7909/17857909/interior_dashboard-1774779474996.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2982452,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7909/17857909/instrument_cluster-1774720370087.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2773565,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7909/17857909/interior_boot-1774720436156.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c71c4f63-179e-5786-a4e7-ffc8d824b5fc/c71c4f63-179e-5786-a4e7-ffc8d824b5fc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1264069,
'Height': 1605,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7909/17857909/docs_service_history-1774720742141.jpg?ixlib=js-3.8.0&auto=format&s=a22c5630fbbb8eb8f060419166f81893',
'Width': 2185}],
'price': 4187,
'price_includes_vat': False,
'registration_date': '2016-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai Tekna DCI',
'transmission': 'manual',
'trim': 'Tekna DCI',
'vin': 'SJNFDAJ11U1619472',
'year': 2016}
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717857909%27 HTTP/1.1" 200 None
2026-03-29 20:07:32 [motorway.uk] INFO: Saving data for 17857909: {'created_time': 1774814852.352637, 'last_price_update_time': 1774814852.352647, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17857909') HTTP/1.1" 204 0
2026-03-29 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8360/20488360/interior_boot-1774705838992.jpg> (referer: None)
2026-03-29 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5403/20395403/instrument_cluster-1774698533488.jpg> (referer: None)
2026-03-29 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2621/17362621/instrument_cluster-1774722181157.jpg> (referer: None)
2026-03-29 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5403/20395403/interior_boot-1774705749575.jpg> (referer: None)
2026-03-29 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2621/17362621/interior_dashboard-1774722131743.jpg> (referer: None)
2026-03-29 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2621/17362621/docs_service_history-1774722366703.jpg?ixlib=js-3.8.0&auto=format&s=ff4e75e1df5f91a1b18ebe1064e1f296> (referer: None)
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85dbc50>
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8360%252F20488360%252Finterior_boot-1774705838992.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8360/20488360/interior_boot-1774705838992.jpg saved to cache
2026-03-29 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a91e511d-5852-5351-bcf2-cfd929ade4b7
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85db590>
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5403%252F20395403%252Finstrument_cluster-1774698533488.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5403/20395403/instrument_cluster-1774698533488.jpg saved to cache
2026-03-29 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24ce5086-c3ae-59e8-8d18-cb827b304b65
2026-03-29 20:07:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85f16d0>
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2621%252F17362621%252Finstrument_cluster-1774722181157.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2621/17362621/instrument_cluster-1774722181157.jpg saved to cache
2026-03-29 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81564603-3cfb-51db-b531-bf5ba9bc5adb
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95431d0>
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5403%252F20395403%252Finterior_boot-1774705749575.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5403/20395403/interior_boot-1774705749575.jpg saved to cache
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24ce5086-c3ae-59e8-8d18-cb827b304b65
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9244550>
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2621%252F17362621%252Finterior_dashboard-1774722131743.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2621/17362621/interior_dashboard-1774722131743.jpg saved to cache
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81564603-3cfb-51db-b531-bf5ba9bc5adb
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700dec4d0>
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2621%252F17362621%252Fdocs_service_history-1774722366703.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dff4e75e1df5f91a1b18ebe1064e1f296') HTTP/1.1" 204 0
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2621/17362621/docs_service_history-1774722366703.jpg?ixlib=js-3.8.0&auto=format&s=ff4e75e1df5f91a1b18ebe1064e1f296 saved to cache
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81564603-3cfb-51db-b531-bf5ba9bc5adb
2026-03-29 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8360/20488360/instrument_cluster-1774705801465.jpg> (referer: None)
2026-03-29 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8360/20488360/interior_dashboard-1774705834322.jpg> (referer: None)
2026-03-29 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2621/17362621/interior_rear_seats-1774722106390.jpg> (referer: None)
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f942d2d0>
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8360%252F20488360%252Finstrument_cluster-1774705801465.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8360/20488360/instrument_cluster-1774705801465.jpg saved to cache
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a91e511d-5852-5351-bcf2-cfd929ade4b7
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c1dc50>
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8360%252F20488360%252Finterior_dashboard-1774705834322.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8360/20488360/interior_dashboard-1774705834322.jpg saved to cache
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a91e511d-5852-5351-bcf2-cfd929ade4b7
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9523e90>
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2621%252F17362621%252Finterior_rear_seats-1774722106390.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2621/17362621/interior_rear_seats-1774722106390.jpg saved to cache
2026-03-29 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81564603-3cfb-51db-b531-bf5ba9bc5adb
2026-03-29 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8360/20488360/interior_rear_seats-1774705691272.jpg> (referer: None)
2026-03-29 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6490/14166490/docs_service_history-1774694290216.jpg?ixlib=js-3.8.0&auto=format&s=e6e6246fe4d571b724fcde30ff3641d2> (referer: None)
2026-03-29 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8360/20488360/20488360-interior_front_seats-modified-1774715919819.jpeg> (referer: None)
2026-03-29 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5403/20395403/interior_rear_seats-1774698664763.jpg> (referer: None)
2026-03-29 20:07:34 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (20727314) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/6328/11446328/interior_boot-1774698345286.png>.
2026-03-29 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5403/20395403/interior_front_seats-1774698727189.jpg> (referer: None)
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facc2650>
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8360%252F20488360%252Finterior_rear_seats-1774705691272.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8360/20488360/interior_rear_seats-1774705691272.jpg saved to cache
2026-03-29 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a91e511d-5852-5351-bcf2-cfd929ade4b7
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82761d0>
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2789601-0a44-5b29-9bf7-2c5b4dac0169/f2789601-0a44-5b29-9bf7-2c5b4dac0169_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6490%252F14166490%252Fdocs_service_history-1774694290216.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De6e6246fe4d571b724fcde30ff3641d2') HTTP/1.1" 204 0
2026-03-29 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6490/14166490/docs_service_history-1774694290216.jpg?ixlib=js-3.8.0&auto=format&s=e6e6246fe4d571b724fcde30ff3641d2 saved to cache
2026-03-29 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2789601-0a44-5b29-9bf7-2c5b4dac0169
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe46b50>
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8360%252F20488360%252F20488360-interior_front_seats-modified-1774715919819.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8360/20488360/20488360-interior_front_seats-modified-1774715919819.jpeg saved to cache
2026-03-29 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a91e511d-5852-5351-bcf2-cfd929ade4b7
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8701c10f50>
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5403%252F20395403%252Finterior_rear_seats-1774698664763.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5403/20395403/interior_rear_seats-1774698664763.jpg saved to cache
2026-03-29 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24ce5086-c3ae-59e8-8d18-cb827b304b65
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f907de10>
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5403%252F20395403%252Finterior_front_seats-1774698727189.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5403/20395403/interior_front_seats-1774698727189.jpg saved to cache
2026-03-29 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24ce5086-c3ae-59e8-8d18-cb827b304b65
2026-03-29 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6490/14166490/interior_boot-1774543863183.jpg> (referer: None)
2026-03-29 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_front_passenger-1774721851154.jpg> (referer: None)
2026-03-29 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2621/17362621/interior_front_seats-1774722092515.jpg> (referer: None)
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f927ce90>
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2789601-0a44-5b29-9bf7-2c5b4dac0169/f2789601-0a44-5b29-9bf7-2c5b4dac0169_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6490%252F14166490%252Finterior_boot-1774543863183.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6490/14166490/interior_boot-1774543863183.jpg saved to cache
2026-03-29 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2789601-0a44-5b29-9bf7-2c5b4dac0169
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e55910>
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2621%252F17362621%252Fexterior_front_passenger-1774721851154.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_front_passenger-1774721851154.jpg saved to cache
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81564603-3cfb-51db-b531-bf5ba9bc5adb
2026-03-29 20:07:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae9ea90>
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2621%252F17362621%252Finterior_front_seats-1774722092515.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2621/17362621/interior_front_seats-1774722092515.jpg saved to cache
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81564603-3cfb-51db-b531-bf5ba9bc5adb
2026-03-29 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6490/14166490/instrument_cluster-1774694322561.jpg> (referer: None)
2026-03-29 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8360/20488360/exterior_front_passenger-1774705652311.jpg> (referer: None)
2026-03-29 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6328/11446328/docs_service_history-1772963403348.jpg?ixlib=js-3.8.0&auto=format&s=feba23badc46c507c6d090d8e7b718a1> (referer: None)
2026-03-29 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1368&page=38&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_rear_driver-1774721822006.jpg> (referer: None)
2026-03-29 20:07:35 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/6328/11446328/interior_boot-1774698345286.png>.
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabcb810>
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2789601-0a44-5b29-9bf7-2c5b4dac0169/f2789601-0a44-5b29-9bf7-2c5b4dac0169_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6490%252F14166490%252Finstrument_cluster-1774694322561.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6490/14166490/instrument_cluster-1774694322561.jpg saved to cache
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2789601-0a44-5b29-9bf7-2c5b4dac0169
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f927d9d0>
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8360%252F20488360%252Fexterior_front_passenger-1774705652311.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8360/20488360/exterior_front_passenger-1774705652311.jpg saved to cache
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a91e511d-5852-5351-bcf2-cfd929ade4b7
2026-03-29 20:07:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8253610>
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e2f594-0071-53b5-80f7-4df79a5a4171/c3e2f594-0071-53b5-80f7-4df79a5a4171_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6328%252F11446328%252Fdocs_service_history-1772963403348.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfeba23badc46c507c6d090d8e7b718a1') HTTP/1.1" 204 0
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6328/11446328/docs_service_history-1772963403348.jpg?ixlib=js-3.8.0&auto=format&s=feba23badc46c507c6d090d8e7b718a1 saved to cache
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3e2f594-0071-53b5-80f7-4df79a5a4171
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20171913
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720171913%27 HTTP/1.1" 200 None
2026-03-29 20:07:35 [motorway.uk] INFO: Scrape type for 20171913: 1
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85f3090>
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2621%252F17362621%252Fexterior_rear_driver-1774721822006.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_rear_driver-1774721822006.jpg saved to cache
2026-03-29 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81564603-3cfb-51db-b531-bf5ba9bc5adb
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20353654
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 19798610
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20208609
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20403793
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 18826766
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 15306667
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715306667%27 HTTP/1.1" 200 None
2026-03-29 20:07:35 [motorway.uk] INFO: Scrape type for 15306667: 1
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 18106884
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20481936
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 17411348
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20387296
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720387296%27 HTTP/1.1" 200 None
2026-03-29 20:07:35 [motorway.uk] INFO: Scrape type for 20387296: 1
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20352821
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20440778
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20434747
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20475784
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 13472860
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 19800646
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20486113
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 9188015
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 19873205
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 19831066
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 18930020
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718930020%27 HTTP/1.1" 200 None
2026-03-29 20:07:35 [motorway.uk] INFO: Scrape type for 18930020: 1
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 19619181
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20103257
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20453524
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 4610978
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20397419
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720397419%27 HTTP/1.1" 200 None
2026-03-29 20:07:35 [motorway.uk] INFO: Scrape type for 20397419: 1
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 17989138
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20389959
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720389959%27 HTTP/1.1" 200 None
2026-03-29 20:07:35 [motorway.uk] INFO: Scrape type for 20389959: 1
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20460435
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720460435%27 HTTP/1.1" 200 None
2026-03-29 20:07:35 [motorway.uk] INFO: Scrape type for 20460435: 1
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20487343
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487343%27 HTTP/1.1" 200 None
2026-03-29 20:07:35 [motorway.uk] INFO: Scrape type for 20487343: 1
2026-03-29 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8360/20488360/exterior_rear_driver-1774705673123.jpg> (referer: None)
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 19895213
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 20432299
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 19974522
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 18180278
2026-03-29 20:07:35 [motorway.uk] INFO: Found listing with ID: 19957959
2026-03-29 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_front_driver-1774721808419.jpg> (referer: None)
2026-03-29 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5403/20395403/exterior_rear_driver-1774706055085.jpg> (referer: None)
2026-03-29 20:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6328/11446328/interior_boot-1774698345286.png> (referer: None)
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8450b10>
2026-03-29 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8360%252F20488360%252Fexterior_rear_driver-1774705673123.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8360/20488360/exterior_rear_driver-1774705673123.jpg saved to cache
2026-03-29 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a91e511d-5852-5351-bcf2-cfd929ade4b7
2026-03-29 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5403/20395403/exterior_front_passenger-1774706038256.jpg> (referer: None)
2026-03-29 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6490/14166490/interior_dashboard-1774607989296.jpg> (referer: None)
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8253bd0>
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2621%252F17362621%252Fexterior_front_driver-1774721808419.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_front_driver-1774721808419.jpg saved to cache
2026-03-29 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81564603-3cfb-51db-b531-bf5ba9bc5adb
2026-03-29 20:07:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81564603-3cfb-51db-b531-bf5ba9bc5adb, skipping ID generation
2026-03-29 20:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81564603-3cfb-51db-b531-bf5ba9bc5adb with scrape type 1
2026-03-29 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81564603-3cfb-51db-b531-bf5ba9bc5adb sending to next pipeline
2026-03-29 20:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 81564603-3cfb-51db-b531-bf5ba9bc5adb, identifier: 17362621
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f51ad0>
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5403%252F20395403%252Fexterior_rear_driver-1774706055085.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5403/20395403/exterior_rear_driver-1774706055085.jpg saved to cache
2026-03-29 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24ce5086-c3ae-59e8-8d18-cb827b304b65
2026-03-29 20:07:36 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:07:36 [PIL.PngImagePlugin] DEBUG: STREAM b'iCCP' 41 355
2026-03-29 20:07:36 [PIL.PngImagePlugin] DEBUG: iCCP profile name b'kCGColorSpaceDisplayP3'
2026-03-29 20:07:36 [PIL.PngImagePlugin] DEBUG: Compression method 0
2026-03-29 20:07:36 [PIL.PngImagePlugin] DEBUG: STREAM b'cICP' 408 4
2026-03-29 20:07:36 [PIL.PngImagePlugin] DEBUG: b'cICP' 408 4 (unknown)
2026-03-29 20:07:36 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 424 120
2026-03-29 20:07:36 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 556 9
2026-03-29 20:07:36 [PIL.PngImagePlugin] DEBUG: STREAM b'iDOT' 577 28
2026-03-29 20:07:36 [PIL.PngImagePlugin] DEBUG: b'iDOT' 577 28 (unknown)
2026-03-29 20:07:36 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 617 16384
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9541d90>
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e2f594-0071-53b5-80f7-4df79a5a4171/c3e2f594-0071-53b5-80f7-4df79a5a4171_image_8.png HTTP/1.1" 201 0
2026-03-29 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6328%252F11446328%252Finterior_boot-1774698345286.png') HTTP/1.1" 204 0
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6328/11446328/interior_boot-1774698345286.png saved to cache
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3e2f594-0071-53b5-80f7-4df79a5a4171
2026-03-29 20:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 81564603-3cfb-51db-b531-bf5ba9bc5adb with identifier: 17362621
2026-03-29 20:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 81564603-3cfb-51db-b531-bf5ba9bc5adb with identifier: 17362621
2026-03-29 20:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 81564603-3cfb-51db-b531-bf5ba9bc5adb with identifier: 17362621 to the API
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_front_driver-1774721808419.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '81564603-3cfb-51db-b531-bf5ba9bc5adb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK22 VCX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17362621',
'listing': 'auction',
'location': 'Plymouth Plymouth',
'make': 'Volkswagen',
'model': 'Other Volkswagen',
'odometer': 18320,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1940058,
'Height': 2765,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_front_driver-1774721808419.jpg',
'Width': 3687},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1285606,
'Height': 2174,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_rear_driver-1774721822006.jpg',
'Width': 2898},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1955612,
'Height': 2745,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_front_passenger-1774721851154.jpg',
'Width': 3660},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1571056,
'Height': 2540,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2621/17362621/exterior_rear_passenger-1774721832336.jpg',
'Width': 3387},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3941572,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2621/17362621/interior_front_seats-1774722092515.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3699178,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2621/17362621/interior_rear_seats-1774722106390.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3648834,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2621/17362621/interior_dashboard-1774722131743.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2493297,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2621/17362621/instrument_cluster-1774722181157.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3031770,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2621/17362621/interior_boot-1774722134560.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81564603-3cfb-51db-b531-bf5ba9bc5adb/81564603-3cfb-51db-b531-bf5ba9bc5adb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7306848,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2621/17362621/docs_service_history-1774722366703.jpg?ixlib=js-3.8.0&auto=format&s=ff4e75e1df5f91a1b18ebe1064e1f296',
'Width': 4032}],
'price': 14136,
'price_includes_vat': False,
'registration_date': '2022-05-06',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Taigo Life TSI S-A',
'transmission': 'automatic',
'trim': 'Taigo Life TSI S-A',
'vin': 'WVGZZZCSZNY015665',
'year': 2022}
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717362621%27 HTTP/1.1" 200 None
2026-03-29 20:07:37 [motorway.uk] INFO: Saving data for 17362621: {'created_time': 1774814857.410299, 'last_price_update_time': 1774814857.410311, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17362621') HTTP/1.1" 204 0
2026-03-29 20:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17898601.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8977650>
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5403%252F20395403%252Fexterior_front_passenger-1774706038256.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5403/20395403/exterior_front_passenger-1774706038256.jpg saved to cache
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24ce5086-c3ae-59e8-8d18-cb827b304b65
2026-03-29 20:07:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24ce5086-c3ae-59e8-8d18-cb827b304b65, skipping ID generation
2026-03-29 20:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24ce5086-c3ae-59e8-8d18-cb827b304b65 with scrape type 1
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24ce5086-c3ae-59e8-8d18-cb827b304b65 sending to next pipeline
2026-03-29 20:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 24ce5086-c3ae-59e8-8d18-cb827b304b65, identifier: 20395403
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabcaf50>
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2789601-0a44-5b29-9bf7-2c5b4dac0169/f2789601-0a44-5b29-9bf7-2c5b4dac0169_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6490%252F14166490%252Finterior_dashboard-1774607989296.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6490/14166490/interior_dashboard-1774607989296.jpg saved to cache
2026-03-29 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2789601-0a44-5b29-9bf7-2c5b4dac0169
2026-03-29 20:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 24ce5086-c3ae-59e8-8d18-cb827b304b65 with identifier: 20395403
2026-03-29 20:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 24ce5086-c3ae-59e8-8d18-cb827b304b65 with identifier: 20395403
2026-03-29 20:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 24ce5086-c3ae-59e8-8d18-cb827b304b65 with identifier: 20395403 to the API
2026-03-29 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/5403/20395403/exterior_front_passenger-1774706038256.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '24ce5086-c3ae-59e8-8d18-cb827b304b65',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LC64 FAA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20395403',
'listing': 'auction',
'location': 'Greater London Croydon',
'make': 'Nissan',
'model': 'Juke',
'odometer': 22710,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2055482,
'Height': 2616,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5403/20395403/exterior_front_driver-1774697818671.jpg',
'Width': 3488},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2802623,
'Height': 2730,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5403/20395403/exterior_rear_driver-1774706055085.jpg',
'Width': 3640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2806315,
'Height': 2819,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5403/20395403/exterior_front_passenger-1774706038256.jpg',
'Width': 3759},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1864965,
'Height': 2646,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5403/20395403/exterior_rear_passenger-1774697817700.jpg',
'Width': 3528},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2467087,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5403/20395403/interior_front_seats-1774698727189.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2268054,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5403/20395403/interior_rear_seats-1774698664763.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2670863,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5403/20395403/interior_dashboard-1774706015817.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1724404,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5403/20395403/instrument_cluster-1774698533488.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2694183,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5403/20395403/interior_boot-1774705749575.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ce5086-c3ae-59e8-8d18-cb827b304b65/24ce5086-c3ae-59e8-8d18-cb827b304b65_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 681357,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5403/20395403/docs_service_history-1774701135237.jpg?ixlib=js-3.8.0&auto=format&s=c7b54b42eb8f04acfbca7880f6379fe8',
'Width': 2880}],
'price': 7145,
'price_includes_vat': False,
'registration_date': '2014-12-22',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke Tekna CVT',
'transmission': 'automatic',
'trim': 'Tekna CVT',
'vin': 'SJNFBAF15U7072625',
'year': 2014}
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720395403%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [motorway.uk] INFO: Saving data for 20395403: {'created_time': 1774814858.259513, 'last_price_update_time': 1774814858.259525, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20395403') HTTP/1.1" 204 0
2026-03-29 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9530683.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17064602.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20473269.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be9b522c-6e91-52c4-8152-a04a0b0d034a with identifier: 17898601
2026-03-29 20:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be9b522c-6e91-52c4-8152-a04a0b0d034a with scrape type 1
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be9b522c-6e91-52c4-8152-a04a0b0d034a
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8601%252F17898601%252Fexterior_front_driver-1771757107041.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8601/17898601/exterior_front_driver-1771757107041.jpeg not downloaded yet
2026-03-29 20:07:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8601%252F17898601%252Fexterior_rear_driver-1771757145625.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8601/17898601/exterior_rear_driver-1771757145625.jpeg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8601%252F17898601%252Fexterior_front_passenger-1771757113380.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8601/17898601/exterior_front_passenger-1771757113380.jpeg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8601%252F17898601%252Fexterior_rear_passenger-1771757132778.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8601/17898601/exterior_rear_passenger-1771757132778.jpeg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8601%252F17898601%252Finterior_front_seats-1771757172418.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8601/17898601/interior_front_seats-1771757172418.jpeg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8601%252F17898601%252Finterior_rear_seats-1771757269528.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8601/17898601/interior_rear_seats-1771757269528.jpeg not downloaded yet
2026-03-29 20:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0ee90e8-1369-5d44-a413-a1283248c0e2 with identifier: 9530683
2026-03-29 20:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0ee90e8-1369-5d44-a413-a1283248c0e2 with scrape type 1
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0ee90e8-1369-5d44-a413-a1283248c0e2
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0683%252F9530683%252Fexterior_front_driver-1774529450210.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0683/9530683/exterior_front_driver-1774529450210.jpeg not downloaded yet
2026-03-29 20:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e593c016-dfff-5800-ab51-95189876095c with identifier: 17064602
2026-03-29 20:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e593c016-dfff-5800-ab51-95189876095c with scrape type 1
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e593c016-dfff-5800-ab51-95189876095c
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4602%252F17064602%252Fexterior_front_driver-1774697968904.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4602/17064602/exterior_front_driver-1774697968904.jpg not downloaded yet
2026-03-29 20:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c6c5eea-d88c-548d-a2a2-5dc6e9183f4e with identifier: 20473269
2026-03-29 20:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c6c5eea-d88c-548d-a2a2-5dc6e9183f4e with scrape type 1
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c6c5eea-d88c-548d-a2a2-5dc6e9183f4e
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3269%252F20473269%252Fexterior_front_driver-1774620931722.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3269/20473269/exterior_front_driver-1774620931722.jpg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8601%252F17898601%252Finterior_dashboard-1771757343627.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8601/17898601/interior_dashboard-1771757343627.jpeg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0683%252F9530683%252Fexterior_rear_driver-1774529487060.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0683/9530683/exterior_rear_driver-1774529487060.jpeg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4602%252F17064602%252Fexterior_rear_driver-1774697978906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4602/17064602/exterior_rear_driver-1774697978906.jpg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3269%252F20473269%252Fexterior_rear_driver-1774620933105.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3269/20473269/exterior_rear_driver-1774620933105.jpg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8601%252F17898601%252Finterior_boot-1771757325183.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8601/17898601/interior_boot-1771757325183.jpeg not downloaded yet
2026-03-29 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20474485.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0683%252F9530683%252Fexterior_front_passenger-1774529464095.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0683/9530683/exterior_front_passenger-1774529464095.jpeg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4602%252F17064602%252Fexterior_front_passenger-1774699374387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4602/17064602/exterior_front_passenger-1774699374387.jpg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3269%252F20473269%252Fexterior_front_passenger-1774620935299.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3269/20473269/exterior_front_passenger-1774620935299.jpg not downloaded yet
2026-03-29 20:07:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19609067.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8601%252F17898601%252Fdocs_service_history-1774695120945.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D26234b005807855cb35f8b6b73962b70%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8601/17898601/docs_service_history-1774695120945.jpeg?ixlib=js-3.8.0&auto=format&s=26234b005807855cb35f8b6b73962b70 not downloaded yet
2026-03-29 20:07:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0683%252F9530683%252Fexterior_rear_passenger-1774529475696.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0683/9530683/exterior_rear_passenger-1774529475696.jpeg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4602%252F17064602%252Fexterior_rear_passenger-1774699547414.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4602/17064602/exterior_rear_passenger-1774699547414.jpg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3269%252F20473269%252Fexterior_rear_passenger-1774620935363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3269/20473269/exterior_rear_passenger-1774620935363.jpg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8601%252F17898601%252Fdocs_service_history-1774695126476.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De32a9379bb374fa73e706458863ac26f%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8601/17898601/docs_service_history-1774695126476.jpeg?ixlib=js-3.8.0&auto=format&s=e32a9379bb374fa73e706458863ac26f not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0683%252F9530683%252Finterior_front_seats-1774529565315.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0683/9530683/interior_front_seats-1774529565315.jpeg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4602%252F17064602%252Finterior_front_seats-1774698409676.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4602/17064602/interior_front_seats-1774698409676.jpg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3269%252F20473269%252Finterior_front_seats-1774621213248.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3269/20473269/interior_front_seats-1774621213248.jpg not downloaded yet
2026-03-29 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6328/11446328/instrument_cluster-1772962644915.jpg> (referer: None)
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0683%252F9530683%252Finterior_rear_seats-1774529606995.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0683/9530683/interior_rear_seats-1774529606995.jpeg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4602%252F17064602%252Finterior_rear_seats-1774698427775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4602/17064602/interior_rear_seats-1774698427775.jpg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3269%252F20473269%252Finterior_rear_seats-1774621211479.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3269/20473269/interior_rear_seats-1774621211479.jpg not downloaded yet
2026-03-29 20:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dc8c59c-3467-5a4e-8fcc-1049589942b3 with identifier: 20474485
2026-03-29 20:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dc8c59c-3467-5a4e-8fcc-1049589942b3 with scrape type 1
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6dc8c59c-3467-5a4e-8fcc-1049589942b3
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F20474485%252Fexterior_front_driver-1774707311405.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/20474485/exterior_front_driver-1774707311405.jpg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0683%252F9530683%252Finterior_dashboard-1774529637125.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0683/9530683/interior_dashboard-1774529637125.jpeg not downloaded yet
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4602%252F17064602%252Finterior_dashboard-1774699568613.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4602/17064602/interior_dashboard-1774699568613.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3269%252F20473269%252Finterior_dashboard-1774621239969.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3269/20473269/interior_dashboard-1774621239969.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F20474485%252Fexterior_rear_driver-1774707366042.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/20474485/exterior_rear_driver-1774707366042.jpg not downloaded yet
2026-03-29 20:07:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 462f132d-00b0-5fda-8de3-ae57293b496e with identifier: 19609067
2026-03-29 20:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 462f132d-00b0-5fda-8de3-ae57293b496e with scrape type 1
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 462f132d-00b0-5fda-8de3-ae57293b496e
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9067%252F19609067%252Fexterior_front_driver-1774356699095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9067/19609067/exterior_front_driver-1774356699095.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0683%252F9530683%252Finstrument_cluster-1774529718069.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0683/9530683/instrument_cluster-1774529718069.jpeg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4602%252F17064602%252Finstrument_cluster-1774699583099.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4602/17064602/instrument_cluster-1774699583099.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3269%252F20473269%252Finstrument_cluster-1774688883673.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3269/20473269/instrument_cluster-1774688883673.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F20474485%252Fexterior_front_passenger-1774707449695.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/20474485/exterior_front_passenger-1774707449695.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9067%252F19609067%252Fexterior_rear_driver-1774356738576.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9067/19609067/exterior_rear_driver-1774356738576.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0683%252F9530683%252Finterior_boot-1774529638897.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0683/9530683/interior_boot-1774529638897.jpeg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4602%252F17064602%252Finterior_boot-1774698540421.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4602/17064602/interior_boot-1774698540421.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3269%252F20473269%252Finterior_boot-1774621213869.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3269/20473269/interior_boot-1774621213869.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F20474485%252Fexterior_rear_passenger-1774707419262.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/20474485/exterior_rear_passenger-1774707419262.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9067%252F19609067%252Fexterior_front_passenger-1774358409013.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9067/19609067/exterior_front_passenger-1774358409013.jpg not downloaded yet
2026-03-29 20:07:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9589090>
2026-03-29 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e2f594-0071-53b5-80f7-4df79a5a4171/c3e2f594-0071-53b5-80f7-4df79a5a4171_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6328%252F11446328%252Finstrument_cluster-1772962644915.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6328/11446328/instrument_cluster-1772962644915.jpg saved to cache
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3e2f594-0071-53b5-80f7-4df79a5a4171
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F0683%252F9530683%252F9530683-docs_service_history-default-1729497800104.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0fe8e3f218efd8076eaad388b484ed29%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/0683/9530683/9530683-docs_service_history-default-1729497800104.jpg?ixlib=js-3.8.0&auto=format&s=0fe8e3f218efd8076eaad388b484ed29 not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4602%252F17064602%252Fdocs_service_history-1774699520432.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8bc18cf11b7f6bc470c3ab74c9508470%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4602/17064602/docs_service_history-1774699520432.jpg?ixlib=js-3.8.0&auto=format&s=8bc18cf11b7f6bc470c3ab74c9508470 not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3269%252F20473269%252Fdocs_service_history-1774621311277.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D91640f0380ca0e7888264f9964547c03%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3269/20473269/docs_service_history-1774621311277.jpg?ixlib=js-3.8.0&auto=format&s=91640f0380ca0e7888264f9964547c03 not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4485%252F20474485%252Finterior_front_seats-1774708320141.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4485/20474485/interior_front_seats-1774708320141.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9067%252F19609067%252Fexterior_rear_passenger-1774453057524.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9067/19609067/exterior_rear_passenger-1774453057524.jpg not downloaded yet
2026-03-29 20:07:39 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (11696586) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8601/17898601/interior_boot-1771757325183.jpeg>.
2026-03-29 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11012278.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4485%252F20474485%252Finterior_rear_seats-1774708260594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4485/20474485/interior_rear_seats-1774708260594.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9067%252F19609067%252Finterior_front_seats-1774695851449.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9067/19609067/interior_front_seats-1774695851449.jpg not downloaded yet
2026-03-29 20:07:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F20474485%252Finterior_dashboard-1774708291897.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/20474485/interior_dashboard-1774708291897.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9067%252F19609067%252Finterior_rear_seats-1774358017285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9067/19609067/interior_rear_seats-1774358017285.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F20474485%252Finstrument_cluster-1774708292908.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/20474485/instrument_cluster-1774708292908.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9067%252F19609067%252Finterior_dashboard-1774358116272.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9067/19609067/interior_dashboard-1774358116272.jpg not downloaded yet
2026-03-29 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8360/20488360/20488360-exterior_front_driver-modified-1774715884548.jpeg> (referer: None)
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4485%252F20474485%252Finterior_boot-1774708307349.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4485/20474485/interior_boot-1774708307349.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9067%252F19609067%252Finterior_boot-1774356458428.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9067/19609067/interior_boot-1774356458428.jpg not downloaded yet
2026-03-29 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3269/20473269/exterior_rear_driver-1774620933105.jpg> (referer: None)
2026-03-29 20:07:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e3bd637-ae50-566a-852c-f7d1368fc5a0 with identifier: 11012278
2026-03-29 20:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0 with scrape type 1
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2278%252F11012278%252Fexterior_front_driver-1774699249100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_front_driver-1774699249100.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4485%252F20474485%252Fdocs_service_history-1774708582270.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da25fd08292f534d61941e65449f4771a%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4485/20474485/docs_service_history-1774708582270.jpg?ixlib=js-3.8.0&auto=format&s=a25fd08292f534d61941e65449f4771a not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9067%252F19609067%252Fdamage_scratches-1774697154025.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9067/19609067/damage_scratches-1774697154025.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2278%252F11012278%252Fexterior_rear_driver-1774699300212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_rear_driver-1774699300212.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9067%252F19609067%252Fdamage_scratches-1774697165109.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9067/19609067/damage_scratches-1774697165109.jpg not downloaded yet
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2278%252F11012278%252Fexterior_front_passenger-1774699333787.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_front_passenger-1774699333787.jpg not downloaded yet
2026-03-29 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1404&page=39&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a066d0>
2026-03-29 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8360%252F20488360%252F20488360-exterior_front_driver-modified-1774715884548.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8360/20488360/20488360-exterior_front_driver-modified-1774715884548.jpeg saved to cache
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a91e511d-5852-5351-bcf2-cfd929ade4b7
2026-03-29 20:07:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a91e511d-5852-5351-bcf2-cfd929ade4b7, skipping ID generation
2026-03-29 20:07:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a91e511d-5852-5351-bcf2-cfd929ade4b7 with scrape type 1
2026-03-29 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a91e511d-5852-5351-bcf2-cfd929ade4b7 sending to next pipeline
2026-03-29 20:07:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a91e511d-5852-5351-bcf2-cfd929ade4b7, identifier: 20488360
2026-03-29 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6328/11446328/interior_dashboard-1774699015297.jpg> (referer: None)
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2278%252F11012278%252Fexterior_rear_passenger-1774699315746.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_rear_passenger-1774699315746.jpg not downloaded yet
2026-03-29 20:07:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a91e511d-5852-5351-bcf2-cfd929ade4b7 with identifier: 20488360
2026-03-29 20:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a91e511d-5852-5351-bcf2-cfd929ade4b7 with identifier: 20488360
2026-03-29 20:07:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a91e511d-5852-5351-bcf2-cfd929ade4b7 with identifier: 20488360 to the API
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/8360/20488360/20488360-exterior_front_driver-modified-1774715884548.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a91e511d-5852-5351-bcf2-cfd929ade4b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LJ64 VKW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488360',
'listing': 'auction',
'location': 'West Sussex Chichester',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 43324,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1062311,
'Height': 2103,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8360/20488360/20488360-exterior_front_driver-modified-1774715884548.jpeg',
'Width': 2804},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 849447,
'Height': 2123,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8360/20488360/exterior_rear_driver-1774705673123.jpg',
'Width': 2831},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 700439,
'Height': 2003,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8360/20488360/exterior_front_passenger-1774705652311.jpg',
'Width': 2671},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1008277,
'Height': 2076,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8360/20488360/20488360-exterior_rear_passenger-modified-1774715904636.jpeg',
'Width': 2768},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1427311,
'Height': 3000,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8360/20488360/20488360-interior_front_seats-modified-1774715919819.jpeg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1070892,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/8360/20488360/interior_rear_seats-1774705691272.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1671349,
'Height': 3000,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8360/20488360/interior_dashboard-1774705834322.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1344675,
'Height': 3000,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8360/20488360/instrument_cluster-1774705801465.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1267099,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/8360/20488360/interior_boot-1774705838992.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a91e511d-5852-5351-bcf2-cfd929ade4b7/a91e511d-5852-5351-bcf2-cfd929ade4b7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2576668,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8360/20488360/20488360-docs_service_history-modified-1774716006916.jpeg?ixlib=js-3.8.0&auto=format&s=249bbc83863982e4769bfe0616f2507d',
'Width': 3000}],
'price': 7641,
'price_includes_vat': False,
'registration_date': '2014-09-25',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta ST-3 Turbo',
'transmission': 'manual',
'trim': 'ST-3 Turbo',
'vin': 'WF0CXXGAKCEB71231',
'year': 2014}
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488360%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [motorway.uk] INFO: Saving data for 20488360: {'created_time': 1774814860.51496, 'last_price_update_time': 1774814860.514974, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488360') HTTP/1.1" 204 0
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2278%252F11012278%252Finterior_front_seats-1774700950326.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2278/11012278/interior_front_seats-1774700950326.jpg not downloaded yet
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a06890>
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c6c5eea-d88c-548d-a2a2-5dc6e9183f4e/3c6c5eea-d88c-548d-a2a2-5dc6e9183f4e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3269%252F20473269%252Fexterior_rear_driver-1774620933105.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3269/20473269/exterior_rear_driver-1774620933105.jpg saved to cache
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c6c5eea-d88c-548d-a2a2-5dc6e9183f4e
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20113566
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720113566%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [motorway.uk] INFO: Scrape type for 20113566: 1
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2278%252F11012278%252Finterior_rear_seats-1774700921316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2278/11012278/interior_rear_seats-1774700921316.jpg not downloaded yet
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 16171790
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20376331
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720376331%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [motorway.uk] INFO: Scrape type for 20376331: 1
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88ec250>
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3e2f594-0071-53b5-80f7-4df79a5a4171/c3e2f594-0071-53b5-80f7-4df79a5a4171_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6328%252F11446328%252Finterior_dashboard-1774699015297.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6328/11446328/interior_dashboard-1774699015297.jpg saved to cache
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3e2f594-0071-53b5-80f7-4df79a5a4171
2026-03-29 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9067/19609067/damage_scratches-1774697165109.jpg> (referer: None)
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2278%252F11012278%252Finterior_dashboard-1774702851615.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2278/11012278/interior_dashboard-1774702851615.jpg not downloaded yet
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20386083
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 15325780
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20473412
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473412%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [motorway.uk] INFO: Scrape type for 20473412: 1
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2278%252F11012278%252Finterior_boot-1774700898194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2278/11012278/interior_boot-1774700898194.jpg not downloaded yet
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20404965
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20498910
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20439436
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20476073
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476073%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [motorway.uk] INFO: Scrape type for 20476073: 1
2026-03-29 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20171913.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2278%252F11012278%252Fdocs_service_history-1774702183646.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D23f50d046c202053aba24e53d5be58e8%27 HTTP/1.1" 200 None
2026-03-29 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2278/11012278/docs_service_history-1774702183646.jpg?ixlib=js-3.8.0&auto=format&s=23f50d046c202053aba24e53d5be58e8 not downloaded yet
2026-03-29 20:07:40 [motorway.uk] INFO: Found listing with ID: 20496195
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720496195%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [motorway.uk] INFO: Scrape type for 20496195: 1
2026-03-29 20:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2278%252F11012278%252Fdocs_service_history-1774702209271.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc3a537c7bd15f5b642c42bc68a72a93f%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2278/11012278/docs_service_history-1774702209271.jpg?ixlib=js-3.8.0&auto=format&s=c3a537c7bd15f5b642c42bc68a72a93f not downloaded yet
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20337643
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20098206
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720098206%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [motorway.uk] INFO: Scrape type for 20098206: 2
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8929690>
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_462f132d-00b0-5fda-8de3-ae57293b496e/462f132d-00b0-5fda-8de3-ae57293b496e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9067%252F19609067%252Fdamage_scratches-1774697165109.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9067/19609067/damage_scratches-1774697165109.jpg saved to cache
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 462f132d-00b0-5fda-8de3-ae57293b496e
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20475098
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 16172967
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716172967%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [motorway.uk] INFO: Scrape type for 16172967: 1
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20389959.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b68b803-a153-55b0-a7f6-62ffc5b104b2 with identifier: 20171913
2026-03-29 20:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2 with scrape type 1
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1913%252F20171913%252Fexterior_front_driver-1773741665487.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1913/20171913/exterior_front_driver-1773741665487.jpg not downloaded yet
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 16857916
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716857916%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [motorway.uk] INFO: Scrape type for 16857916: 1
2026-03-29 20:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1913%252F20171913%252Fexterior_rear_driver-1773741660811.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1913/20171913/exterior_rear_driver-1773741660811.jpg not downloaded yet
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487343.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20462733
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20490112
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20402109
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720402109%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [motorway.uk] INFO: Scrape type for 20402109: 1
2026-03-29 20:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1913%252F20171913%252Fexterior_front_passenger-1774546625297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1913/20171913/exterior_front_passenger-1774546625297.jpg not downloaded yet
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20374667
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 19899009
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20432177
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 11842898
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20046055
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20386977
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20277874
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 14979819
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20474482
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20415120
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20214345
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 19182202
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719182202%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [motorway.uk] INFO: Scrape type for 19182202: 1
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1913%252F20171913%252Fexterior_rear_passenger-1773741659487.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1913/20171913/exterior_rear_passenger-1773741659487.jpg not downloaded yet
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20334323
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20417464
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720417464%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [motorway.uk] INFO: Scrape type for 20417464: 1
2026-03-29 20:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a234e4c-57d4-59e1-b39e-eeb4991b4d63 with identifier: 20389959
2026-03-29 20:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63 with scrape type 1
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9959%252F20389959%252Fexterior_front_driver-1774709448325.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_front_driver-1774709448325.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1913%252F20171913%252Finterior_front_seats-1774546607301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1913/20171913/interior_front_seats-1774546607301.jpg not downloaded yet
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 18237118
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 20502332
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720502332%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [motorway.uk] INFO: Scrape type for 20502332: 1
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9959%252F20389959%252Fexterior_rear_driver-1774709468772.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_rear_driver-1774709468772.jpg not downloaded yet
2026-03-29 20:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca with identifier: 20487343
2026-03-29 20:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca with scrape type 1
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7343%252F20487343%252Fexterior_front_driver-1774700739414.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_front_driver-1774700739414.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1913%252F20171913%252Finterior_rear_seats-1773742208325.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1913/20171913/interior_rear_seats-1773742208325.jpg not downloaded yet
2026-03-29 20:07:41 [motorway.uk] INFO: Found listing with ID: 16476900
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9959%252F20389959%252Fexterior_front_passenger-1774709513303.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_front_passenger-1774709513303.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7343%252F20487343%252Fexterior_rear_driver-1774700812719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_rear_driver-1774700812719.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1913%252F20171913%252Finterior_dashboard-1774546882083.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1913/20171913/interior_dashboard-1774546882083.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9959%252F20389959%252Fexterior_rear_passenger-1774709480450.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_rear_passenger-1774709480450.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7343%252F20487343%252Fexterior_front_passenger-1774700786323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_front_passenger-1774700786323.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1913%252F20171913%252Finstrument_cluster-1774546153394.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1913/20171913/instrument_cluster-1774546153394.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9959%252F20389959%252Finterior_front_seats-1774696132328.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9959/20389959/interior_front_seats-1774696132328.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7343%252F20487343%252Fexterior_rear_passenger-1774700833007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_rear_passenger-1774700833007.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1913%252F20171913%252Finterior_boot-1773742197225.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1913/20171913/interior_boot-1773742197225.jpg not downloaded yet
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9067/19609067/exterior_rear_passenger-1774453057524.jpg> (referer: None)
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9959%252F20389959%252Finterior_rear_seats-1774696163946.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9959/20389959/interior_rear_seats-1774696163946.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7343%252F20487343%252Finterior_front_seats-1774701762983.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7343/20487343/interior_front_seats-1774701762983.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1913%252F20171913%252Fwheels_front_driver-1773741740302.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1913/20171913/wheels_front_driver-1773741740302.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9959%252F20389959%252Finterior_dashboard-1774696197835.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9959/20389959/interior_dashboard-1774696197835.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7343%252F20487343%252Finterior_rear_seats-1774701778511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7343/20487343/interior_rear_seats-1774701778511.jpg not downloaded yet
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_rear_passenger-1774699315746.jpg> (referer: None)
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9959%252F20389959%252Finstrument_cluster-1774696217162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9959/20389959/instrument_cluster-1774696217162.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7343%252F20487343%252Finterior_dashboard-1774701808480.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7343/20487343/interior_dashboard-1774701808480.jpg not downloaded yet
2026-03-29 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9067/19609067/interior_dashboard-1774358116272.jpg> (referer: None)
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9959%252F20389959%252Finterior_boot-1774696222949.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9959/20389959/interior_boot-1774696222949.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7343%252F20487343%252Finterior_boot-1774701815916.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7343/20487343/interior_boot-1774701815916.jpg not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9959%252F20389959%252Fdocs_service_history-1774696473767.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6d86debcc6dc45d03ea1270b9cb8f086%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9959/20389959/docs_service_history-1774696473767.jpg?ixlib=js-3.8.0&auto=format&s=6d86debcc6dc45d03ea1270b9cb8f086 not downloaded yet
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7343%252F20487343%252Fdocs_service_history-1774701904021.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2259b625bd12f02672828a8ad97baa91%27 HTTP/1.1" 200 None
2026-03-29 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7343/20487343/docs_service_history-1774701904021.jpg?ixlib=js-3.8.0&auto=format&s=2259b625bd12f02672828a8ad97baa91 not downloaded yet
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93b6d50>
2026-03-29 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_462f132d-00b0-5fda-8de3-ae57293b496e/462f132d-00b0-5fda-8de3-ae57293b496e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9067%252F19609067%252Fexterior_rear_passenger-1774453057524.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9067/19609067/exterior_rear_passenger-1774453057524.jpg saved to cache
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 462f132d-00b0-5fda-8de3-ae57293b496e
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7343%252F20487343%252Fdocs_service_history-1774701905396.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2ab7165c3a2ea425ba39d907b76ade39%27 HTTP/1.1" 200 None
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7343/20487343/docs_service_history-1774701905396.jpg?ixlib=js-3.8.0&auto=format&s=2ab7165c3a2ea425ba39d907b76ade39 not downloaded yet
2026-03-29 20:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4485/20474485/instrument_cluster-1774708292908.jpg> (referer: None)
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb0610>
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2278%252F11012278%252Fexterior_rear_passenger-1774699315746.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_rear_passenger-1774699315746.jpg saved to cache
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f886b8d0>
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_462f132d-00b0-5fda-8de3-ae57293b496e/462f132d-00b0-5fda-8de3-ae57293b496e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9067%252F19609067%252Finterior_dashboard-1774358116272.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9067/19609067/interior_dashboard-1774358116272.jpg saved to cache
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 462f132d-00b0-5fda-8de3-ae57293b496e
2026-03-29 20:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1913/20171913/exterior_rear_driver-1773741660811.jpg> (referer: None)
2026-03-29 20:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20397419.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18930020.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f886a390>
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dc8c59c-3467-5a4e-8fcc-1049589942b3/6dc8c59c-3467-5a4e-8fcc-1049589942b3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F20474485%252Finstrument_cluster-1774708292908.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/20474485/instrument_cluster-1774708292908.jpg saved to cache
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6dc8c59c-3467-5a4e-8fcc-1049589942b3
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa10ad50>
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1913%252F20171913%252Fexterior_rear_driver-1773741660811.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1913/20171913/exterior_rear_driver-1773741660811.jpg saved to cache
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2
2026-03-29 20:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccf606d8-a1e4-57ae-b115-ee124d6077b6 with identifier: 20397419
2026-03-29 20:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccf606d8-a1e4-57ae-b115-ee124d6077b6 with scrape type 1
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ccf606d8-a1e4-57ae-b115-ee124d6077b6
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7419%252F20397419%252Fexterior_front_driver-1774714498884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_front_driver-1774714498884.jpg not downloaded yet
2026-03-29 20:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd87803e-4ff7-5c1b-a2c8-a0f7142779ee with identifier: 18930020
2026-03-29 20:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd87803e-4ff7-5c1b-a2c8-a0f7142779ee with scrape type 1
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd87803e-4ff7-5c1b-a2c8-a0f7142779ee
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0020%252F18930020%252Fexterior_front_driver-1772728970009.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0020/18930020/exterior_front_driver-1772728970009.jpg already downloaded
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0020%252F18930020%252Fexterior_rear_driver-1772874190427.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0020/18930020/exterior_rear_driver-1772874190427.jpg already downloaded
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0020%252F18930020%252Fexterior_front_passenger-1772729048916.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0020/18930020/exterior_front_passenger-1772729048916.jpg already downloaded
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0020%252F18930020%252Fexterior_rear_passenger-1772729015029.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0020/18930020/exterior_rear_passenger-1772729015029.jpg already downloaded
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0020%252F18930020%252Finterior_front_seats-1772874722091.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0020/18930020/interior_front_seats-1772874722091.jpg already downloaded
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0020%252F18930020%252Finterior_rear_seats-1772874709919.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0020/18930020/interior_rear_seats-1772874709919.jpg already downloaded
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0020%252F18930020%252Finterior_dashboard-1772874726115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0020/18930020/interior_dashboard-1772874726115.jpg already downloaded
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0020%252F18930020%252Finstrument_cluster-1772874702091.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0020/18930020/instrument_cluster-1772874702091.jpg already downloaded
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0020%252F18930020%252Finterior_boot-1772803730769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0020/18930020/interior_boot-1772803730769.jpg already downloaded
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0020%252F18930020%252Fdocs_service_history-1772874006505.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0382d5c85544c08adaade190b63a22c0%27 HTTP/1.1" 200 None
2026-03-29 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0020/18930020/docs_service_history-1772874006505.jpg?ixlib=js-3.8.0&auto=format&s=0382d5c85544c08adaade190b63a22c0 already downloaded
2026-03-29 20:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: dd87803e-4ff7-5c1b-a2c8-a0f7142779ee, identifier: 18930020
2026-03-29 20:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: dd87803e-4ff7-5c1b-a2c8-a0f7142779ee with identifier: 18930020
2026-03-29 20:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: dd87803e-4ff7-5c1b-a2c8-a0f7142779ee with identifier: 18930020
2026-03-29 20:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: dd87803e-4ff7-5c1b-a2c8-a0f7142779ee with identifier: 18930020 to the API
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18930020.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'dd87803e-4ff7-5c1b-a2c8-a0f7142779ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'D11 CRU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18930020',
'listing': 'auction',
'location': 'West Midlands Stourbridge',
'make': 'Audi',
'model': 'A3',
'odometer': 49000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/0020/18930020/exterior_front_driver-1772728970009.jpg',
'https://motorway-photos-redacted.imgix.net/0020/18930020/exterior_rear_driver-1772874190427.jpg',
'https://motorway-photos-redacted.imgix.net/0020/18930020/exterior_front_passenger-1772729048916.jpg',
'https://motorway-photos-redacted.imgix.net/0020/18930020/exterior_rear_passenger-1772729015029.jpg',
'https://motorway-photos-modified.imgix.net/0020/18930020/interior_front_seats-1772874722091.jpg',
'https://motorway-photos-modified.imgix.net/0020/18930020/interior_rear_seats-1772874709919.jpg',
'https://motorway-photos-modified.imgix.net/0020/18930020/interior_dashboard-1772874726115.jpg',
'https://motorway-photos-modified.imgix.net/0020/18930020/instrument_cluster-1772874702091.jpg',
'https://motorway-photos.imgix.net/0020/18930020/interior_boot-1772803730769.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/0020/18930020/docs_service_history-1772874006505.jpg?ixlib=js-3.8.0&auto=format&s=0382d5c85544c08adaade190b63a22c0'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd87803e-4ff7-5c1b-a2c8-a0f7142779ee/dd87803e-4ff7-5c1b-a2c8-a0f7142779ee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1424468,
'Height': 2358,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0020/18930020/exterior_front_driver-1772728970009.jpg',
'Width': 3144},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd87803e-4ff7-5c1b-a2c8-a0f7142779ee/dd87803e-4ff7-5c1b-a2c8-a0f7142779ee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1887259,
'Height': 2885,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0020/18930020/exterior_rear_driver-1772874190427.jpg',
'Width': 3846},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd87803e-4ff7-5c1b-a2c8-a0f7142779ee/dd87803e-4ff7-5c1b-a2c8-a0f7142779ee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1497529,
'Height': 2976,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0020/18930020/exterior_front_passenger-1772729048916.jpg',
'Width': 3968},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd87803e-4ff7-5c1b-a2c8-a0f7142779ee/dd87803e-4ff7-5c1b-a2c8-a0f7142779ee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1684571,
'Height': 2832,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0020/18930020/exterior_rear_passenger-1772729015029.jpg',
'Width': 3776},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd87803e-4ff7-5c1b-a2c8-a0f7142779ee/dd87803e-4ff7-5c1b-a2c8-a0f7142779ee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1662242,
'Height': 2156,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0020/18930020/interior_front_seats-1772874722091.jpg',
'Width': 2875},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd87803e-4ff7-5c1b-a2c8-a0f7142779ee/dd87803e-4ff7-5c1b-a2c8-a0f7142779ee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2105913,
'Height': 2347,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0020/18930020/interior_rear_seats-1772874709919.jpg',
'Width': 3130},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd87803e-4ff7-5c1b-a2c8-a0f7142779ee/dd87803e-4ff7-5c1b-a2c8-a0f7142779ee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3136190,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0020/18930020/interior_dashboard-1772874726115.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd87803e-4ff7-5c1b-a2c8-a0f7142779ee/dd87803e-4ff7-5c1b-a2c8-a0f7142779ee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403715,
'Height': 1050,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0020/18930020/instrument_cluster-1772874702091.jpg',
'Width': 1400},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd87803e-4ff7-5c1b-a2c8-a0f7142779ee/dd87803e-4ff7-5c1b-a2c8-a0f7142779ee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3613584,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0020/18930020/interior_boot-1772803730769.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd87803e-4ff7-5c1b-a2c8-a0f7142779ee/dd87803e-4ff7-5c1b-a2c8-a0f7142779ee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3923500,
'Height': 4660,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0020/18930020/docs_service_history-1772874006505.jpg?ixlib=js-3.8.0&auto=format&s=0382d5c85544c08adaade190b63a22c0',
'Width': 3367}],
'price': 9674,
'price_includes_vat': False,
'registration_date': '2016-04-15',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 Sport NAV TDI S-A',
'transmission': 'automatic',
'trim': 'Sport NAV TDI S-A',
'vin': 'WAUZZZ8V9GA105039',
'year': 2016}
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718930020%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [motorway.uk] INFO: Saving data for 18930020: {'created_time': 1774814863.416028, 'last_price_update_time': 1774814863.416039, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18930020') HTTP/1.1" 204 0
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7419%252F20397419%252Fexterior_rear_driver-1774714549354.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_rear_driver-1774714549354.jpg not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7419%252F20397419%252Fexterior_front_passenger-1774714602375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_front_passenger-1774714602375.jpg not downloaded yet
2026-03-29 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20387296.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7419%252F20397419%252Fexterior_rear_passenger-1774714569028.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_rear_passenger-1774714569028.jpg not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7419%252F20397419%252Finterior_front_seats-1774715084896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7419/20397419/interior_front_seats-1774715084896.jpg not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7419%252F20397419%252Finterior_rear_seats-1774715301487.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7419/20397419/interior_rear_seats-1774715301487.jpg not downloaded yet
2026-03-29 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9959/20389959/docs_service_history-1774696473767.jpg?ixlib=js-3.8.0&auto=format&s=6d86debcc6dc45d03ea1270b9cb8f086> (referer: None)
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7419%252F20397419%252F20397419-interior_dashboard-modified-1774717413676.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7419/20397419/20397419-interior_dashboard-modified-1774717413676.jpeg not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7419%252F20397419%252Finstrument_cluster-1774715175781.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7419/20397419/instrument_cluster-1774715175781.jpg not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7419%252F20397419%252Finterior_boot-1774715272599.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7419/20397419/interior_boot-1774715272599.jpg not downloaded yet
2026-03-29 20:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69e19fdd-f519-51df-bb4c-18c5b2ea848e with identifier: 20387296
2026-03-29 20:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e with scrape type 1
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7296%252F20387296%252Fexterior_front_driver-1774716704202.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7296/20387296/exterior_front_driver-1774716704202.jpg not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7419%252F20397419%252Fdocs_service_history-1774715852644.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3e066ab5c0628935026d323eb2481d93%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7419/20397419/docs_service_history-1774715852644.jpg?ixlib=js-3.8.0&auto=format&s=3e066ab5c0628935026d323eb2481d93 not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7296%252F20387296%252Fexterior_rear_driver-1774716733967.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7296/20387296/exterior_rear_driver-1774716733967.jpg not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7296%252F20387296%252Fexterior_front_passenger-1774716821236.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7296/20387296/exterior_front_passenger-1774716821236.jpg not downloaded yet
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f919a190>
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9959%252F20389959%252Fdocs_service_history-1774696473767.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6d86debcc6dc45d03ea1270b9cb8f086') HTTP/1.1" 204 0
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9959/20389959/docs_service_history-1774696473767.jpg?ixlib=js-3.8.0&auto=format&s=6d86debcc6dc45d03ea1270b9cb8f086 saved to cache
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63
2026-03-29 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4485/20474485/interior_front_seats-1774708320141.jpg> (referer: None)
2026-03-29 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20376331.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7343/20487343/docs_service_history-1774701904021.jpg?ixlib=js-3.8.0&auto=format&s=2259b625bd12f02672828a8ad97baa91> (referer: None)
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7296%252F20387296%252Fexterior_rear_passenger-1774783535249.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7296/20387296/exterior_rear_passenger-1774783535249.jpg not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7296%252F20387296%252Finterior_front_seats-1774717539043.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7296/20387296/interior_front_seats-1774717539043.jpg not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7296%252F20387296%252Finterior_rear_seats-1774717561792.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7296/20387296/interior_rear_seats-1774717561792.jpg not downloaded yet
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7296%252F20387296%252Finterior_dashboard-1774783522181.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7296/20387296/interior_dashboard-1774783522181.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7296%252F20387296%252Finstrument_cluster-1774783506894.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7296/20387296/instrument_cluster-1774783506894.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7296%252F20387296%252Finterior_boot-1774717617709.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7296/20387296/interior_boot-1774717617709.jpg not downloaded yet
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb2fd0>
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dc8c59c-3467-5a4e-8fcc-1049589942b3/6dc8c59c-3467-5a4e-8fcc-1049589942b3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4485%252F20474485%252Finterior_front_seats-1774708320141.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4485/20474485/interior_front_seats-1774708320141.jpg saved to cache
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6dc8c59c-3467-5a4e-8fcc-1049589942b3
2026-03-29 20:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f539b6c-7b8b-5d31-9a32-8e9ad9678114 with identifier: 20376331
2026-03-29 20:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114 with scrape type 1
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6331%252F20376331%252Fexterior_front_driver-1774099450255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_front_driver-1774099450255.jpg not downloaded yet
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f894e0d0>
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7343%252F20487343%252Fdocs_service_history-1774701904021.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2259b625bd12f02672828a8ad97baa91') HTTP/1.1" 204 0
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7343/20487343/docs_service_history-1774701904021.jpg?ixlib=js-3.8.0&auto=format&s=2259b625bd12f02672828a8ad97baa91 saved to cache
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7296%252F20387296%252Fwheels_front_driver-1774716857504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7296/20387296/wheels_front_driver-1774716857504.jpg not downloaded yet
2026-03-29 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7343/20487343/interior_dashboard-1774701808480.jpg> (referer: None)
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6331%252F20376331%252Fexterior_rear_driver-1774099484997.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_rear_driver-1774099484997.jpg not downloaded yet
2026-03-29 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7343/20487343/docs_service_history-1774701905396.jpg?ixlib=js-3.8.0&auto=format&s=2ab7165c3a2ea425ba39d907b76ade39> (referer: None)
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6331%252F20376331%252Fexterior_front_passenger-1774099496948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_front_passenger-1774099496948.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6331%252F20376331%252Fexterior_rear_passenger-1774099486536.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_rear_passenger-1774099486536.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6331%252F20376331%252Finterior_front_seats-1774106722981.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6331/20376331/interior_front_seats-1774106722981.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6331%252F20376331%252Finterior_rear_seats-1774106760516.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6331/20376331/interior_rear_seats-1774106760516.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6331%252F20376331%252Finterior_dashboard-1774106787762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6331/20376331/interior_dashboard-1774106787762.jpg not downloaded yet
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f902d9d0>
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7343%252F20487343%252Finterior_dashboard-1774701808480.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7343/20487343/interior_dashboard-1774701808480.jpg saved to cache
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6331%252F20376331%252Finstrument_cluster-1774106819335.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6331/20376331/instrument_cluster-1774106819335.jpg not downloaded yet
2026-03-29 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20476073.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fd7ad0>
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7343%252F20487343%252Fdocs_service_history-1774701905396.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2ab7165c3a2ea425ba39d907b76ade39') HTTP/1.1" 204 0
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7343/20487343/docs_service_history-1774701905396.jpg?ixlib=js-3.8.0&auto=format&s=2ab7165c3a2ea425ba39d907b76ade39 saved to cache
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6331%252F20376331%252Finterior_boot-1774106826304.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6331/20376331/interior_boot-1774106826304.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6331%252F20376331%252Fdocs_service_history-1774712190845.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D378c95acd0dd93705fac3d64e2760fe0%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6331/20376331/docs_service_history-1774712190845.jpg?ixlib=js-3.8.0&auto=format&s=378c95acd0dd93705fac3d64e2760fe0 not downloaded yet
2026-03-29 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7343/20487343/interior_boot-1774701815916.jpg> (referer: None)
2026-03-29 20:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c345d700-8838-5625-aa00-e7dccf75a389 with identifier: 20476073
2026-03-29 20:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c345d700-8838-5625-aa00-e7dccf75a389 with scrape type 1
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c345d700-8838-5625-aa00-e7dccf75a389
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6073%252F20476073%252Fexterior_front_driver-1774704753556.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_front_driver-1774704753556.jpg not downloaded yet
2026-03-29 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19097600.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6073%252F20476073%252Fexterior_rear_driver-1774704770562.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_rear_driver-1774704770562.jpg not downloaded yet
2026-03-29 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_rear_driver-1774714549354.jpg> (referer: None)
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6073%252F20476073%252Fexterior_front_passenger-1774704798312.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_front_passenger-1774704798312.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6073%252F20476073%252Fexterior_rear_passenger-1774704783172.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_rear_passenger-1774704783172.jpg not downloaded yet
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6073%252F20476073%252Finterior_front_seats-1774718903817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6073/20476073/interior_front_seats-1774718903817.jpg not downloaded yet
2026-03-29 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_front_driver-1774099450255.jpg> (referer: None)
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb3510>
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7343%252F20487343%252Finterior_boot-1774701815916.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7343/20487343/interior_boot-1774701815916.jpg saved to cache
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6073%252F20476073%252Finterior_rear_seats-1774719313737.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6073/20476073/interior_rear_seats-1774719313737.jpg not downloaded yet
2026-03-29 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_rear_driver-1774099484997.jpg> (referer: None)
2026-03-29 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9959/20389959/interior_boot-1774696222949.jpg> (referer: None)
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6073%252F20476073%252Finterior_dashboard-1774719366271.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6073/20476073/interior_dashboard-1774719366271.jpg not downloaded yet
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6073%252F20476073%252Finstrument_cluster-1774718995322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6073/20476073/instrument_cluster-1774718995322.jpg not downloaded yet
2026-03-29 20:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95c0690c-af8f-5b09-8b20-56381a7b37ac with identifier: 19097600
2026-03-29 20:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95c0690c-af8f-5b09-8b20-56381a7b37ac with scrape type 1
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 95c0690c-af8f-5b09-8b20-56381a7b37ac
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7600%252F19097600%252Fexterior_front_driver-1767440424891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_front_driver-1767440424891.jpg not downloaded yet
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f924c490>
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7419%252F20397419%252Fexterior_rear_driver-1774714549354.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_rear_driver-1774714549354.jpg saved to cache
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ccf606d8-a1e4-57ae-b115-ee124d6077b6
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85719d0>
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6331%252F20376331%252Fexterior_front_driver-1774099450255.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_front_driver-1774099450255.jpg saved to cache
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6073%252F20476073%252Finterior_boot-1774719621961.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6073/20476073/interior_boot-1774719621961.jpg not downloaded yet
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7600%252F19097600%252Fexterior_rear_driver-1767619876505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_rear_driver-1767619876505.jpg not downloaded yet
2026-03-29 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7296/20387296/wheels_front_driver-1774716857504.jpg> (referer: None)
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6073%252F20476073%252Fdocs_service_history-1774720191198.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59e6add59b4f75cd4943ecae14fca9a8%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6073/20476073/docs_service_history-1774720191198.jpg?ixlib=js-3.8.0&auto=format&s=59e6add59b4f75cd4943ecae14fca9a8 not downloaded yet
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7600%252F19097600%252Fexterior_front_passenger-1767440421904.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_front_passenger-1767440421904.jpg not downloaded yet
2026-03-29 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16172967.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f821e950>
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6331%252F20376331%252Fexterior_rear_driver-1774099484997.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_rear_driver-1774099484997.jpg saved to cache
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114
2026-03-29 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9018b10>
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9959%252F20389959%252Finterior_boot-1774696222949.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9959/20389959/interior_boot-1774696222949.jpg saved to cache
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63
2026-03-29 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6331/20376331/docs_service_history-1774712190845.jpg?ixlib=js-3.8.0&auto=format&s=378c95acd0dd93705fac3d64e2760fe0> (referer: None)
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7600%252F19097600%252Fexterior_rear_passenger-1767619856213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_rear_passenger-1767619856213.jpg not downloaded yet
2026-03-29 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15306667.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_front_passenger-1774099496948.jpg> (referer: None)
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7600%252F19097600%252Finterior_front_seats-1767619825852.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7600/19097600/interior_front_seats-1767619825852.jpg not downloaded yet
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8aa52d0>
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7296%252F20387296%252Fwheels_front_driver-1774716857504.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7296/20387296/wheels_front_driver-1774716857504.jpg saved to cache
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e
2026-03-29 20:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c34f13f-85a0-5180-b1f8-903901075d06 with identifier: 16172967
2026-03-29 20:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c34f13f-85a0-5180-b1f8-903901075d06 with scrape type 1
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c34f13f-85a0-5180-b1f8-903901075d06
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2967%252F16172967%252F16172967-exterior_front_driver-default-1774714287356.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_front_driver-default-1774714287356.jpg not downloaded yet
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7600%252F19097600%252Finterior_rear_seats-1767619801100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7600/19097600/interior_rear_seats-1767619801100.jpg not downloaded yet
2026-03-29 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7419/20397419/interior_front_seats-1774715084896.jpg> (referer: None)
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2967%252F16172967%252F16172967-exterior_rear_driver-default-1774714330323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_rear_driver-default-1774714330323.jpg not downloaded yet
2026-03-29 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7600%252F19097600%252Finterior_dashboard-1767619790959.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7600/19097600/interior_dashboard-1767619790959.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2967%252F16172967%252F16172967-exterior_front_passenger-default-1774714299839.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_front_passenger-default-1774714299839.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7600%252F19097600%252Finterior_boot-1767440982896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7600/19097600/interior_boot-1767440982896.jpg not downloaded yet
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab60390>
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6331%252F20376331%252Fdocs_service_history-1774712190845.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D378c95acd0dd93705fac3d64e2760fe0') HTTP/1.1" 204 0
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6331/20376331/docs_service_history-1774712190845.jpg?ixlib=js-3.8.0&auto=format&s=378c95acd0dd93705fac3d64e2760fe0 saved to cache
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114
2026-03-29 20:07:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 294cc826-79c1-588a-9ec7-44a4a07dc5ce with identifier: 15306667
2026-03-29 20:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce with scrape type 1
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6667%252F15306667%252Fexterior_front_driver-1774696940905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_front_driver-1774696940905.jpg not downloaded yet
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8635a10>
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6331%252F20376331%252Fexterior_front_passenger-1774099496948.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_front_passenger-1774099496948.jpg saved to cache
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2967%252F16172967%252F16172967-exterior_rear_passenger-default-1774714323866.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_rear_passenger-default-1774714323866.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F7600%252F19097600%252Fdocs_service_history-1767441277498.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db94c121413eb5fd95e1ff73b39c46244%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/7600/19097600/docs_service_history-1767441277498.jpg?ixlib=js-3.8.0&auto=format&s=b94c121413eb5fd95e1ff73b39c46244 not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6667%252F15306667%252Fexterior_rear_driver-1774696920990.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_rear_driver-1774696920990.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2967%252F16172967%252F16172967-interior_front_seats-default-1774714293089.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2967/16172967/16172967-interior_front_seats-default-1774714293089.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7600%252F19097600%252Fdamage_scratches-1767440488536.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7600/19097600/damage_scratches-1767440488536.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6667%252F15306667%252Fexterior_front_passenger-1774696942395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_front_passenger-1774696942395.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2967%252F16172967%252F16172967-interior_rear_seats-default-1774714294541.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2967/16172967/16172967-interior_rear_seats-default-1774714294541.jpg not downloaded yet
2026-03-29 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f920b810>
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7419%252F20397419%252Finterior_front_seats-1774715084896.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7419/20397419/interior_front_seats-1774715084896.jpg saved to cache
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ccf606d8-a1e4-57ae-b115-ee124d6077b6
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6667%252F15306667%252Fexterior_rear_passenger-1774696943520.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_rear_passenger-1774696943520.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2967%252F16172967%252F16172967-interior_dashboard-default-1774714297522.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-interior_dashboard-default-1774714297522.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6667%252F15306667%252Finterior_front_seats-1774697216719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6667/15306667/interior_front_seats-1774697216719.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2967%252F16172967%252F16172967-interior_boot-default-1774714297048.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2967/16172967/16172967-interior_boot-default-1774714297048.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6667%252F15306667%252Finterior_rear_seats-1774697218005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6667/15306667/interior_rear_seats-1774697218005.jpg not downloaded yet
2026-03-29 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_front_driver-1774704753556.jpg> (referer: None)
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F2967%252F16172967%252Fdocs_service_history-1749839948760.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D82d319e1a9188afaa621d5608dfdf9b8%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/2967/16172967/docs_service_history-1749839948760.jpeg?ixlib=js-3.8.0&auto=format&s=82d319e1a9188afaa621d5608dfdf9b8 not downloaded yet
2026-03-29 20:07:46 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8601/17898601/interior_boot-1771757325183.jpeg>.
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6667%252F15306667%252Finterior_dashboard-1774697234651.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6667/15306667/interior_dashboard-1774697234651.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2967%252F16172967%252Fdamage_scratches-1749838707238.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2967/16172967/damage_scratches-1749838707238.jpeg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6667%252F15306667%252Finstrument_cluster-1774697710256.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6667/15306667/instrument_cluster-1774697710256.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6667%252F15306667%252Finterior_boot-1774697716238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6667/15306667/interior_boot-1774697716238.jpg not downloaded yet
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6667%252F15306667%252Fdocs_service_history-1774697454303.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D63798c2af462d77be2df9c72f27e27d7%27 HTTP/1.1" 200 None
2026-03-29 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6667/15306667/docs_service_history-1774697454303.jpg?ixlib=js-3.8.0&auto=format&s=63798c2af462d77be2df9c72f27e27d7 not downloaded yet
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96bd490>
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6073%252F20476073%252Fexterior_front_driver-1774704753556.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_front_driver-1774704753556.jpg saved to cache
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c345d700-8838-5625-aa00-e7dccf75a389
2026-03-29 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8601/17898601/interior_boot-1771757325183.jpeg> (referer: None)
2026-03-29 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1913/20171913/interior_boot-1773742197225.jpg> (referer: None)
2026-03-29 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_rear_passenger-default-1774714323866.jpg> (referer: None)
2026-03-29 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6331/20376331/instrument_cluster-1774106819335.jpg> (referer: None)
2026-03-29 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_front_driver-1774696940905.jpg> (referer: None)
2026-03-29 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2967/16172967/16172967-interior_rear_seats-default-1774714294541.jpg> (referer: None)
2026-03-29 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7296/20387296/interior_boot-1774717617709.jpg> (referer: None)
2026-03-29 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2967/16172967/16172967-interior_front_seats-default-1774714293089.jpg> (referer: None)
2026-03-29 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/7600/19097600/docs_service_history-1767441277498.jpg?ixlib=js-3.8.0&auto=format&s=b94c121413eb5fd95e1ff73b39c46244> (referer: None)
2026-03-29 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2967/16172967/16172967-interior_boot-default-1774714297048.jpg> (referer: None)
2026-03-29 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_rear_passenger-1774696943520.jpg> (referer: None)
2026-03-29 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_rear_driver-1774696920990.jpg> (referer: None)
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xac\xcb\xff\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\xad\xcb\x00\xac\xc2\x0b\x00\x00\x00\x00'
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8dead10>
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be9b522c-6e91-52c4-8152-a04a0b0d034a/be9b522c-6e91-52c4-8152-a04a0b0d034a_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8601%252F17898601%252Finterior_boot-1771757325183.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8601/17898601/interior_boot-1771757325183.jpeg saved to cache
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be9b522c-6e91-52c4-8152-a04a0b0d034a
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S938B\x00'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S938BXXS8BZB5\x00'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:17 10:08:52\x00'
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8719a50>
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1913%252F20171913%252Finterior_boot-1773742197225.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1913/20171913/interior_boot-1773742197225.jpg saved to cache
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8244f90>
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2967%252F16172967%252F16172967-exterior_rear_passenger-default-1774714323866.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_rear_passenger-default-1774714323866.jpg saved to cache
2026-03-29 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c34f13f-85a0-5180-b1f8-903901075d06
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf177d0>
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6331%252F20376331%252Finstrument_cluster-1774106819335.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6331/20376331/instrument_cluster-1774106819335.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87015fd4d0>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6667%252F15306667%252Fexterior_front_driver-1774696940905.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_front_driver-1774696940905.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84b79d0>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2967%252F16172967%252F16172967-interior_rear_seats-default-1774714294541.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2967/16172967/16172967-interior_rear_seats-default-1774714294541.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c34f13f-85a0-5180-b1f8-903901075d06
2026-03-29 20:07:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84b5910>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7296%252F20387296%252Finterior_boot-1774717617709.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7296/20387296/interior_boot-1774717617709.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa15a1d0>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2967%252F16172967%252F16172967-interior_front_seats-default-1774714293089.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2967/16172967/16172967-interior_front_seats-default-1774714293089.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c34f13f-85a0-5180-b1f8-903901075d06
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1f4fd0>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F7600%252F19097600%252Fdocs_service_history-1767441277498.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db94c121413eb5fd95e1ff73b39c46244') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/7600/19097600/docs_service_history-1767441277498.jpg?ixlib=js-3.8.0&auto=format&s=b94c121413eb5fd95e1ff73b39c46244 saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 95c0690c-af8f-5b09-8b20-56381a7b37ac
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf02890>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2967%252F16172967%252F16172967-interior_boot-default-1774714297048.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2967/16172967/16172967-interior_boot-default-1774714297048.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c34f13f-85a0-5180-b1f8-903901075d06
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8718290>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6667%252F15306667%252Fexterior_rear_passenger-1774696943520.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_rear_passenger-1774696943520.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa158390>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6667%252F15306667%252Fexterior_rear_driver-1774696920990.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_rear_driver-1774696920990.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_front_passenger-1774696942395.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7600/19097600/damage_scratches-1767440488536.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7600/19097600/interior_boot-1767440982896.jpg> (referer: None)
2026-03-29 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6667/15306667/instrument_cluster-1774697710256.jpg> (referer: None)
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88b7b50>
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6667%252F15306667%252Fexterior_front_passenger-1774696942395.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_front_passenger-1774696942395.jpg saved to cache
2026-03-29 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2026:01:03 11:41:09\x00'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S921B\x00'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S921BXXSBCYK8\x00'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9045910>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7600%252F19097600%252Fdamage_scratches-1767440488536.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7600/19097600/damage_scratches-1767440488536.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 95c0690c-af8f-5b09-8b20-56381a7b37ac
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2026:01:03 11:49:32\x00'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S921B\x00'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S921BXXSBCYK8\x00'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:07:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88eed50>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7600%252F19097600%252Finterior_boot-1767440982896.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7600/19097600/interior_boot-1767440982896.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 95c0690c-af8f-5b09-8b20-56381a7b37ac
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8944d90>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6667%252F15306667%252Finstrument_cluster-1774697710256.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6667/15306667/instrument_cluster-1774697710256.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce
2026-03-29 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6667/15306667/interior_boot-1774697716238.jpg> (referer: None)
2026-03-29 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_front_passenger-default-1774714299839.jpg> (referer: None)
2026-03-29 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7600/19097600/interior_dashboard-1767619790959.jpg> (referer: None)
2026-03-29 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_rear_driver-default-1774714330323.jpg> (referer: None)
2026-03-29 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6667/15306667/docs_service_history-1774697454303.jpg?ixlib=js-3.8.0&auto=format&s=63798c2af462d77be2df9c72f27e27d7> (referer: None)
2026-03-29 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-interior_dashboard-default-1774714297522.jpg> (referer: None)
2026-03-29 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7600/19097600/interior_rear_seats-1767619801100.jpg> (referer: None)
2026-03-29 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6667/15306667/interior_front_seats-1774697216719.jpg> (referer: None)
2026-03-29 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6667/15306667/interior_dashboard-1774697234651.jpg> (referer: None)
2026-03-29 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6667/15306667/interior_rear_seats-1774697218005.jpg> (referer: None)
2026-03-29 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2967/16172967/damage_scratches-1749838707238.jpeg> (referer: None)
2026-03-29 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/2967/16172967/docs_service_history-1749839948760.jpeg?ixlib=js-3.8.0&auto=format&s=82d319e1a9188afaa621d5608dfdf9b8> (referer: None)
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9455d90>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6667%252F15306667%252Finterior_boot-1774697716238.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6667/15306667/interior_boot-1774697716238.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88b6fd0>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2967%252F16172967%252F16172967-exterior_front_passenger-default-1774714299839.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_front_passenger-default-1774714299839.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c34f13f-85a0-5180-b1f8-903901075d06
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9265d90>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7600%252F19097600%252Finterior_dashboard-1767619790959.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7600/19097600/interior_dashboard-1767619790959.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 95c0690c-af8f-5b09-8b20-56381a7b37ac
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8df02d0>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2967%252F16172967%252F16172967-exterior_rear_driver-default-1774714330323.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_rear_driver-default-1774714330323.jpg saved to cache
2026-03-29 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c34f13f-85a0-5180-b1f8-903901075d06
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9264910>
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6667%252F15306667%252Fdocs_service_history-1774697454303.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D63798c2af462d77be2df9c72f27e27d7') HTTP/1.1" 204 0
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6667/15306667/docs_service_history-1774697454303.jpg?ixlib=js-3.8.0&auto=format&s=63798c2af462d77be2df9c72f27e27d7 saved to cache
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8df1350>
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2967%252F16172967%252F16172967-interior_dashboard-default-1774714297522.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-interior_dashboard-default-1774714297522.jpg saved to cache
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c34f13f-85a0-5180-b1f8-903901075d06
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f821cf50>
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7600%252F19097600%252Finterior_rear_seats-1767619801100.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7600/19097600/interior_rear_seats-1767619801100.jpg saved to cache
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 95c0690c-af8f-5b09-8b20-56381a7b37ac
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88b67d0>
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6667%252F15306667%252Finterior_front_seats-1774697216719.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6667/15306667/interior_front_seats-1774697216719.jpg saved to cache
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8456810>
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6667%252F15306667%252Finterior_dashboard-1774697234651.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6667/15306667/interior_dashboard-1774697234651.jpg saved to cache
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fade6b90>
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6667%252F15306667%252Finterior_rear_seats-1774697218005.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6667/15306667/interior_rear_seats-1774697218005.jpg saved to cache
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce
2026-03-29 20:07:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 294cc826-79c1-588a-9ec7-44a4a07dc5ce, skipping ID generation
2026-03-29 20:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce with scrape type 1
2026-03-29 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 294cc826-79c1-588a-9ec7-44a4a07dc5ce sending to next pipeline
2026-03-29 20:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 294cc826-79c1-588a-9ec7-44a4a07dc5ce, identifier: 15306667
2026-03-29 20:07:51 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:07:51 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:07:51 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00/8x\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xee\x9c\x00/-\xe8\x00\x00\x00\x00'
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84b7a90>
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2967%252F16172967%252Fdamage_scratches-1749838707238.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2967/16172967/damage_scratches-1749838707238.jpeg saved to cache
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c34f13f-85a0-5180-b1f8-903901075d06
2026-03-29 20:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 294cc826-79c1-588a-9ec7-44a4a07dc5ce with identifier: 15306667
2026-03-29 20:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 294cc826-79c1-588a-9ec7-44a4a07dc5ce with identifier: 15306667
2026-03-29 20:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 294cc826-79c1-588a-9ec7-44a4a07dc5ce with identifier: 15306667 to the API
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6667/15306667/interior_rear_seats-1774697218005.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '294cc826-79c1-588a-9ec7-44a4a07dc5ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BU64 OXE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15306667',
'listing': 'auction',
'location': 'Greater London Romford',
'make': 'Ford',
'model': 'Focus',
'odometer': 75000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1849630,
'Height': 2696,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_front_driver-1774696940905.jpg',
'Width': 3595},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1619219,
'Height': 2563,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_rear_driver-1774696920990.jpg',
'Width': 3417},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1746138,
'Height': 2592,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_front_passenger-1774696942395.jpg',
'Width': 3456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1171220,
'Height': 2123,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6667/15306667/exterior_rear_passenger-1774696943520.jpg',
'Width': 2831},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2785442,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6667/15306667/interior_front_seats-1774697216719.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2582669,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6667/15306667/interior_rear_seats-1774697218005.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2040573,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6667/15306667/interior_dashboard-1774697234651.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488443,
'Height': 1344,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6667/15306667/instrument_cluster-1774697710256.jpg',
'Width': 1792},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 655031,
'Height': 1653,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6667/15306667/interior_boot-1774697716238.jpg',
'Width': 2204},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_294cc826-79c1-588a-9ec7-44a4a07dc5ce/294cc826-79c1-588a-9ec7-44a4a07dc5ce_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1380591,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6667/15306667/docs_service_history-1774697454303.jpg?ixlib=js-3.8.0&auto=format&s=63798c2af462d77be2df9c72f27e27d7',
'Width': 3840}],
'price': 3829,
'price_includes_vat': False,
'registration_date': '2014-09-08',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus Titanium Navigator Auto',
'transmission': 'automatic',
'trim': 'Titanium Navigator Auto',
'vin': 'WF0KXXGCBKEM36233',
'year': 2014}
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715306667%27 HTTP/1.1" 200 None
2026-03-29 20:07:51 [motorway.uk] INFO: Saving data for 15306667: {'created_time': 1774814871.80139, 'last_price_update_time': 1774814871.801401, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15306667') HTTP/1.1" 204 0
2026-03-29 20:07:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:07:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96be250>
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F2967%252F16172967%252Fdocs_service_history-1749839948760.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D82d319e1a9188afaa621d5608dfdf9b8') HTTP/1.1" 204 0
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/2967/16172967/docs_service_history-1749839948760.jpeg?ixlib=js-3.8.0&auto=format&s=82d319e1a9188afaa621d5608dfdf9b8 saved to cache
2026-03-29 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c34f13f-85a0-5180-b1f8-903901075d06
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6073/20476073/docs_service_history-1774720191198.jpg?ixlib=js-3.8.0&auto=format&s=59e6add59b4f75cd4943ecae14fca9a8> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_front_passenger-1767440421904.jpg> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_rear_driver-1767619876505.jpg> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_front_driver-default-1774714287356.jpg> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_rear_passenger-1767619856213.jpg> (referer: None)
2026-03-29 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7600/19097600/interior_front_seats-1767619825852.jpg> (referer: None)
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa54910>
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6073%252F20476073%252Fdocs_service_history-1774720191198.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59e6add59b4f75cd4943ecae14fca9a8') HTTP/1.1" 204 0
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6073/20476073/docs_service_history-1774720191198.jpg?ixlib=js-3.8.0&auto=format&s=59e6add59b4f75cd4943ecae14fca9a8 saved to cache
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c345d700-8838-5625-aa00-e7dccf75a389
2026-03-29 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_front_driver-1767440424891.jpg> (referer: None)
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f817ead0>
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7600%252F19097600%252Fexterior_front_passenger-1767440421904.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_front_passenger-1767440421904.jpg saved to cache
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95c0690c-af8f-5b09-8b20-56381a7b37ac
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8928690>
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7600%252F19097600%252Fexterior_rear_driver-1767619876505.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_rear_driver-1767619876505.jpg saved to cache
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95c0690c-af8f-5b09-8b20-56381a7b37ac
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f5b410>
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2967%252F16172967%252F16172967-exterior_front_driver-default-1774714287356.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_front_driver-default-1774714287356.jpg saved to cache
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c34f13f-85a0-5180-b1f8-903901075d06
2026-03-29 20:07:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c34f13f-85a0-5180-b1f8-903901075d06, skipping ID generation
2026-03-29 20:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c34f13f-85a0-5180-b1f8-903901075d06 with scrape type 1
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c34f13f-85a0-5180-b1f8-903901075d06 sending to next pipeline
2026-03-29 20:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8c34f13f-85a0-5180-b1f8-903901075d06, identifier: 16172967
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8fac350>
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7600%252F19097600%252Fexterior_rear_passenger-1767619856213.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_rear_passenger-1767619856213.jpg saved to cache
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95c0690c-af8f-5b09-8b20-56381a7b37ac
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84d6810>
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7600%252F19097600%252Finterior_front_seats-1767619825852.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7600/19097600/interior_front_seats-1767619825852.jpg saved to cache
2026-03-29 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95c0690c-af8f-5b09-8b20-56381a7b37ac
2026-03-29 20:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8c34f13f-85a0-5180-b1f8-903901075d06 with identifier: 16172967
2026-03-29 20:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8c34f13f-85a0-5180-b1f8-903901075d06 with identifier: 16172967
2026-03-29 20:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8c34f13f-85a0-5180-b1f8-903901075d06 with identifier: 16172967 to the API
2026-03-29 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_front_driver-default-1774714287356.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8c34f13f-85a0-5180-b1f8-903901075d06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'S555 HUR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16172967',
'listing': 'auction',
'location': 'Essex Benfleet',
'make': 'Audi',
'model': 'SQ5',
'odometer': 103000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1745930,
'Height': 2663,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_front_driver-default-1774714287356.jpg',
'Width': 3551},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1402682,
'Height': 2450,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_rear_driver-default-1774714330323.jpg',
'Width': 3266},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1641642,
'Height': 2414,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_front_passenger-default-1774714299839.jpg',
'Width': 3218},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1135346,
'Height': 2442,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-exterior_rear_passenger-default-1774714323866.jpg',
'Width': 3256},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2006426,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2967/16172967/16172967-interior_front_seats-default-1774714293089.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1959811,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2967/16172967/16172967-interior_rear_seats-default-1774714294541.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1697665,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2967/16172967/16172967-interior_dashboard-default-1774714297522.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3117006,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2967/16172967/16172967-interior_boot-default-1774714297048.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2881162,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/2967/16172967/docs_service_history-1749839948760.jpeg?ixlib=js-3.8.0&auto=format&s=82d319e1a9188afaa621d5608dfdf9b8',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c34f13f-85a0-5180-b1f8-903901075d06/8c34f13f-85a0-5180-b1f8-903901075d06_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3221268,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2967/16172967/damage_scratches-1749838707238.jpeg',
'Width': 4032}],
'price': 8815,
'price_includes_vat': False,
'registration_date': '2015-04-03',
'seats_number': None,
'seller_name': None,
'title': 'Audi SQ5 TDI Quattro Auto',
'transmission': 'automatic',
'trim': 'TDI Quattro Auto',
'vin': 'WAUZZZ8R5FA101541',
'year': 2015}
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716172967%27 HTTP/1.1" 200 None
2026-03-29 20:07:53 [motorway.uk] INFO: Saving data for 16172967: {'created_time': 1774814873.267863, 'last_price_update_time': 1774814873.267874, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16172967') HTTP/1.1" 204 0
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8719490>
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7600%252F19097600%252Fexterior_front_driver-1767440424891.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_front_driver-1767440424891.jpg saved to cache
2026-03-29 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95c0690c-af8f-5b09-8b20-56381a7b37ac
2026-03-29 20:07:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95c0690c-af8f-5b09-8b20-56381a7b37ac, skipping ID generation
2026-03-29 20:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95c0690c-af8f-5b09-8b20-56381a7b37ac with scrape type 1
2026-03-29 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95c0690c-af8f-5b09-8b20-56381a7b37ac sending to next pipeline
2026-03-29 20:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 95c0690c-af8f-5b09-8b20-56381a7b37ac, identifier: 19097600
2026-03-29 20:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 95c0690c-af8f-5b09-8b20-56381a7b37ac with identifier: 19097600
2026-03-29 20:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 95c0690c-af8f-5b09-8b20-56381a7b37ac with identifier: 19097600
2026-03-29 20:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 95c0690c-af8f-5b09-8b20-56381a7b37ac with identifier: 19097600 to the API
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_front_driver-1767440424891.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '95c0690c-af8f-5b09-8b20-56381a7b37ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'T18 JSM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19097600',
'listing': 'auction',
'location': 'North Lanarkshire Wishaw',
'make': 'Jaguar',
'model': 'XF Series',
'odometer': 61065,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1087821,
'Height': 2131,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_front_driver-1767440424891.jpg',
'Width': 2841},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 871049,
'Height': 2017,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_rear_driver-1767619876505.jpg',
'Width': 2689},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 891599,
'Height': 2253,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_front_passenger-1767440421904.jpg',
'Width': 3004},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1322968,
'Height': 2246,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7600/19097600/exterior_rear_passenger-1767619856213.jpg',
'Width': 2995},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2010223,
'Height': 2982,
'OriginUrl': 'https://motorway-photos.imgix.net/7600/19097600/interior_front_seats-1767619825852.jpg',
'Width': 3976},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2101249,
'Height': 3078,
'OriginUrl': 'https://motorway-photos.imgix.net/7600/19097600/interior_rear_seats-1767619801100.jpg',
'Width': 4104},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1312276,
'Height': 2350,
'OriginUrl': 'https://motorway-photos.imgix.net/7600/19097600/interior_dashboard-1767619790959.jpg',
'Width': 3133},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 9483180,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/7600/19097600/interior_boot-1767440982896.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1507470,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/7600/19097600/docs_service_history-1767441277498.jpg?ixlib=js-3.8.0&auto=format&s=b94c121413eb5fd95e1ff73b39c46244',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95c0690c-af8f-5b09-8b20-56381a7b37ac/95c0690c-af8f-5b09-8b20-56381a7b37ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8011284,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/7600/19097600/damage_scratches-1767440488536.jpg',
'Width': 4080}],
'price': 9409,
'price_includes_vat': False,
'registration_date': '2019-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar XF R-Sport D Auto',
'transmission': 'automatic',
'trim': 'XF R-Sport D Auto',
'vin': 'SAJBB4AN5JCY71580',
'year': 2019}
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719097600%27 HTTP/1.1" 200 None
2026-03-29 20:07:53 [motorway.uk] INFO: Saving data for 19097600: {'created_time': 1774814873.885909, 'last_price_update_time': 1774814873.88592, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19097600') HTTP/1.1" 204 0
2026-03-29 20:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_front_passenger-1774704798312.jpg> (referer: None)
2026-03-29 20:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_rear_passenger-1774704783172.jpg> (referer: None)
2026-03-29 20:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_rear_driver-1774704770562.jpg> (referer: None)
2026-03-29 20:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6073/20476073/interior_dashboard-1774719366271.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_rear_passenger-1774099486536.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6073/20476073/instrument_cluster-1774718995322.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6331/20376331/interior_boot-1774106826304.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6331/20376331/interior_front_seats-1774106722981.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6331/20376331/interior_dashboard-1774106787762.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7296/20387296/interior_dashboard-1774783522181.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6073/20476073/interior_rear_seats-1774719313737.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6073/20476073/interior_front_seats-1774718903817.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6073/20476073/interior_boot-1774719621961.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6331/20376331/interior_rear_seats-1774106760516.jpg> (referer: None)
2026-03-29 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7296/20387296/instrument_cluster-1774783506894.jpg> (referer: None)
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa171d0>
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6073%252F20476073%252Fexterior_front_passenger-1774704798312.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_front_passenger-1774704798312.jpg saved to cache
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c345d700-8838-5625-aa00-e7dccf75a389
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c74c90>
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6073%252F20476073%252Fexterior_rear_passenger-1774704783172.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_rear_passenger-1774704783172.jpg saved to cache
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c345d700-8838-5625-aa00-e7dccf75a389
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e6edd0>
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6073%252F20476073%252Fexterior_rear_driver-1774704770562.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_rear_driver-1774704770562.jpg saved to cache
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c345d700-8838-5625-aa00-e7dccf75a389
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e19610>
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6073%252F20476073%252Finterior_dashboard-1774719366271.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6073/20476073/interior_dashboard-1774719366271.jpg saved to cache
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c345d700-8838-5625-aa00-e7dccf75a389
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faecf210>
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6331%252F20376331%252Fexterior_rear_passenger-1774099486536.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_rear_passenger-1774099486536.jpg saved to cache
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e1b3d0>
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6073%252F20476073%252Finstrument_cluster-1774718995322.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6073/20476073/instrument_cluster-1774718995322.jpg saved to cache
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c345d700-8838-5625-aa00-e7dccf75a389
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e1ab10>
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6331%252F20376331%252Finterior_boot-1774106826304.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6331/20376331/interior_boot-1774106826304.jpg saved to cache
2026-03-29 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faece1d0>
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6331%252F20376331%252Finterior_front_seats-1774106722981.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6331/20376331/interior_front_seats-1774106722981.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9000b10>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6331%252F20376331%252Finterior_dashboard-1774106787762.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6331/20376331/interior_dashboard-1774106787762.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84ee650>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7296%252F20387296%252Finterior_dashboard-1774783522181.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7296/20387296/interior_dashboard-1774783522181.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8accad0>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6073%252F20476073%252Finterior_rear_seats-1774719313737.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6073/20476073/interior_rear_seats-1774719313737.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c345d700-8838-5625-aa00-e7dccf75a389
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9000350>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6073%252F20476073%252Finterior_front_seats-1774718903817.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6073/20476073/interior_front_seats-1774718903817.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c345d700-8838-5625-aa00-e7dccf75a389
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9224cd0>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6073%252F20476073%252Finterior_boot-1774719621961.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6073/20476073/interior_boot-1774719621961.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c345d700-8838-5625-aa00-e7dccf75a389
2026-03-29 20:07:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c345d700-8838-5625-aa00-e7dccf75a389, skipping ID generation
2026-03-29 20:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c345d700-8838-5625-aa00-e7dccf75a389 with scrape type 1
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c345d700-8838-5625-aa00-e7dccf75a389 sending to next pipeline
2026-03-29 20:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c345d700-8838-5625-aa00-e7dccf75a389, identifier: 20476073
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94ab110>
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6331%252F20376331%252Finterior_rear_seats-1774106760516.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6331/20376331/interior_rear_seats-1774106760516.jpg saved to cache
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114
2026-03-29 20:07:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f539b6c-7b8b-5d31-9a32-8e9ad9678114, skipping ID generation
2026-03-29 20:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114 with scrape type 1
2026-03-29 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f539b6c-7b8b-5d31-9a32-8e9ad9678114 sending to next pipeline
2026-03-29 20:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7f539b6c-7b8b-5d31-9a32-8e9ad9678114, identifier: 20376331
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82c1950>
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7296%252F20387296%252Finstrument_cluster-1774783506894.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7296/20387296/instrument_cluster-1774783506894.jpg saved to cache
2026-03-29 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e
2026-03-29 20:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c345d700-8838-5625-aa00-e7dccf75a389 with identifier: 20476073
2026-03-29 20:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c345d700-8838-5625-aa00-e7dccf75a389 with identifier: 20476073
2026-03-29 20:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c345d700-8838-5625-aa00-e7dccf75a389 with identifier: 20476073 to the API
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6073/20476073/interior_boot-1774719621961.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c345d700-8838-5625-aa00-e7dccf75a389',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VN69 MYD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20476073',
'listing': 'auction',
'location': 'East Riding of Yorkshire Hull',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 23000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1568314,
'Height': 2685,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_front_driver-1774704753556.jpg',
'Width': 3580},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1438486,
'Height': 2729,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_rear_driver-1774704770562.jpg',
'Width': 3639},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1211893,
'Height': 2352,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_front_passenger-1774704798312.jpg',
'Width': 3136},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1464062,
'Height': 2480,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6073/20476073/exterior_rear_passenger-1774704783172.jpg',
'Width': 3306},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3643565,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6073/20476073/interior_front_seats-1774718903817.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3272451,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6073/20476073/interior_rear_seats-1774719313737.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1655042,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6073/20476073/interior_dashboard-1774719366271.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2767827,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6073/20476073/instrument_cluster-1774718995322.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3824348,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6073/20476073/interior_boot-1774719621961.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c345d700-8838-5625-aa00-e7dccf75a389/c345d700-8838-5625-aa00-e7dccf75a389_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 584967,
'Height': 2250,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6073/20476073/docs_service_history-1774720191198.jpg?ixlib=js-3.8.0&auto=format&s=59e6add59b4f75cd4943ecae14fca9a8',
'Width': 3173}],
'price': 10053,
'price_includes_vat': False,
'registration_date': '2019-10-31',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai Acenta Premium DiG-T',
'transmission': 'manual',
'trim': 'Acenta Premium DiG-T',
'vin': 'SJNFFAJ11U2722118',
'year': 2019}
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476073%27 HTTP/1.1" 200 None
2026-03-29 20:07:56 [motorway.uk] INFO: Saving data for 20476073: {'created_time': 1774814876.541169, 'last_price_update_time': 1774814876.541179, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20476073') HTTP/1.1" 204 0
2026-03-29 20:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7f539b6c-7b8b-5d31-9a32-8e9ad9678114 with identifier: 20376331
2026-03-29 20:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7f539b6c-7b8b-5d31-9a32-8e9ad9678114 with identifier: 20376331
2026-03-29 20:07:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7f539b6c-7b8b-5d31-9a32-8e9ad9678114 with identifier: 20376331 to the API
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6331/20376331/interior_rear_seats-1774106760516.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7f539b6c-7b8b-5d31-9a32-8e9ad9678114',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KW20 LYU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20376331',
'listing': 'auction',
'location': 'North East Lincolnshire Grimsby',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 22500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 968041,
'Height': 2171,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_front_driver-1774099450255.jpg',
'Width': 2895},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1100566,
'Height': 2252,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_rear_driver-1774099484997.jpg',
'Width': 3003},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1723701,
'Height': 2440,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_front_passenger-1774099496948.jpg',
'Width': 3253},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1300364,
'Height': 2189,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6331/20376331/exterior_rear_passenger-1774099486536.jpg',
'Width': 2919},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3247367,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6331/20376331/interior_front_seats-1774106722981.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4895732,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6331/20376331/interior_rear_seats-1774106760516.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3349555,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6331/20376331/interior_dashboard-1774106787762.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2923550,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6331/20376331/instrument_cluster-1774106819335.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2927077,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6331/20376331/interior_boot-1774106826304.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f539b6c-7b8b-5d31-9a32-8e9ad9678114/7f539b6c-7b8b-5d31-9a32-8e9ad9678114_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521260,
'Height': 2773,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6331/20376331/docs_service_history-1774712190845.jpg?ixlib=js-3.8.0&auto=format&s=378c95acd0dd93705fac3d64e2760fe0',
'Width': 1940}],
'price': 8834,
'price_includes_vat': False,
'registration_date': '2020-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta ST-LINE Edition Turbo',
'transmission': 'manual',
'trim': 'ST-LINE Edition Turbo',
'vin': 'WF0FXXGAHFKP23154',
'year': 2020}
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720376331%27 HTTP/1.1" 200 None
2026-03-29 20:07:56 [motorway.uk] INFO: Saving data for 20376331: {'created_time': 1774814876.964748, 'last_price_update_time': 1774814876.96476, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20376331') HTTP/1.1" 204 0
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7296/20387296/exterior_rear_passenger-1774783535249.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7296/20387296/interior_rear_seats-1774717561792.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7296/20387296/interior_front_seats-1774717539043.jpg> (referer: None)
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f97290>
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7296%252F20387296%252Fexterior_rear_passenger-1774783535249.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7296/20387296/exterior_rear_passenger-1774783535249.jpg saved to cache
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa153f10>
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7296%252F20387296%252Finterior_rear_seats-1774717561792.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7296/20387296/interior_rear_seats-1774717561792.jpg saved to cache
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f905c7d0>
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7296%252F20387296%252Finterior_front_seats-1774717539043.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7296/20387296/interior_front_seats-1774717539043.jpg saved to cache
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7419/20397419/docs_service_history-1774715852644.jpg?ixlib=js-3.8.0&auto=format&s=3e066ab5c0628935026d323eb2481d93> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_front_driver-1774714498884.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7296/20387296/exterior_rear_driver-1774716733967.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7419/20397419/instrument_cluster-1774715175781.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_front_passenger-1774714602375.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_rear_passenger-1774714569028.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7296/20387296/exterior_front_driver-1774716704202.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9959/20389959/instrument_cluster-1774696217162.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7296/20387296/exterior_front_passenger-1774716821236.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7419/20397419/20397419-interior_dashboard-modified-1774717413676.jpeg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7419/20397419/interior_rear_seats-1774715301487.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7343/20487343/interior_rear_seats-1774701778511.jpg> (referer: None)
2026-03-29 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7419/20397419/interior_boot-1774715272599.jpg> (referer: None)
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82ac410>
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7419%252F20397419%252Fdocs_service_history-1774715852644.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3e066ab5c0628935026d323eb2481d93') HTTP/1.1" 204 0
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7419/20397419/docs_service_history-1774715852644.jpg?ixlib=js-3.8.0&auto=format&s=3e066ab5c0628935026d323eb2481d93 saved to cache
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ccf606d8-a1e4-57ae-b115-ee124d6077b6
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad83010>
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7419%252F20397419%252Fexterior_front_driver-1774714498884.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_front_driver-1774714498884.jpg saved to cache
2026-03-29 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ccf606d8-a1e4-57ae-b115-ee124d6077b6
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85c5d10>
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7296%252F20387296%252Fexterior_rear_driver-1774716733967.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7296/20387296/exterior_rear_driver-1774716733967.jpg saved to cache
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85c7bd0>
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7419%252F20397419%252Finstrument_cluster-1774715175781.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7419/20397419/instrument_cluster-1774715175781.jpg saved to cache
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ccf606d8-a1e4-57ae-b115-ee124d6077b6
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac91150>
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7419%252F20397419%252Fexterior_front_passenger-1774714602375.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_front_passenger-1774714602375.jpg saved to cache
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ccf606d8-a1e4-57ae-b115-ee124d6077b6
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadd3790>
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7419%252F20397419%252Fexterior_rear_passenger-1774714569028.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_rear_passenger-1774714569028.jpg saved to cache
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ccf606d8-a1e4-57ae-b115-ee124d6077b6
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f851ded0>
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7296%252F20387296%252Fexterior_front_driver-1774716704202.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7296/20387296/exterior_front_driver-1774716704202.jpg saved to cache
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85c79d0>
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9959%252F20389959%252Finstrument_cluster-1774696217162.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9959/20389959/instrument_cluster-1774696217162.jpg saved to cache
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad835d0>
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7296%252F20387296%252Fexterior_front_passenger-1774716821236.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7296/20387296/exterior_front_passenger-1774716821236.jpg saved to cache
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e
2026-03-29 20:07:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69e19fdd-f519-51df-bb4c-18c5b2ea848e, skipping ID generation
2026-03-29 20:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e with scrape type 1
2026-03-29 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69e19fdd-f519-51df-bb4c-18c5b2ea848e sending to next pipeline
2026-03-29 20:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 69e19fdd-f519-51df-bb4c-18c5b2ea848e, identifier: 20387296
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82ae850>
2026-03-29 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7419%252F20397419%252F20397419-interior_dashboard-modified-1774717413676.jpeg') HTTP/1.1" 204 0
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7419/20397419/20397419-interior_dashboard-modified-1774717413676.jpeg saved to cache
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ccf606d8-a1e4-57ae-b115-ee124d6077b6
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0f7d90>
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7419%252F20397419%252Finterior_rear_seats-1774715301487.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7419/20397419/interior_rear_seats-1774715301487.jpg saved to cache
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ccf606d8-a1e4-57ae-b115-ee124d6077b6
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadd1f90>
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7343%252F20487343%252Finterior_rear_seats-1774701778511.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7343/20487343/interior_rear_seats-1774701778511.jpg saved to cache
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca
2026-03-29 20:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 69e19fdd-f519-51df-bb4c-18c5b2ea848e with identifier: 20387296
2026-03-29 20:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 69e19fdd-f519-51df-bb4c-18c5b2ea848e with identifier: 20387296
2026-03-29 20:07:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 69e19fdd-f519-51df-bb4c-18c5b2ea848e with identifier: 20387296 to the API
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:07:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7296/20387296/exterior_front_passenger-1774716821236.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '69e19fdd-f519-51df-bb4c-18c5b2ea848e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HF72 XVV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20387296',
'listing': 'auction',
'location': 'Dorset Bournemouth',
'make': 'Nissan',
'model': 'Juke',
'odometer': 36000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2309946,
'Height': 2921,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7296/20387296/exterior_front_driver-1774716704202.jpg',
'Width': 3894},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1543414,
'Height': 2480,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7296/20387296/exterior_rear_driver-1774716733967.jpg',
'Width': 3307},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2397509,
'Height': 3017,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7296/20387296/exterior_front_passenger-1774716821236.jpg',
'Width': 4022},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1947783,
'Height': 2540,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7296/20387296/exterior_rear_passenger-1774783535249.jpg',
'Width': 3387},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4676207,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7296/20387296/interior_front_seats-1774717539043.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3623518,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7296/20387296/interior_rear_seats-1774717561792.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2882441,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7296/20387296/interior_dashboard-1774783522181.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1234194,
'Height': 2507,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7296/20387296/instrument_cluster-1774783506894.jpg',
'Width': 3343},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4603365,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7296/20387296/interior_boot-1774717617709.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69e19fdd-f519-51df-bb4c-18c5b2ea848e/69e19fdd-f519-51df-bb4c-18c5b2ea848e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1463727,
'Height': 2308,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7296/20387296/wheels_front_driver-1774716857504.jpg',
'Width': 3077}],
'price': 12204,
'price_includes_vat': False,
'registration_date': '2022-09-05',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke Tekna DiG-T S-A',
'transmission': 'automatic',
'trim': 'Tekna DiG-T S-A',
'vin': 'SJNFAAF16U1193422',
'year': 2022}
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720387296%27 HTTP/1.1" 200 None
2026-03-29 20:07:59 [motorway.uk] INFO: Saving data for 20387296: {'created_time': 1774814879.721425, 'last_price_update_time': 1774814879.721441, 'auction_closing_time': 1774884600.0}
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20387296') HTTP/1.1" 204 0
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:07:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf1f610>
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7419%252F20397419%252Finterior_boot-1774715272599.jpg') HTTP/1.1" 204 0
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7419/20397419/interior_boot-1774715272599.jpg saved to cache
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ccf606d8-a1e4-57ae-b115-ee124d6077b6
2026-03-29 20:07:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ccf606d8-a1e4-57ae-b115-ee124d6077b6, skipping ID generation
2026-03-29 20:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccf606d8-a1e4-57ae-b115-ee124d6077b6 with scrape type 1
2026-03-29 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ccf606d8-a1e4-57ae-b115-ee124d6077b6 sending to next pipeline
2026-03-29 20:07:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ccf606d8-a1e4-57ae-b115-ee124d6077b6, identifier: 20397419
2026-03-29 20:07:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ccf606d8-a1e4-57ae-b115-ee124d6077b6 with identifier: 20397419
2026-03-29 20:07:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ccf606d8-a1e4-57ae-b115-ee124d6077b6 with identifier: 20397419
2026-03-29 20:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ccf606d8-a1e4-57ae-b115-ee124d6077b6 with identifier: 20397419 to the API
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7419/20397419/interior_boot-1774715272599.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ccf606d8-a1e4-57ae-b115-ee124d6077b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HY66 VZU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20397419',
'listing': 'auction',
'location': 'Blaenau Gwent Abertillery',
'make': 'BMW',
'model': '1 Series',
'odometer': 45317,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1971664,
'Height': 2583,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_front_driver-1774714498884.jpg',
'Width': 3444},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2254868,
'Height': 2690,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_rear_driver-1774714549354.jpg',
'Width': 3586},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2182880,
'Height': 2598,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_front_passenger-1774714602375.jpg',
'Width': 3464},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2193351,
'Height': 2689,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7419/20397419/exterior_rear_passenger-1774714569028.jpg',
'Width': 3585},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3532737,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7419/20397419/interior_front_seats-1774715084896.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3562790,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7419/20397419/interior_rear_seats-1774715301487.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2550141,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7419/20397419/20397419-interior_dashboard-modified-1774717413676.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2223044,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7419/20397419/instrument_cluster-1774715175781.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3960285,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7419/20397419/interior_boot-1774715272599.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccf606d8-a1e4-57ae-b115-ee124d6077b6/ccf606d8-a1e4-57ae-b115-ee124d6077b6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509235,
'Height': 2370,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7419/20397419/docs_service_history-1774715852644.jpg?ixlib=js-3.8.0&auto=format&s=3e066ab5c0628935026d323eb2481d93',
'Width': 1637}],
'price': 7674,
'price_includes_vat': False,
'registration_date': '2016-09-13',
'seats_number': None,
'seller_name': None,
'title': 'BMW 118I Sport',
'transmission': 'manual',
'trim': '118I Sport',
'vin': 'WBA1R52020V859286',
'year': 2016}
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720397419%27 HTTP/1.1" 200 None
2026-03-29 20:08:00 [motorway.uk] INFO: Saving data for 20397419: {'created_time': 1774814880.344477, 'last_price_update_time': 1774814880.344488, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20397419') HTTP/1.1" 204 0
2026-03-29 20:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1913/20171913/wheels_front_driver-1773741740302.jpg> (referer: None)
2026-03-29 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_rear_passenger-1774700833007.jpg> (referer: None)
2026-03-29 20:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7343/20487343/interior_front_seats-1774701762983.jpg> (referer: None)
2026-03-29 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9959/20389959/interior_dashboard-1774696197835.jpg> (referer: None)
2026-03-29 20:08:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9959/20389959/interior_rear_seats-1774696163946.jpg> (referer: None)
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf1fe10>
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1913%252F20171913%252Fwheels_front_driver-1773741740302.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1913/20171913/wheels_front_driver-1773741740302.jpg saved to cache
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84b4e10>
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7343%252F20487343%252Fexterior_rear_passenger-1774700833007.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_rear_passenger-1774700833007.jpg saved to cache
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f83e5210>
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7343%252F20487343%252Finterior_front_seats-1774701762983.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7343/20487343/interior_front_seats-1774701762983.jpg saved to cache
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f948c390>
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9959%252F20389959%252Finterior_dashboard-1774696197835.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9959/20389959/interior_dashboard-1774696197835.jpg saved to cache
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebec7d50>
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9959%252F20389959%252Finterior_rear_seats-1774696163946.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9959/20389959/interior_rear_seats-1774696163946.jpg saved to cache
2026-03-29 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63
2026-03-29 20:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_front_driver-1774700739414.jpg> (referer: None)
2026-03-29 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1913/20171913/interior_dashboard-1774546882083.jpg> (referer: None)
2026-03-29 20:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1913/20171913/instrument_cluster-1774546153394.jpg> (referer: None)
2026-03-29 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_rear_driver-1774700812719.jpg> (referer: None)
2026-03-29 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_rear_driver-1774709468772.jpg> (referer: None)
2026-03-29 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_front_passenger-1774709513303.jpg> (referer: None)
2026-03-29 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_rear_passenger-1774709480450.jpg> (referer: None)
2026-03-29 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_front_passenger-1774700786323.jpg> (referer: None)
2026-03-29 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9959/20389959/interior_front_seats-1774696132328.jpg> (referer: None)
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f83e56d0>
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7343%252F20487343%252Fexterior_front_driver-1774700739414.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_front_driver-1774700739414.jpg saved to cache
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfea5d0>
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1913%252F20171913%252Finterior_dashboard-1774546882083.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1913/20171913/interior_dashboard-1774546882083.jpg saved to cache
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebed5c50>
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1913%252F20171913%252Finstrument_cluster-1774546153394.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1913/20171913/instrument_cluster-1774546153394.jpg saved to cache
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8281710>
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7343%252F20487343%252Fexterior_rear_driver-1774700812719.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_rear_driver-1774700812719.jpg saved to cache
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9266cd0>
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9959%252F20389959%252Fexterior_rear_driver-1774709468772.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_rear_driver-1774709468772.jpg saved to cache
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae2ee10>
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9959%252F20389959%252Fexterior_front_passenger-1774709513303.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_front_passenger-1774709513303.jpg saved to cache
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebed7790>
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9959%252F20389959%252Fexterior_rear_passenger-1774709480450.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_rear_passenger-1774709480450.jpg saved to cache
2026-03-29 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf24710>
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7343%252F20487343%252Fexterior_front_passenger-1774700786323.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_front_passenger-1774700786323.jpg saved to cache
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca
2026-03-29 20:08:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca, skipping ID generation
2026-03-29 20:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca with scrape type 1
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca sending to next pipeline
2026-03-29 20:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca, identifier: 20487343
2026-03-29 20:08:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebec6d90>
2026-03-29 20:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9959%252F20389959%252Finterior_front_seats-1774696132328.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9959/20389959/interior_front_seats-1774696132328.jpg saved to cache
2026-03-29 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63
2026-03-29 20:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca with identifier: 20487343
2026-03-29 20:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca with identifier: 20487343
2026-03-29 20:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 07f5c09c-dba7-5d5a-8e14-eb83019ba7ca with identifier: 20487343 to the API
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_front_passenger-1774700786323.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '07f5c09c-dba7-5d5a-8e14-eb83019ba7ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VE17 BKF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487343',
'listing': 'auction',
'location': 'Nottinghamshire Worksop',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 78361,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1837530,
'Height': 2680,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_front_driver-1774700739414.jpg',
'Width': 3573},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1388035,
'Height': 2322,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_rear_driver-1774700812719.jpg',
'Width': 3096},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1684318,
'Height': 2690,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_front_passenger-1774700786323.jpg',
'Width': 3587},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1682471,
'Height': 2483,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7343/20487343/exterior_rear_passenger-1774700833007.jpg',
'Width': 3311},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3678553,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7343/20487343/interior_front_seats-1774701762983.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4318028,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7343/20487343/interior_rear_seats-1774701778511.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2156700,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7343/20487343/interior_dashboard-1774701808480.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3292984,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7343/20487343/interior_boot-1774701815916.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1357162,
'Height': 1560,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7343/20487343/docs_service_history-1774701904021.jpg?ixlib=js-3.8.0&auto=format&s=2259b625bd12f02672828a8ad97baa91',
'Width': 2073},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07f5c09c-dba7-5d5a-8e14-eb83019ba7ca/07f5c09c-dba7-5d5a-8e14-eb83019ba7ca_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2268042,
'Height': 2488,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7343/20487343/docs_service_history-1774701905396.jpg?ixlib=js-3.8.0&auto=format&s=2ab7165c3a2ea425ba39d907b76ade39',
'Width': 2640}],
'price': 6546,
'price_includes_vat': False,
'registration_date': '2017-05-31',
'seats_number': None,
'seller_name': None,
'title': 'Nissan X-Trail Tekna DCI 4X4',
'transmission': 'manual',
'trim': 'Tekna DCI 4X4',
'vin': 'JN1TFNT32U0005673',
'year': 2017}
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487343%27 HTTP/1.1" 200 None
2026-03-29 20:08:02 [motorway.uk] INFO: Saving data for 20487343: {'created_time': 1774814882.844829, 'last_price_update_time': 1774814882.84484, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487343') HTTP/1.1" 204 0
2026-03-29 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1440&page=40&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1913/20171913/exterior_rear_passenger-1773741659487.jpg> (referer: None)
2026-03-29 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1913/20171913/exterior_front_passenger-1774546625297.jpg> (referer: None)
2026-03-29 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1913/20171913/interior_front_seats-1774546607301.jpg> (referer: None)
2026-03-29 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_front_driver-1774709448325.jpg> (referer: None)
2026-03-29 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1913/20171913/interior_rear_seats-1773742208325.jpg> (referer: None)
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 13194088
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 20307939
2026-03-29 20:08:02 [motorway.uk] INFO: Found listing with ID: 14034746
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714034746%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [motorway.uk] INFO: Scrape type for 14034746: 1
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 20338819
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 12525227
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 15408464
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 19652736
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 19998992
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 16324421
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 20402579
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720402579%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [motorway.uk] INFO: Scrape type for 20402579: 1
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 15712620
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 19937895
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 20343893
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720343893%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [motorway.uk] INFO: Scrape type for 20343893: 1
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94cfe50>
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1913%252F20171913%252Fexterior_rear_passenger-1773741659487.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1913/20171913/exterior_rear_passenger-1773741659487.jpg saved to cache
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 19863425
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 20374139
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720374139%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [motorway.uk] INFO: Scrape type for 20374139: 1
2026-03-29 20:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1913/20171913/exterior_front_driver-1773741665487.jpg> (referer: None)
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f2a290>
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1913%252F20171913%252Fexterior_front_passenger-1774546625297.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1913/20171913/exterior_front_passenger-1774546625297.jpg saved to cache
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84d6610>
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1913%252F20171913%252Finterior_front_seats-1774546607301.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1913/20171913/interior_front_seats-1774546607301.jpg saved to cache
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfe4f10>
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9959%252F20389959%252Fexterior_front_driver-1774709448325.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_front_driver-1774709448325.jpg saved to cache
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63
2026-03-29 20:08:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a234e4c-57d4-59e1-b39e-eeb4991b4d63, skipping ID generation
2026-03-29 20:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63 with scrape type 1
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a234e4c-57d4-59e1-b39e-eeb4991b4d63 sending to next pipeline
2026-03-29 20:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9a234e4c-57d4-59e1-b39e-eeb4991b4d63, identifier: 20389959
2026-03-29 20:08:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:03 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:08:03 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S938B\x00'
2026-03-29 20:08:03 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:08:03 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S938BXXS8BZB5\x00'
2026-03-29 20:08:03 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:08:03 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:08:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:08:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:03 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:17 10:08:27\x00'
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9209c10>
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1913%252F20171913%252Finterior_rear_seats-1773742208325.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1913/20171913/interior_rear_seats-1773742208325.jpg saved to cache
2026-03-29 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 20447541
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 20096245
2026-03-29 20:08:03 [motorway.uk] INFO: Found listing with ID: 8969713
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278969713%27 HTTP/1.1" 200 None
2026-03-29 20:08:03 [motorway.uk] INFO: Scrape type for 8969713: 1
2026-03-29 20:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9a234e4c-57d4-59e1-b39e-eeb4991b4d63 with identifier: 20389959
2026-03-29 20:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9a234e4c-57d4-59e1-b39e-eeb4991b4d63 with identifier: 20389959
2026-03-29 20:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9a234e4c-57d4-59e1-b39e-eeb4991b4d63 with identifier: 20389959 to the API
2026-03-29 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_front_driver-1774709448325.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.7L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '9a234e4c-57d4-59e1-b39e-eeb4991b4d63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'CK67 UXE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20389959',
'listing': 'auction',
'location': 'Merseyside Liverpool',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 71409,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2114735,
'Height': 2960,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_front_driver-1774709448325.jpg',
'Width': 3947},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1504450,
'Height': 2312,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_rear_driver-1774709468772.jpg',
'Width': 3082},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1989360,
'Height': 2822,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_front_passenger-1774709513303.jpg',
'Width': 3763},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2103958,
'Height': 2830,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9959/20389959/exterior_rear_passenger-1774709480450.jpg',
'Width': 3773},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3873653,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9959/20389959/interior_front_seats-1774696132328.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3925696,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9959/20389959/interior_rear_seats-1774696163946.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3980165,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9959/20389959/interior_dashboard-1774696197835.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2270400,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9959/20389959/instrument_cluster-1774696217162.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4127120,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9959/20389959/interior_boot-1774696222949.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a234e4c-57d4-59e1-b39e-eeb4991b4d63/9a234e4c-57d4-59e1-b39e-eeb4991b4d63_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 567610,
'Height': 2198,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9959/20389959/docs_service_history-1774696473767.jpg?ixlib=js-3.8.0&auto=format&s=6d86debcc6dc45d03ea1270b9cb8f086',
'Width': 2840}],
'price': 8604,
'price_includes_vat': False,
'registration_date': '2017-12-19',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Tucson Sport ED 2WD CRDI S-A',
'transmission': 'automatic',
'trim': 'Sport ED 2WD CRDI S-A',
'vin': 'TMAJ3815VJJ480362',
'year': 2017}
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720389959%27 HTTP/1.1" 200 None
2026-03-29 20:08:04 [motorway.uk] INFO: Saving data for 20389959: {'created_time': 1774814884.132425, 'last_price_update_time': 1774814884.132438, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20389959') HTTP/1.1" 204 0
2026-03-29 20:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20417464.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:04 [motorway.uk] INFO: Found listing with ID: 20187846
2026-03-29 20:08:04 [motorway.uk] INFO: Found listing with ID: 15023759
2026-03-29 20:08:04 [motorway.uk] INFO: Found listing with ID: 20483861
2026-03-29 20:08:04 [motorway.uk] INFO: Found listing with ID: 20488363
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488363%27 HTTP/1.1" 200 None
2026-03-29 20:08:04 [motorway.uk] INFO: Scrape type for 20488363: 1
2026-03-29 20:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f891b690>
2026-03-29 20:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1913%252F20171913%252Fexterior_front_driver-1773741665487.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1913/20171913/exterior_front_driver-1773741665487.jpg saved to cache
2026-03-29 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2
2026-03-29 20:08:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b68b803-a153-55b0-a7f6-62ffc5b104b2, skipping ID generation
2026-03-29 20:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2 with scrape type 1
2026-03-29 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b68b803-a153-55b0-a7f6-62ffc5b104b2 sending to next pipeline
2026-03-29 20:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0b68b803-a153-55b0-a7f6-62ffc5b104b2, identifier: 20171913
2026-03-29 20:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0b68b803-a153-55b0-a7f6-62ffc5b104b2 with identifier: 20171913
2026-03-29 20:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0b68b803-a153-55b0-a7f6-62ffc5b104b2 with identifier: 20171913
2026-03-29 20:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0b68b803-a153-55b0-a7f6-62ffc5b104b2 with identifier: 20171913 to the API
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1913/20171913/exterior_front_driver-1773741665487.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '0b68b803-a153-55b0-a7f6-62ffc5b104b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CLZ 929',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20171913',
'listing': 'auction',
'location': 'Lancashire Accrington',
'make': 'Audi',
'model': 'A8',
'odometer': 103500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 961919,
'Height': 1879,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1913/20171913/exterior_front_driver-1773741665487.jpg',
'Width': 2505},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1436530,
'Height': 2270,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1913/20171913/exterior_rear_driver-1773741660811.jpg',
'Width': 3027},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1316127,
'Height': 2475,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1913/20171913/exterior_front_passenger-1774546625297.jpg',
'Width': 3300},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1099856,
'Height': 2277,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1913/20171913/exterior_rear_passenger-1773741659487.jpg',
'Width': 3036},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1586177,
'Height': 2729,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1913/20171913/interior_front_seats-1774546607301.jpg',
'Width': 3639},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5735335,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/1913/20171913/interior_rear_seats-1773742208325.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1071162,
'Height': 2355,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1913/20171913/interior_dashboard-1774546882083.jpg',
'Width': 3140},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1216511,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1913/20171913/instrument_cluster-1774546153394.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8133337,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/1913/20171913/interior_boot-1773742197225.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b68b803-a153-55b0-a7f6-62ffc5b104b2/0b68b803-a153-55b0-a7f6-62ffc5b104b2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 939397,
'Height': 1889,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1913/20171913/wheels_front_driver-1773741740302.jpg',
'Width': 2519}],
'price': 14275,
'price_includes_vat': False,
'registration_date': '2018-12-31',
'seats_number': None,
'seller_name': None,
'title': 'Audi A8 50 TDI Quattro Auto',
'transmission': 'automatic',
'trim': '50 TDI Quattro Auto',
'vin': 'WAUZZZF80JN014299',
'year': 2018}
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720171913%27 HTTP/1.1" 200 None
2026-03-29 20:08:04 [motorway.uk] INFO: Saving data for 20171913: {'created_time': 1774814884.853714, 'last_price_update_time': 1774814884.853724, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20171913') HTTP/1.1" 204 0
2026-03-29 20:08:04 [motorway.uk] INFO: Found listing with ID: 18488723
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718488723%27 HTTP/1.1" 200 None
2026-03-29 20:08:04 [motorway.uk] INFO: Scrape type for 18488723: 1
2026-03-29 20:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20502332.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:04 [motorway.uk] INFO: Found listing with ID: 19333728
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719333728%27 HTTP/1.1" 200 None
2026-03-29 20:08:04 [motorway.uk] INFO: Scrape type for 19333728: 1
2026-03-29 20:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2278/11012278/docs_service_history-1774702209271.jpg?ixlib=js-3.8.0&auto=format&s=c3a537c7bd15f5b642c42bc68a72a93f> (referer: None)
2026-03-29 20:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c918b564-9ffe-5877-8970-b8ff9bffee8f with identifier: 20417464
2026-03-29 20:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c918b564-9ffe-5877-8970-b8ff9bffee8f with scrape type 1
2026-03-29 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c918b564-9ffe-5877-8970-b8ff9bffee8f
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7464%252F20417464%252Fexterior_front_driver-1774339777959.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_front_driver-1774339777959.jpg not downloaded yet
2026-03-29 20:08:04 [motorway.uk] INFO: Found listing with ID: 20373131
2026-03-29 20:08:04 [motorway.uk] INFO: Found listing with ID: 15015635
2026-03-29 20:08:04 [motorway.uk] INFO: Found listing with ID: 19288107
2026-03-29 20:08:04 [motorway.uk] INFO: Found listing with ID: 20487830
2026-03-29 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487830%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [motorway.uk] INFO: Scrape type for 20487830: 1
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7464%252F20417464%252Fexterior_rear_driver-1774339808190.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_rear_driver-1774339808190.jpg not downloaded yet
2026-03-29 20:08:05 [motorway.uk] INFO: Found listing with ID: 20064722
2026-03-29 20:08:05 [motorway.uk] INFO: Found listing with ID: 17810245
2026-03-29 20:08:05 [motorway.uk] INFO: Found listing with ID: 17844342
2026-03-29 20:08:05 [motorway.uk] INFO: Found listing with ID: 20159342
2026-03-29 20:08:05 [motorway.uk] INFO: Found listing with ID: 20367432
2026-03-29 20:08:05 [motorway.uk] INFO: Found listing with ID: 19709380
2026-03-29 20:08:05 [motorway.uk] INFO: Found listing with ID: 18256517
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718256517%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [motorway.uk] INFO: Scrape type for 18256517: 1
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7464%252F20417464%252Fexterior_front_passenger-1774339856516.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_front_passenger-1774339856516.jpg not downloaded yet
2026-03-29 20:08:05 [motorway.uk] INFO: Found listing with ID: 20246067
2026-03-29 20:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24ecfa21-23ac-52ac-8997-2524c5af1f5e with identifier: 20502332
2026-03-29 20:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e with scrape type 1
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2332%252F20502332%252Fexterior_front_driver-1774786624968.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_front_driver-1774786624968.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7464%252F20417464%252Fexterior_rear_passenger-1774339836616.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_rear_passenger-1774339836616.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2332%252F20502332%252Fexterior_rear_driver-1774786641223.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_rear_driver-1774786641223.jpg not downloaded yet
2026-03-29 20:08:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f92770d0>
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2278%252F11012278%252Fdocs_service_history-1774702209271.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc3a537c7bd15f5b642c42bc68a72a93f') HTTP/1.1" 204 0
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2278/11012278/docs_service_history-1774702209271.jpg?ixlib=js-3.8.0&auto=format&s=c3a537c7bd15f5b642c42bc68a72a93f saved to cache
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7464%252F20417464%252Finterior_front_seats-1774340216933.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7464/20417464/interior_front_seats-1774340216933.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2332%252F20502332%252Fexterior_front_passenger-1774786674558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_front_passenger-1774786674558.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7464%252F20417464%252Finterior_rear_seats-1774340235657.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7464/20417464/interior_rear_seats-1774340235657.jpg not downloaded yet
2026-03-29 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19182202.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2332%252F20502332%252Fexterior_rear_passenger-1774786653687.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_rear_passenger-1774786653687.jpg not downloaded yet
2026-03-29 20:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2278/11012278/docs_service_history-1774702183646.jpg?ixlib=js-3.8.0&auto=format&s=23f50d046c202053aba24e53d5be58e8> (referer: None)
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7464%252F20417464%252Finterior_dashboard-1774779413487.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7464/20417464/interior_dashboard-1774779413487.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2332%252F20502332%252Finterior_front_seats-1774787073690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2332/20502332/interior_front_seats-1774787073690.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7464%252F20417464%252Finstrument_cluster-1774340320332.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7464/20417464/instrument_cluster-1774340320332.jpg not downloaded yet
2026-03-29 20:08:05 [scrapy.extensions.logstats] INFO: Crawled 347 pages (at 48 pages/min), scraped 185 items (at 25 items/min)
2026-03-29 20:08:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 309MiB
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2332%252F20502332%252Finterior_rear_seats-1774787090641.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2332/20502332/interior_rear_seats-1774787090641.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7464%252F20417464%252Finterior_boot-1774340297153.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7464/20417464/interior_boot-1774340297153.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2332%252F20502332%252Finterior_dashboard-1774787167348.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2332/20502332/interior_dashboard-1774787167348.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7464%252F20417464%252Fdocs_service_history-1774673984639.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db5d5c3a78202a77e12acc1489f39d904%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7464/20417464/docs_service_history-1774673984639.jpg?ixlib=js-3.8.0&auto=format&s=b5d5c3a78202a77e12acc1489f39d904 not downloaded yet
2026-03-29 20:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efcf04b4-eb56-533f-86b2-e1e3275c0e93 with identifier: 19182202
2026-03-29 20:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efcf04b4-eb56-533f-86b2-e1e3275c0e93 with scrape type 1
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efcf04b4-eb56-533f-86b2-e1e3275c0e93
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2202%252F19182202%252Fexterior_front_driver-1774107385017.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_front_driver-1774107385017.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2332%252F20502332%252Finstrument_cluster-1774787168846.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2332/20502332/instrument_cluster-1774787168846.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2202%252F19182202%252Fexterior_rear_driver-1774107341747.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_rear_driver-1774107341747.jpg not downloaded yet
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa11bfd0>
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2278%252F11012278%252Fdocs_service_history-1774702183646.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D23f50d046c202053aba24e53d5be58e8') HTTP/1.1" 204 0
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2278/11012278/docs_service_history-1774702183646.jpg?ixlib=js-3.8.0&auto=format&s=23f50d046c202053aba24e53d5be58e8 saved to cache
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2332%252F20502332%252Finterior_boot-1774787120582.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2332/20502332/interior_boot-1774787120582.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2202%252F19182202%252Fexterior_front_passenger-1774107369694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_front_passenger-1774107369694.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2332%252F20502332%252Fdocs_service_history-1774787327211.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da88fcf30e5c7a856faf8baba0158fe16%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2332/20502332/docs_service_history-1774787327211.jpg?ixlib=js-3.8.0&auto=format&s=a88fcf30e5c7a856faf8baba0158fe16 not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2202%252F19182202%252Fexterior_rear_passenger-1774107353667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_rear_passenger-1774107353667.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2202%252F19182202%252Finterior_front_seats-1774629176067.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2202/19182202/interior_front_seats-1774629176067.jpg not downloaded yet
2026-03-29 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20098206.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2278/11012278/interior_dashboard-1774702851615.jpg> (referer: None)
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2202%252F19182202%252Finterior_rear_seats-1774629233295.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2202/19182202/interior_rear_seats-1774629233295.jpg not downloaded yet
2026-03-29 20:08:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2202%252F19182202%252Finterior_dashboard-1774702518894.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2202/19182202/interior_dashboard-1774702518894.jpg not downloaded yet
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2202%252F19182202%252Finstrument_cluster-1774108362600.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2202/19182202/instrument_cluster-1774108362600.jpg not downloaded yet
2026-03-29 20:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8ced341-9016-5a8d-869c-42308ec46825 with identifier: 20098206
2026-03-29 20:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8ced341-9016-5a8d-869c-42308ec46825 with scrape type 2
2026-03-29 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8ced341-9016-5a8d-869c-42308ec46825 with scrape type 2
2026-03-29 20:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a8ced341-9016-5a8d-869c-42308ec46825, identifier: 20098206
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9600b90>
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2278%252F11012278%252Finterior_dashboard-1774702851615.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2278/11012278/interior_dashboard-1774702851615.jpg saved to cache
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2202%252F19182202%252Finterior_boot-1774108116507.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2202/19182202/interior_boot-1774108116507.jpg not downloaded yet
2026-03-29 20:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a8ced341-9016-5a8d-869c-42308ec46825 with identifier: 20098206
2026-03-29 20:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a8ced341-9016-5a8d-869c-42308ec46825 with identifier: 20098206
2026-03-29 20:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a8ced341-9016-5a8d-869c-42308ec46825 with identifier: 20098206 to the API
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20098206.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'a8ced341-9016-5a8d-869c-42308ec46825',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HXZ 5733',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20098206',
'listing': 'auction',
'location': 'Newry, Mourne And Down Newry',
'make': 'Toyota',
'model': 'Auris',
'odometer': 32614,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 8709,
'price_includes_vat': False,
'registration_date': '2015-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Auris Excel VVT-i CVT',
'transmission': 'automatic',
'trim': 'Excel VVT-i CVT',
'vin': 'SB1MS3JE70E153697',
'year': 2015}
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720098206%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [motorway.uk] INFO: Saving data for 20098206: {'auction_closing_time': 1774884600.0, 'created_time': 1774728183.322814, 'last_price_update_time': 1774814886.52706}
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20098206') HTTP/1.1" 204 0
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2202%252F19182202%252Fdocs_service_history-1774277326225.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da0a0283dadc59db8191963b3b33c8d7d%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2202/19182202/docs_service_history-1774277326225.jpg?ixlib=js-3.8.0&auto=format&s=a0a0283dadc59db8191963b3b33c8d7d not downloaded yet
2026-03-29 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20402109.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_rear_passenger-1774107353667.jpg> (referer: None)
2026-03-29 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_front_passenger-1774786674558.jpg> (referer: None)
2026-03-29 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2278/11012278/interior_boot-1774700898194.jpg> (referer: None)
2026-03-29 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7464/20417464/interior_rear_seats-1774340235657.jpg> (referer: None)
2026-03-29 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2202/19182202/interior_front_seats-1774629176067.jpg> (referer: None)
2026-03-29 20:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d360b184-71d7-5a14-bba8-7a136df92017 with identifier: 20402109
2026-03-29 20:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d360b184-71d7-5a14-bba8-7a136df92017 with scrape type 1
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d360b184-71d7-5a14-bba8-7a136df92017
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2109%252F20402109%252Fexterior_front_driver-1774696604912.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_front_driver-1774696604912.jpg not downloaded yet
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2109%252F20402109%252Fexterior_rear_driver-1774696619636.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_rear_driver-1774696619636.jpg not downloaded yet
2026-03-29 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2202/19182202/docs_service_history-1774277326225.jpg?ixlib=js-3.8.0&auto=format&s=a0a0283dadc59db8191963b3b33c8d7d> (referer: None)
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2109%252F20402109%252Fexterior_front_passenger-1774696649705.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_front_passenger-1774696649705.jpg not downloaded yet
2026-03-29 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20496195.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f863d390>
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2202%252F19182202%252Fexterior_rear_passenger-1774107353667.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_rear_passenger-1774107353667.jpg saved to cache
2026-03-29 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efcf04b4-eb56-533f-86b2-e1e3275c0e93
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facc1d50>
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2332%252F20502332%252Fexterior_front_passenger-1774786674558.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_front_passenger-1774786674558.jpg saved to cache
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f919bc10>
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2278%252F11012278%252Finterior_boot-1774700898194.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2278/11012278/interior_boot-1774700898194.jpg saved to cache
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8862d10>
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7464%252F20417464%252Finterior_rear_seats-1774340235657.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7464/20417464/interior_rear_seats-1774340235657.jpg saved to cache
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c918b564-9ffe-5877-8970-b8ff9bffee8f
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafbb750>
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2202%252F19182202%252Finterior_front_seats-1774629176067.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2202/19182202/interior_front_seats-1774629176067.jpg saved to cache
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efcf04b4-eb56-533f-86b2-e1e3275c0e93
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2109%252F20402109%252Fexterior_rear_passenger-1774696682416.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_rear_passenger-1774696682416.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2109%252F20402109%252Finterior_front_seats-1774697186533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2109/20402109/interior_front_seats-1774697186533.jpg not downloaded yet
2026-03-29 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16857916.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f894d750>
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2202%252F19182202%252Fdocs_service_history-1774277326225.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da0a0283dadc59db8191963b3b33c8d7d') HTTP/1.1" 204 0
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2202/19182202/docs_service_history-1774277326225.jpg?ixlib=js-3.8.0&auto=format&s=a0a0283dadc59db8191963b3b33c8d7d saved to cache
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item efcf04b4-eb56-533f-86b2-e1e3275c0e93
2026-03-29 20:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc4c82c5-cd98-500b-8281-51819578e163 with identifier: 20496195
2026-03-29 20:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc4c82c5-cd98-500b-8281-51819578e163 with scrape type 1
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc4c82c5-cd98-500b-8281-51819578e163
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6195%252F20496195%252Fexterior_front_driver-1774771753814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_front_driver-1774771753814.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2109%252F20402109%252Finterior_rear_seats-1774697243900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2109/20402109/interior_rear_seats-1774697243900.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6195%252F20496195%252Fexterior_rear_driver-1774771916491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_rear_driver-1774771916491.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2109%252F20402109%252Finterior_dashboard-1774697311384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2109/20402109/interior_dashboard-1774697311384.jpg not downloaded yet
2026-03-29 20:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a98941ea-7b61-540d-8fcc-baa07bc55dba with identifier: 16857916
2026-03-29 20:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a98941ea-7b61-540d-8fcc-baa07bc55dba with scrape type 1
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a98941ea-7b61-540d-8fcc-baa07bc55dba
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7916%252F16857916%252Fexterior_front_driver-1774687348812.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_front_driver-1774687348812.jpeg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6195%252F20496195%252Fexterior_front_passenger-1774771787911.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_front_passenger-1774771787911.jpg not downloaded yet
2026-03-29 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8969713.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20473412.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2109%252F20402109%252Finstrument_cluster-1774697295576.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2109/20402109/instrument_cluster-1774697295576.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7916%252F16857916%252Fexterior_rear_driver-1774687341229.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_rear_driver-1774687341229.jpeg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6195%252F20496195%252Fexterior_rear_passenger-1774771815594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_rear_passenger-1774771815594.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2109%252F20402109%252Finterior_boot-1774697468259.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2109/20402109/interior_boot-1774697468259.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7916%252F16857916%252Fexterior_front_passenger-1774687319749.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_front_passenger-1774687319749.jpeg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6195%252F20496195%252Finterior_front_seats-1774772069301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6195/20496195/interior_front_seats-1774772069301.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2109%252F20402109%252Fdocs_service_history-1774697681356.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2f5f65c64415d668edbdecd41c42ad54%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2109/20402109/docs_service_history-1774697681356.jpg?ixlib=js-3.8.0&auto=format&s=2f5f65c64415d668edbdecd41c42ad54 not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7916%252F16857916%252Fexterior_rear_passenger-1774687347618.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_rear_passenger-1774687347618.jpeg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6195%252F20496195%252Finterior_rear_seats-1774772081340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6195/20496195/interior_rear_seats-1774772081340.jpg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7916%252F16857916%252Finterior_front_seats-1774687712637.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7916/16857916/interior_front_seats-1774687712637.jpeg not downloaded yet
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6195%252F20496195%252Finterior_dashboard-1774772533629.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6195/20496195/interior_dashboard-1774772533629.jpg not downloaded yet
2026-03-29 20:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12c39fd4-4285-546f-ac27-0719c42d1e8f with identifier: 8969713
2026-03-29 20:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12c39fd4-4285-546f-ac27-0719c42d1e8f with scrape type 1
2026-03-29 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12c39fd4-4285-546f-ac27-0719c42d1e8f
2026-03-29 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9713%252F8969713%252F8969713-exterior_front_driver-modified-1774627108104.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9713/8969713/8969713-exterior_front_driver-modified-1774627108104.jpeg not downloaded yet
2026-03-29 20:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 613ee332-5aba-513c-904b-51832af61a86 with identifier: 20473412
2026-03-29 20:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 613ee332-5aba-513c-904b-51832af61a86 with scrape type 1
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 613ee332-5aba-513c-904b-51832af61a86
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3412%252F20473412%252Fexterior_front_driver-1774783596983.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_front_driver-1774783596983.jpeg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7916%252F16857916%252Finterior_rear_seats-1774687765635.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7916/16857916/interior_rear_seats-1774687765635.jpeg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6195%252F20496195%252Finstrument_cluster-1774772174292.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6195/20496195/instrument_cluster-1774772174292.jpg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9713%252F8969713%252Fexterior_rear_driver-1774625028646.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9713/8969713/exterior_rear_driver-1774625028646.jpg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3412%252F20473412%252Fexterior_rear_driver-1774783639194.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_rear_driver-1774783639194.jpeg not downloaded yet
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2202/19182202/interior_dashboard-1774702518894.jpg> (referer: None)
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7916%252F16857916%252F16857916-interior_dashboard-modified-1774689097161.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7916/16857916/16857916-interior_dashboard-modified-1774689097161.jpeg not downloaded yet
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20374139.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6195%252F20496195%252Finterior_boot-1774772137424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6195/20496195/interior_boot-1774772137424.jpg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9713%252F8969713%252Fexterior_front_passenger-1774624952298.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9713/8969713/exterior_front_passenger-1774624952298.jpg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3412%252F20473412%252Fexterior_front_passenger-1774783604807.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_front_passenger-1774783604807.jpeg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7916%252F16857916%252F16857916-instrument_cluster-modified-1774689168790.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7916/16857916/16857916-instrument_cluster-modified-1774689168790.jpeg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6195%252F20496195%252Fdocs_service_history-1774772789013.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D393f3914d6fec3ef7041a33d91b36511%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6195/20496195/docs_service_history-1774772789013.jpg?ixlib=js-3.8.0&auto=format&s=393f3914d6fec3ef7041a33d91b36511 not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9713%252F8969713%252Fexterior_rear_passenger-1774624999817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9713/8969713/exterior_rear_passenger-1774624999817.jpg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3412%252F20473412%252Fexterior_rear_passenger-1774783618302.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_rear_passenger-1774783618302.jpeg not downloaded yet
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2202/19182202/instrument_cluster-1774108362600.jpg> (referer: None)
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7916%252F16857916%252F16857916-interior_boot-modified-1774689145192.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7916/16857916/16857916-interior_boot-modified-1774689145192.jpeg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9713%252F8969713%252Finterior_front_seats-1774625324395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9713/8969713/interior_front_seats-1774625324395.jpg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3412%252F20473412%252Finterior_front_seats-1774783788253.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3412/20473412/interior_front_seats-1774783788253.jpeg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7916%252F16857916%252Fdocs_service_history-1774688370011.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D916e9aba5e00e8547198be4b6612b3ee%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7916/16857916/docs_service_history-1774688370011.jpeg?ixlib=js-3.8.0&auto=format&s=916e9aba5e00e8547198be4b6612b3ee not downloaded yet
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faecc950>
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2202%252F19182202%252Finterior_dashboard-1774702518894.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2202/19182202/interior_dashboard-1774702518894.jpg saved to cache
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efcf04b4-eb56-533f-86b2-e1e3275c0e93
2026-03-29 20:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8 with identifier: 20374139
2026-03-29 20:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8 with scrape type 1
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4139%252F20374139%252Fexterior_front_driver-1774708879391.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_front_driver-1774708879391.jpg not downloaded yet
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_front_driver-1774687348812.jpeg> (referer: None)
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9713%252F8969713%252Finterior_rear_seats-1774625147117.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9713/8969713/interior_rear_seats-1774625147117.jpg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3412%252F20473412%252Finterior_rear_seats-1774783897933.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3412/20473412/interior_rear_seats-1774783897933.jpeg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4139%252F20374139%252Fexterior_rear_driver-1774708888686.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_rear_driver-1774708888686.jpg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9713%252F8969713%252Finterior_dashboard-1774625201676.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9713/8969713/interior_dashboard-1774625201676.jpg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3412%252F20473412%252Finterior_dashboard-1774783926705.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3412/20473412/interior_dashboard-1774783926705.jpeg not downloaded yet
2026-03-29 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20343893.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4139%252F20374139%252Fexterior_front_passenger-1774708769286.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_front_passenger-1774708769286.jpg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9713%252F8969713%252Finstrument_cluster-1774625230559.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9713/8969713/instrument_cluster-1774625230559.jpg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3412%252F20473412%252Finstrument_cluster-1774783967744.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3412/20473412/instrument_cluster-1774783967744.jpeg not downloaded yet
2026-03-29 20:08:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f825b050>
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2202%252F19182202%252Finstrument_cluster-1774108362600.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2202/19182202/instrument_cluster-1774108362600.jpg saved to cache
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efcf04b4-eb56-533f-86b2-e1e3275c0e93
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4139%252F20374139%252Fexterior_rear_passenger-1774708724649.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_rear_passenger-1774708724649.jpg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9713%252F8969713%252Finterior_boot-1774625273694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9713/8969713/interior_boot-1774625273694.jpg not downloaded yet
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3412%252F20473412%252Finterior_boot-1774783958854.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3412/20473412/interior_boot-1774783958854.jpeg not downloaded yet
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa186490>
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7916%252F16857916%252Fexterior_front_driver-1774687348812.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_front_driver-1774687348812.jpeg saved to cache
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a98941ea-7b61-540d-8fcc-baa07bc55dba
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4139%252F20374139%252Finterior_front_seats-1774711350993.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4139/20374139/interior_front_seats-1774711350993.jpg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9713%252F8969713%252F8969713-docs_service_history-default-1774217267064.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De16a06f110947b6e56b87075458a594a%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9713/8969713/8969713-docs_service_history-default-1774217267064.jpg?ixlib=js-3.8.0&auto=format&s=e16a06f110947b6e56b87075458a594a not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3412%252F20473412%252Fdamage_scratches-1774784068680.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3412/20473412/damage_scratches-1774784068680.jpeg not downloaded yet
2026-03-29 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20402579.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4293c30d-723b-53a6-ba49-a06c447f0246 with identifier: 20343893
2026-03-29 20:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4293c30d-723b-53a6-ba49-a06c447f0246 with scrape type 1
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4293c30d-723b-53a6-ba49-a06c447f0246
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3893%252F20343893%252Fexterior_front_driver-1774525042118.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_front_driver-1774525042118.jpg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4139%252F20374139%252Finterior_rear_seats-1774711428852.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4139/20374139/interior_rear_seats-1774711428852.jpg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3893%252F20343893%252Fexterior_rear_driver-1774267966099.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_rear_driver-1774267966099.jpg not downloaded yet
2026-03-29 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_front_passenger-1774696649705.jpg> (referer: None)
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4139%252F20374139%252F20374139-interior_dashboard-modified-1774772423395.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4139/20374139/20374139-interior_dashboard-modified-1774772423395.jpeg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3893%252F20343893%252Fexterior_front_passenger-1774609106622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_front_passenger-1774609106622.jpg not downloaded yet
2026-03-29 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18488723.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9810a24-2233-526d-9ced-55a079645b4f with identifier: 20402579
2026-03-29 20:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9810a24-2233-526d-9ced-55a079645b4f with scrape type 1
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9810a24-2233-526d-9ced-55a079645b4f
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2579%252F20402579%252Fexterior_front_driver-1774267081874.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2579/20402579/exterior_front_driver-1774267081874.jpg not downloaded yet
2026-03-29 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_rear_passenger-1774696682416.jpg> (referer: None)
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4139%252F20374139%252Finterior_boot-1774711813840.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4139/20374139/interior_boot-1774711813840.jpg not downloaded yet
2026-03-29 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_rear_driver-1774696619636.jpg> (referer: None)
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3893%252F20343893%252Fexterior_rear_passenger-1774450095323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_rear_passenger-1774450095323.jpg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20402579%252Fexterior_rear_driver-1774264571136.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20402579/exterior_rear_driver-1774264571136.jpg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4139%252F20374139%252F20374139-docs_service_history-modified-1774774429605.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7f377851501c4492c450844b8a4d6ac2%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4139/20374139/20374139-docs_service_history-modified-1774774429605.jpeg?ixlib=js-3.8.0&auto=format&s=7f377851501c4492c450844b8a4d6ac2 not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3893%252F20343893%252Finterior_front_seats-1774609081803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3893/20343893/interior_front_seats-1774609081803.jpg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20402579%252Fexterior_front_passenger-1774264548352.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20402579/exterior_front_passenger-1774264548352.jpg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4139%252F20374139%252Fdamage_paintwork-1774709045989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4139/20374139/damage_paintwork-1774709045989.jpg not downloaded yet
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f870da90>
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2109%252F20402109%252Fexterior_front_passenger-1774696649705.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_front_passenger-1774696649705.jpg saved to cache
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d360b184-71d7-5a14-bba8-7a136df92017
2026-03-29 20:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13 with identifier: 18488723
2026-03-29 20:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13 with scrape type 1
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F18488723%252Fexterior_front_driver-1769868561369.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_front_driver-1769868561369.jpeg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3893%252F20343893%252Finterior_rear_seats-1774457313975.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3893/20343893/interior_rear_seats-1774457313975.jpg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20402579%252Fexterior_rear_passenger-1774264531472.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20402579/exterior_rear_passenger-1774264531472.jpg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F18488723%252Fexterior_rear_driver-1769868680872.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_rear_driver-1769868680872.jpeg not downloaded yet
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f924c9d0>
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2109%252F20402109%252Fexterior_rear_passenger-1774696682416.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_rear_passenger-1774696682416.jpg saved to cache
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d360b184-71d7-5a14-bba8-7a136df92017
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3893%252F20343893%252Finterior_dashboard-1774609046633.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3893/20343893/interior_dashboard-1774609046633.jpg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2579%252F20402579%252Finterior_front_seats-1774264984948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2579/20402579/interior_front_seats-1774264984948.jpg not downloaded yet
2026-03-29 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2202/19182202/interior_boot-1774108116507.jpg> (referer: None)
2026-03-29 20:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_front_driver-1774696604912.jpg> (referer: None)
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F18488723%252Fexterior_front_passenger-1769868576017.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_front_passenger-1769868576017.jpeg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3893%252F20343893%252Finterior_boot-1774525096279.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3893/20343893/interior_boot-1774525096279.jpg not downloaded yet
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2579%252F20402579%252Finterior_rear_seats-1774264998818.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2579/20402579/interior_rear_seats-1774264998818.jpg not downloaded yet
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8eb1050>
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2109%252F20402109%252Fexterior_rear_driver-1774696619636.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_rear_driver-1774696619636.jpg saved to cache
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d360b184-71d7-5a14-bba8-7a136df92017
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F18488723%252Fexterior_rear_passenger-1769868670160.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_rear_passenger-1769868670160.jpeg not downloaded yet
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3893%252F20343893%252Fdocs_service_history-1774269723628.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D732443d44a96c1934f028270af73efab%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3893/20343893/docs_service_history-1774269723628.jpg?ixlib=js-3.8.0&auto=format&s=732443d44a96c1934f028270af73efab not downloaded yet
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20402579%252Finterior_dashboard-1774265023415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20402579/interior_dashboard-1774265023415.jpg not downloaded yet
2026-03-29 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_rear_driver-1774783639194.jpeg> (referer: None)
2026-03-29 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9713/8969713/exterior_rear_driver-1774625028646.jpg> (referer: None)
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F18488723%252Finterior_front_seats-1769868851713.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/18488723/interior_front_seats-1769868851713.jpeg not downloaded yet
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf5fa90>
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2202%252F19182202%252Finterior_boot-1774108116507.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2202/19182202/interior_boot-1774108116507.jpg saved to cache
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item efcf04b4-eb56-533f-86b2-e1e3275c0e93
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f930a290>
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2109%252F20402109%252Fexterior_front_driver-1774696604912.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_front_driver-1774696604912.jpg saved to cache
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d360b184-71d7-5a14-bba8-7a136df92017
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3893%252F20343893%252Fdocs_service_history-1774270108962.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daa9bbdfff431c4ccf08e2015594fe17e%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3893/20343893/docs_service_history-1774270108962.jpg?ixlib=js-3.8.0&auto=format&s=aa9bbdfff431c4ccf08e2015594fe17e not downloaded yet
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2579%252F20402579%252Finterior_boot-1774265027728.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2579/20402579/interior_boot-1774265027728.jpg not downloaded yet
2026-03-29 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488363.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F18488723%252Finterior_rear_seats-1769868771060.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/18488723/interior_rear_seats-1769868771060.jpeg not downloaded yet
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2579%252F20402579%252Fdocs_service_history-1774348886446.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ce37e6b24dc788a0f2aa01bac97a64d%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2579/20402579/docs_service_history-1774348886446.jpg?ixlib=js-3.8.0&auto=format&s=3ce37e6b24dc788a0f2aa01bac97a64d not downloaded yet
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9309c10>
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3412%252F20473412%252Fexterior_rear_driver-1774783639194.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_rear_driver-1774783639194.jpeg saved to cache
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 613ee332-5aba-513c-904b-51832af61a86
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf150d0>
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9713%252F8969713%252Fexterior_rear_driver-1774625028646.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9713/8969713/exterior_rear_driver-1774625028646.jpg saved to cache
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12c39fd4-4285-546f-ac27-0719c42d1e8f
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F18488723%252Finterior_dashboard-1769868855243.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/18488723/interior_dashboard-1769868855243.jpeg not downloaded yet
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2579%252F20402579%252Fdocs_service_history-1774348886679.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0b9ef4d76015e8fa3b78e95ad777bed1%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2579/20402579/docs_service_history-1774348886679.jpg?ixlib=js-3.8.0&auto=format&s=0b9ef4d76015e8fa3b78e95ad777bed1 not downloaded yet
2026-03-29 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2202/19182202/interior_rear_seats-1774629233295.jpg> (referer: None)
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F18488723%252Finstrument_cluster-1769868743005.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/18488723/instrument_cluster-1769868743005.jpeg not downloaded yet
2026-03-29 20:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 949f67c0-5862-5d4c-a61a-cbfe864ebfe5 with identifier: 20488363
2026-03-29 20:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5 with scrape type 1
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8363%252F20488363%252Fexterior_front_driver-1774703758074.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_front_driver-1774703758074.jpg not downloaded yet
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F18488723%252Finterior_boot-1769868820377.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/18488723/interior_boot-1769868820377.jpeg not downloaded yet
2026-03-29 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2109/20402109/interior_dashboard-1774697311384.jpg> (referer: None)
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8363%252F20488363%252Fexterior_rear_driver-1774703771378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_rear_driver-1774703771378.jpg not downloaded yet
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8723%252F18488723%252Fdocs_service_history-1774697121593.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6621536dc721ae30735e04c31287e6c5%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8723/18488723/docs_service_history-1774697121593.jpeg?ixlib=js-3.8.0&auto=format&s=6621536dc721ae30735e04c31287e6c5 not downloaded yet
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8363%252F20488363%252Fexterior_front_passenger-1774703797133.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_front_passenger-1774703797133.jpg not downloaded yet
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8363%252F20488363%252Fexterior_rear_passenger-1774703788984.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_rear_passenger-1774703788984.jpg not downloaded yet
2026-03-29 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_rear_passenger-1774708724649.jpg> (referer: None)
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f85f90>
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2202%252F19182202%252Finterior_rear_seats-1774629233295.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2202/19182202/interior_rear_seats-1774629233295.jpg saved to cache
2026-03-29 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efcf04b4-eb56-533f-86b2-e1e3275c0e93
2026-03-29 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8363%252F20488363%252Finterior_front_seats-1774704097813.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8363/20488363/interior_front_seats-1774704097813.jpg not downloaded yet
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8363%252F20488363%252Finterior_rear_seats-1774704112273.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8363/20488363/interior_rear_seats-1774704112273.jpg not downloaded yet
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f813a950>
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2109%252F20402109%252Finterior_dashboard-1774697311384.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2109/20402109/interior_dashboard-1774697311384.jpg saved to cache
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d360b184-71d7-5a14-bba8-7a136df92017
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f960c110>
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4139%252F20374139%252Fexterior_rear_passenger-1774708724649.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_rear_passenger-1774708724649.jpg saved to cache
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8363%252F20488363%252F20488363-interior_dashboard-modified-1774704854476.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8363/20488363/20488363-interior_dashboard-modified-1774704854476.jpeg not downloaded yet
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8363%252F20488363%252Finterior_boot-1774704143881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8363/20488363/interior_boot-1774704143881.jpg not downloaded yet
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8363%252F20488363%252Fdocs_service_history-1774704251445.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D90e0aa45c9cc01afc74a4e38b63848d5%27 HTTP/1.1" 200 None
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8363/20488363/docs_service_history-1774704251445.jpg?ixlib=js-3.8.0&auto=format&s=90e0aa45c9cc01afc74a4e38b63848d5 not downloaded yet
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20460435.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8363%252F20488363%252Fdamage_dents-1774703860652.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8363/20488363/damage_dents-1774703860652.jpg not downloaded yet
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9713/8969713/instrument_cluster-1774625230559.jpg> (referer: None)
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3893/20343893/docs_service_history-1774269723628.jpg?ixlib=js-3.8.0&auto=format&s=732443d44a96c1934f028270af73efab> (referer: None)
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3893/20343893/docs_service_history-1774270108962.jpg?ixlib=js-3.8.0&auto=format&s=aa9bbdfff431c4ccf08e2015594fe17e> (referer: None)
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_rear_driver-1774267966099.jpg> (referer: None)
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3412/20473412/instrument_cluster-1774783967744.jpeg> (referer: None)
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_rear_passenger-1769868670160.jpeg> (referer: None)
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2579/20402579/interior_dashboard-1774265023415.jpg> (referer: None)
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4139/20374139/interior_front_seats-1774711350993.jpg> (referer: None)
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8723/18488723/interior_rear_seats-1769868771060.jpeg> (referer: None)
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2579/20402579/docs_service_history-1774348886446.jpg?ixlib=js-3.8.0&auto=format&s=3ce37e6b24dc788a0f2aa01bac97a64d> (referer: None)
2026-03-29 20:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a175dc-e4dc-5dc5-bbea-2977731aaa39 with identifier: 20460435
2026-03-29 20:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39 with scrape type 1
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F20460435%252Fexterior_front_driver-1774600153779.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_front_driver-1774600153779.jpg not downloaded yet
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F20460435%252Fexterior_rear_driver-1774600224835.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_rear_driver-1774600224835.jpg not downloaded yet
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F20460435%252Fexterior_front_passenger-1774598852109.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_front_passenger-1774598852109.jpg not downloaded yet
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84c9310>
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9713%252F8969713%252Finstrument_cluster-1774625230559.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9713/8969713/instrument_cluster-1774625230559.jpg saved to cache
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12c39fd4-4285-546f-ac27-0719c42d1e8f
2026-03-29 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8723/18488723/interior_front_seats-1769868851713.jpeg> (referer: None)
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F20460435%252Fexterior_rear_passenger-1774598846533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_rear_passenger-1774598846533.jpg not downloaded yet
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f907c2d0>
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3893%252F20343893%252Fdocs_service_history-1774269723628.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D732443d44a96c1934f028270af73efab') HTTP/1.1" 204 0
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3893/20343893/docs_service_history-1774269723628.jpg?ixlib=js-3.8.0&auto=format&s=732443d44a96c1934f028270af73efab saved to cache
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4293c30d-723b-53a6-ba49-a06c447f0246
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9247a10>
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3893%252F20343893%252Fdocs_service_history-1774270108962.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daa9bbdfff431c4ccf08e2015594fe17e') HTTP/1.1" 204 0
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3893/20343893/docs_service_history-1774270108962.jpg?ixlib=js-3.8.0&auto=format&s=aa9bbdfff431c4ccf08e2015594fe17e saved to cache
2026-03-29 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4293c30d-723b-53a6-ba49-a06c447f0246
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93a73d0>
2026-03-29 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3893%252F20343893%252Fexterior_rear_driver-1774267966099.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_rear_driver-1774267966099.jpg saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4293c30d-723b-53a6-ba49-a06c447f0246
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00&\xdfX\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xa7\xab\x00&\xd5N\x00\x00\x00\x00'
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90d5c50>
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3412%252F20473412%252Finstrument_cluster-1774783967744.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3412/20473412/instrument_cluster-1774783967744.jpeg saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 613ee332-5aba-513c-904b-51832af61a86
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f962aa90>
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F18488723%252Fexterior_rear_passenger-1769868670160.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_rear_passenger-1769868670160.jpeg saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9024150>
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20402579%252Finterior_dashboard-1774265023415.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20402579/interior_dashboard-1774265023415.jpg saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9810a24-2233-526d-9ced-55a079645b4f
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93a6fd0>
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4139%252F20374139%252Finterior_front_seats-1774711350993.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4139/20374139/interior_front_seats-1774711350993.jpg saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00%\x87f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xee\xd0\x00%}`\x00\x00\x00\x00'
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f939cf90>
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F18488723%252Finterior_rear_seats-1769868771060.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/18488723/interior_rear_seats-1769868771060.jpeg saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0435%252F20460435%252Finterior_front_seats-1774599672086.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0435/20460435/interior_front_seats-1774599672086.jpg not downloaded yet
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89dacd0>
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2579%252F20402579%252Fdocs_service_history-1774348886446.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3ce37e6b24dc788a0f2aa01bac97a64d') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2579/20402579/docs_service_history-1774348886446.jpg?ixlib=js-3.8.0&auto=format&s=3ce37e6b24dc788a0f2aa01bac97a64d saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9810a24-2233-526d-9ced-55a079645b4f
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00,\x0f\xb4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x024\xcc\x00,\x05\xae\x00\x00\x00\x00'
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89d8b10>
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F18488723%252Finterior_front_seats-1769868851713.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/18488723/interior_front_seats-1769868851713.jpeg saved to cache
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0435%252F20460435%252Finterior_rear_seats-1774599609694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0435/20460435/interior_rear_seats-1774599609694.jpg not downloaded yet
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0435%252F20460435%252Finterior_dashboard-1774692122823.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0435/20460435/interior_dashboard-1774692122823.jpg not downloaded yet
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F20460435%252Finstrument_cluster-1774599576950.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/20460435/instrument_cluster-1774599576950.jpg not downloaded yet
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0435%252F20460435%252Finterior_boot-1774692050243.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0435/20460435/interior_boot-1774692050243.jpg not downloaded yet
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0435%252F20460435%252Fdocs_service_history-1774599880790.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd61830abefce5bf6f70575d2a3276e5c%27 HTTP/1.1" 200 None
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0435/20460435/docs_service_history-1774599880790.jpg?ixlib=js-3.8.0&auto=format&s=d61830abefce5bf6f70575d2a3276e5c not downloaded yet
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8363/20488363/damage_dents-1774703860652.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8723/18488723/interior_dashboard-1769868855243.jpeg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2579/20402579/interior_boot-1774265027728.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_rear_passenger-1774703788984.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8363/20488363/interior_front_seats-1774704097813.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8363/20488363/interior_boot-1774704143881.jpg> (referer: None)
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8202550>
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8363%252F20488363%252Fdamage_dents-1774703860652.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8363/20488363/damage_dents-1774703860652.jpg saved to cache
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebeab750>
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F18488723%252Finterior_dashboard-1769868855243.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/18488723/interior_dashboard-1769868855243.jpeg saved to cache
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95d5190>
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2579%252F20402579%252Finterior_boot-1774265027728.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2579/20402579/interior_boot-1774265027728.jpg saved to cache
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9810a24-2233-526d-9ced-55a079645b4f
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9420b10>
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8363%252F20488363%252Fexterior_rear_passenger-1774703788984.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_rear_passenger-1774703788984.jpg saved to cache
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d0b10>
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8363%252F20488363%252Finterior_front_seats-1774704097813.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8363/20488363/interior_front_seats-1774704097813.jpg saved to cache
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95d7510>
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8363%252F20488363%252Finterior_boot-1774704143881.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8363/20488363/interior_boot-1774704143881.jpg saved to cache
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_front_driver-1774600153779.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8363/20488363/docs_service_history-1774704251445.jpg?ixlib=js-3.8.0&auto=format&s=90e0aa45c9cc01afc74a4e38b63848d5> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_rear_passenger-1774598846533.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_front_passenger-1774598852109.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_rear_driver-1774600224835.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0435/20460435/docs_service_history-1774599880790.jpg?ixlib=js-3.8.0&auto=format&s=d61830abefce5bf6f70575d2a3276e5c> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_front_passenger-1774703797133.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0435/20460435/interior_front_seats-1774599672086.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0435/20460435/interior_rear_seats-1774599609694.jpg> (referer: None)
2026-03-29 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8363/20488363/interior_rear_seats-1774704112273.jpg> (referer: None)
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa4b5d0>
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F20460435%252Fexterior_front_driver-1774600153779.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_front_driver-1774600153779.jpg saved to cache
2026-03-29 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad244d0>
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8363%252F20488363%252Fdocs_service_history-1774704251445.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D90e0aa45c9cc01afc74a4e38b63848d5') HTTP/1.1" 204 0
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8363/20488363/docs_service_history-1774704251445.jpg?ixlib=js-3.8.0&auto=format&s=90e0aa45c9cc01afc74a4e38b63848d5 saved to cache
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0cf590>
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F20460435%252Fexterior_rear_passenger-1774598846533.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_rear_passenger-1774598846533.jpg saved to cache
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cc02d0>
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F20460435%252Fexterior_front_passenger-1774598852109.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_front_passenger-1774598852109.jpg saved to cache
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8855910>
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F20460435%252Fexterior_rear_driver-1774600224835.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_rear_driver-1774600224835.jpg saved to cache
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facead90>
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0435%252F20460435%252Fdocs_service_history-1774599880790.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd61830abefce5bf6f70575d2a3276e5c') HTTP/1.1" 204 0
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0435/20460435/docs_service_history-1774599880790.jpg?ixlib=js-3.8.0&auto=format&s=d61830abefce5bf6f70575d2a3276e5c saved to cache
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf80450>
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8363%252F20488363%252Fexterior_front_passenger-1774703797133.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_front_passenger-1774703797133.jpg saved to cache
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facea950>
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0435%252F20460435%252Finterior_front_seats-1774599672086.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0435/20460435/interior_front_seats-1774599672086.jpg saved to cache
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ad19d0>
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0435%252F20460435%252Finterior_rear_seats-1774599609694.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0435/20460435/interior_rear_seats-1774599609694.jpg saved to cache
2026-03-29 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39
2026-03-29 20:08:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f895b750>
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8363%252F20488363%252Finterior_rear_seats-1774704112273.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8363/20488363/interior_rear_seats-1774704112273.jpg saved to cache
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5
2026-03-29 20:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0435/20460435/interior_boot-1774692050243.jpg> (referer: None)
2026-03-29 20:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8723/18488723/docs_service_history-1774697121593.jpeg?ixlib=js-3.8.0&auto=format&s=6621536dc721ae30735e04c31287e6c5> (referer: None)
2026-03-29 20:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8363/20488363/20488363-interior_dashboard-modified-1774704854476.jpeg> (referer: None)
2026-03-29 20:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_rear_driver-1774703771378.jpg> (referer: None)
2026-03-29 20:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_front_driver-1774703758074.jpg> (referer: None)
2026-03-29 20:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0435/20460435/instrument_cluster-1774599576950.jpg> (referer: None)
2026-03-29 20:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8723/18488723/instrument_cluster-1769868743005.jpeg> (referer: None)
2026-03-29 20:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0435/20460435/interior_dashboard-1774692122823.jpg> (referer: None)
2026-03-29 20:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8723/18488723/interior_boot-1769868820377.jpeg> (referer: None)
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cb2e50>
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0435%252F20460435%252Finterior_boot-1774692050243.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0435/20460435/interior_boot-1774692050243.jpg saved to cache
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9219110>
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8723%252F18488723%252Fdocs_service_history-1774697121593.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6621536dc721ae30735e04c31287e6c5') HTTP/1.1" 204 0
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8723/18488723/docs_service_history-1774697121593.jpeg?ixlib=js-3.8.0&auto=format&s=6621536dc721ae30735e04c31287e6c5 saved to cache
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0cdc50>
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8363%252F20488363%252F20488363-interior_dashboard-modified-1774704854476.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8363/20488363/20488363-interior_dashboard-modified-1774704854476.jpeg saved to cache
2026-03-29 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e48410>
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8363%252F20488363%252Fexterior_rear_driver-1774703771378.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_rear_driver-1774703771378.jpg saved to cache
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cc0710>
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8363%252F20488363%252Fexterior_front_driver-1774703758074.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_front_driver-1774703758074.jpg saved to cache
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5
2026-03-29 20:08:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 949f67c0-5862-5d4c-a61a-cbfe864ebfe5, skipping ID generation
2026-03-29 20:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5 with scrape type 1
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 949f67c0-5862-5d4c-a61a-cbfe864ebfe5 sending to next pipeline
2026-03-29 20:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 949f67c0-5862-5d4c-a61a-cbfe864ebfe5, identifier: 20488363
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89700d0>
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0435%252F20460435%252Finstrument_cluster-1774599576950.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0435/20460435/instrument_cluster-1774599576950.jpg saved to cache
2026-03-29 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39
2026-03-29 20:08:16 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:16 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:16 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00#\xf9`\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfe\x19\x00#\xefZ\x00\x00\x00\x00'
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa49710>
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F18488723%252Finstrument_cluster-1769868743005.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/18488723/instrument_cluster-1769868743005.jpeg saved to cache
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cb3f90>
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0435%252F20460435%252Finterior_dashboard-1774692122823.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0435/20460435/interior_dashboard-1774692122823.jpg saved to cache
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39
2026-03-29 20:08:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53a175dc-e4dc-5dc5-bbea-2977731aaa39, skipping ID generation
2026-03-29 20:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39 with scrape type 1
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53a175dc-e4dc-5dc5-bbea-2977731aaa39 sending to next pipeline
2026-03-29 20:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 53a175dc-e4dc-5dc5-bbea-2977731aaa39, identifier: 20460435
2026-03-29 20:08:17 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:17 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:17 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x004}\xeb\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xd3\xde\x004s\xe5\x00\x00\x00\x00'
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cb06d0>
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F18488723%252Finterior_boot-1769868820377.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/18488723/interior_boot-1769868820377.jpeg saved to cache
2026-03-29 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13
2026-03-29 20:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 949f67c0-5862-5d4c-a61a-cbfe864ebfe5 with identifier: 20488363
2026-03-29 20:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 949f67c0-5862-5d4c-a61a-cbfe864ebfe5 with identifier: 20488363
2026-03-29 20:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 949f67c0-5862-5d4c-a61a-cbfe864ebfe5 with identifier: 20488363 to the API
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_front_driver-1774703758074.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '949f67c0-5862-5d4c-a61a-cbfe864ebfe5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DC23 JKN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488363',
'listing': 'auction',
'location': 'Cheshire West and Chester Winsford',
'make': 'Kia',
'model': 'Sportage',
'odometer': 20300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1915026,
'Height': 2870,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_front_driver-1774703758074.jpg',
'Width': 3826},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1851780,
'Height': 2924,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_rear_driver-1774703771378.jpg',
'Width': 3898},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1613947,
'Height': 2730,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_front_passenger-1774703797133.jpg',
'Width': 3640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1818688,
'Height': 2879,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8363/20488363/exterior_rear_passenger-1774703788984.jpg',
'Width': 3838},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3136928,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8363/20488363/interior_front_seats-1774704097813.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2835466,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8363/20488363/interior_rear_seats-1774704112273.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2911011,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8363/20488363/20488363-interior_dashboard-modified-1774704854476.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3069448,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8363/20488363/interior_boot-1774704143881.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 754340,
'Height': 1983,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8363/20488363/docs_service_history-1774704251445.jpg?ixlib=js-3.8.0&auto=format&s=90e0aa45c9cc01afc74a4e38b63848d5',
'Width': 3540},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_949f67c0-5862-5d4c-a61a-cbfe864ebfe5/949f67c0-5862-5d4c-a61a-cbfe864ebfe5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 906530,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8363/20488363/damage_dents-1774703860652.jpg',
'Width': 4032}],
'price': 16425,
'price_includes_vat': False,
'registration_date': '2023-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage 2 ISG',
'transmission': 'manual',
'trim': '2 ISG',
'vin': 'U5YPU81BLPL181764',
'year': 2023}
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488363%27 HTTP/1.1" 200 None
2026-03-29 20:08:18 [motorway.uk] INFO: Saving data for 20488363: {'created_time': 1774814898.034128, 'last_price_update_time': 1774814898.034139, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488363') HTTP/1.1" 204 0
2026-03-29 20:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 53a175dc-e4dc-5dc5-bbea-2977731aaa39 with identifier: 20460435
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Green HTTP/1.1" 200 None
2026-03-29 20:08:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 53a175dc-e4dc-5dc5-bbea-2977731aaa39 with identifier: 20460435
2026-03-29 20:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 53a175dc-e4dc-5dc5-bbea-2977731aaa39 with identifier: 20460435 to the API
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0435/20460435/interior_dashboard-1774692122823.jpg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '53a175dc-e4dc-5dc5-bbea-2977731aaa39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PE16 DDU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20460435',
'listing': 'auction',
'location': 'Wiltshire Swindon',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 95600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1539847,
'Height': 2835,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_front_driver-1774600153779.jpg',
'Width': 3780},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1502842,
'Height': 2854,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_rear_driver-1774600224835.jpg',
'Width': 3805},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1221392,
'Height': 2835,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_front_passenger-1774598852109.jpg',
'Width': 3780},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 956999,
'Height': 2850,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0435/20460435/exterior_rear_passenger-1774598846533.jpg',
'Width': 3800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2240663,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0435/20460435/interior_front_seats-1774599672086.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2087279,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0435/20460435/interior_rear_seats-1774599609694.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3035555,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0435/20460435/interior_dashboard-1774692122823.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2347033,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0435/20460435/instrument_cluster-1774599576950.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2780387,
'Height': 2662,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0435/20460435/interior_boot-1774692050243.jpg',
'Width': 3550},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a175dc-e4dc-5dc5-bbea-2977731aaa39/53a175dc-e4dc-5dc5-bbea-2977731aaa39_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1471758,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0435/20460435/docs_service_history-1774599880790.jpg?ixlib=js-3.8.0&auto=format&s=d61830abefce5bf6f70575d2a3276e5c',
'Width': 3840}],
'price': 6659,
'price_includes_vat': False,
'registration_date': '2016-03-24',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Rrover Evoque HSE DYN LUX TD4A',
'transmission': 'automatic',
'trim': 'Rrover Evoque HSE DYN LUX TD4A',
'vin': 'SALVA2AN7GH138180',
'year': 2016}
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720460435%27 HTTP/1.1" 200 None
2026-03-29 20:08:18 [motorway.uk] INFO: Saving data for 20460435: {'created_time': 1774814898.594567, 'last_price_update_time': 1774814898.594577, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20460435') HTTP/1.1" 204 0
2026-03-29 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_front_passenger-1769868576017.jpeg> (referer: None)
2026-03-29 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_rear_driver-1769868680872.jpeg> (referer: None)
2026-03-29 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2579/20402579/exterior_rear_passenger-1774264531472.jpg> (referer: None)
2026-03-29 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2579/20402579/docs_service_history-1774348886679.jpg?ixlib=js-3.8.0&auto=format&s=0b9ef4d76015e8fa3b78e95ad777bed1> (referer: None)
2026-03-29 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2579/20402579/interior_front_seats-1774264984948.jpg> (referer: None)
2026-03-29 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2579/20402579/interior_rear_seats-1774264998818.jpg> (referer: None)
2026-03-29 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3893/20343893/interior_rear_seats-1774457313975.jpg> (referer: None)
2026-03-29 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3893/20343893/interior_dashboard-1774609046633.jpg> (referer: None)
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d5b50>
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F18488723%252Fexterior_front_passenger-1769868576017.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_front_passenger-1769868576017.jpeg saved to cache
2026-03-29 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13
2026-03-29 20:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3893/20343893/interior_boot-1774525096279.jpg> (referer: None)
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89a6d10>
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F18488723%252Fexterior_rear_driver-1769868680872.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_rear_driver-1769868680872.jpeg saved to cache
2026-03-29 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac24a90>
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20402579%252Fexterior_rear_passenger-1774264531472.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20402579/exterior_rear_passenger-1774264531472.jpg saved to cache
2026-03-29 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9810a24-2233-526d-9ced-55a079645b4f
2026-03-29 20:08:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89a4190>
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2579%252F20402579%252Fdocs_service_history-1774348886679.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0b9ef4d76015e8fa3b78e95ad777bed1') HTTP/1.1" 204 0
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2579/20402579/docs_service_history-1774348886679.jpg?ixlib=js-3.8.0&auto=format&s=0b9ef4d76015e8fa3b78e95ad777bed1 saved to cache
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9810a24-2233-526d-9ced-55a079645b4f
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac27b50>
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2579%252F20402579%252Finterior_front_seats-1774264984948.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2579/20402579/interior_front_seats-1774264984948.jpg saved to cache
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9810a24-2233-526d-9ced-55a079645b4f
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f954c190>
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2579%252F20402579%252Finterior_rear_seats-1774264998818.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2579/20402579/interior_rear_seats-1774264998818.jpg saved to cache
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9810a24-2233-526d-9ced-55a079645b4f
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b' \x16\x00\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x98\x10\x00\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'SM-A920F\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 196 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 204 - value: b'A920FXXS7CVI6\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 218 - value: b'2026:03:24 12:36:08\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xee\x00\x00\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x8a\x1d\x00\x00'
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faad7110>
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3893%252F20343893%252Finterior_rear_seats-1774457313975.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3893/20343893/interior_rear_seats-1774457313975.jpg saved to cache
2026-03-29 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4293c30d-723b-53a6-ba49-a06c447f0246
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b' \x16\x00\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x98\x10\x00\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'SM-A920F\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 196 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 204 - value: b'A920FXXS7CVI6\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 218 - value: b'2026:03:26 16:31:00\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xee\x00\x00\x00'
2026-03-29 20:08:19 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x8a\x1d\x00\x00'
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89a6d10>
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3893%252F20343893%252Finterior_dashboard-1774609046633.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3893/20343893/interior_dashboard-1774609046633.jpg saved to cache
2026-03-29 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4293c30d-723b-53a6-ba49-a06c447f0246
2026-03-29 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4139/20374139/20374139-docs_service_history-modified-1774774429605.jpeg?ixlib=js-3.8.0&auto=format&s=7f377851501c4492c450844b8a4d6ac2> (referer: None)
2026-03-29 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b' \x16\x00\x00'
2026-03-29 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x98\x10\x00\x00'
2026-03-29 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'SM-A920F\x00'
2026-03-29 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 196 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 204 - value: b'A920FXXS7CVI6\x00'
2026-03-29 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 218 - value: b'2026:03:22 16:15:34\x00'
2026-03-29 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xee\x00\x00\x00'
2026-03-29 20:08:20 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x8a\x1d\x00\x00'
2026-03-29 20:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f926ab10>
2026-03-29 20:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3893%252F20343893%252Finterior_boot-1774525096279.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3893/20343893/interior_boot-1774525096279.jpg saved to cache
2026-03-29 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4293c30d-723b-53a6-ba49-a06c447f0246
2026-03-29 20:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facab250>
2026-03-29 20:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4139%252F20374139%252F20374139-docs_service_history-modified-1774774429605.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7f377851501c4492c450844b8a4d6ac2') HTTP/1.1" 204 0
2026-03-29 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4139/20374139/20374139-docs_service_history-modified-1774774429605.jpeg?ixlib=js-3.8.0&auto=format&s=7f377851501c4492c450844b8a4d6ac2 saved to cache
2026-03-29 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8
2026-03-29 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_rear_passenger-1774450095323.jpg> (referer: None)
2026-03-29 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_front_driver-1769868561369.jpeg> (referer: None)
2026-03-29 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4139/20374139/damage_paintwork-1774709045989.jpg> (referer: None)
2026-03-29 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2579/20402579/exterior_front_passenger-1774264548352.jpg> (referer: None)
2026-03-29 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2579/20402579/exterior_rear_driver-1774264571136.jpg> (referer: None)
2026-03-29 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2579/20402579/exterior_front_driver-1774267081874.jpg> (referer: None)
2026-03-29 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_front_passenger-1774609106622.jpg> (referer: None)
2026-03-29 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4139/20374139/interior_boot-1774711813840.jpg> (referer: None)
2026-03-29 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3893/20343893/interior_front_seats-1774609081803.jpg> (referer: None)
2026-03-29 20:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_front_driver-1774525042118.jpg> (referer: None)
2026-03-29 20:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf9ee10>
2026-03-29 20:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3893%252F20343893%252Fexterior_rear_passenger-1774450095323.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_rear_passenger-1774450095323.jpg saved to cache
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4293c30d-723b-53a6-ba49-a06c447f0246
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81a7210>
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F18488723%252Fexterior_front_driver-1769868561369.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_front_driver-1769868561369.jpeg saved to cache
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13
2026-03-29 20:08:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13, skipping ID generation
2026-03-29 20:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13 with scrape type 1
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13 sending to next pipeline
2026-03-29 20:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13, identifier: 18488723
2026-03-29 20:08:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89a5650>
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4139%252F20374139%252Fdamage_paintwork-1774709045989.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4139/20374139/damage_paintwork-1774709045989.jpg saved to cache
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf9cd10>
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20402579%252Fexterior_front_passenger-1774264548352.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20402579/exterior_front_passenger-1774264548352.jpg saved to cache
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9810a24-2233-526d-9ced-55a079645b4f
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81f16d0>
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20402579%252Fexterior_rear_driver-1774264571136.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20402579/exterior_rear_driver-1774264571136.jpg saved to cache
2026-03-29 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9810a24-2233-526d-9ced-55a079645b4f
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa1eb10>
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2579%252F20402579%252Fexterior_front_driver-1774267081874.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2579/20402579/exterior_front_driver-1774267081874.jpg saved to cache
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9810a24-2233-526d-9ced-55a079645b4f
2026-03-29 20:08:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9810a24-2233-526d-9ced-55a079645b4f, skipping ID generation
2026-03-29 20:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9810a24-2233-526d-9ced-55a079645b4f with scrape type 1
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9810a24-2233-526d-9ced-55a079645b4f sending to next pipeline
2026-03-29 20:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c9810a24-2233-526d-9ced-55a079645b4f, identifier: 20402579
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c33bd0>
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3893%252F20343893%252Fexterior_front_passenger-1774609106622.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_front_passenger-1774609106622.jpg saved to cache
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4293c30d-723b-53a6-ba49-a06c447f0246
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d7950>
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4139%252F20374139%252Finterior_boot-1774711813840.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4139/20374139/interior_boot-1774711813840.jpg saved to cache
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b' \x16\x00\x00'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x98\x10\x00\x00'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'SM-A920F\x00'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 188 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 196 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 204 - value: b'A920FXXS7CVI6\x00'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 218 - value: b'2026:03:26 16:31:14\x00'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xee\x00\x00\x00'
2026-03-29 20:08:22 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x8a\x1d\x00\x00'
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9372a90>
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3893%252F20343893%252Finterior_front_seats-1774609081803.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3893/20343893/interior_front_seats-1774609081803.jpg saved to cache
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4293c30d-723b-53a6-ba49-a06c447f0246
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81f2a50>
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3893%252F20343893%252Fexterior_front_driver-1774525042118.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_front_driver-1774525042118.jpg saved to cache
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4293c30d-723b-53a6-ba49-a06c447f0246
2026-03-29 20:08:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4293c30d-723b-53a6-ba49-a06c447f0246, skipping ID generation
2026-03-29 20:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4293c30d-723b-53a6-ba49-a06c447f0246 with scrape type 1
2026-03-29 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4293c30d-723b-53a6-ba49-a06c447f0246 sending to next pipeline
2026-03-29 20:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4293c30d-723b-53a6-ba49-a06c447f0246, identifier: 20343893
2026-03-29 20:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13 with identifier: 18488723
2026-03-29 20:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13 with identifier: 18488723
2026-03-29 20:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13 with identifier: 18488723 to the API
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_front_driver-1769868561369.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DK16 WOD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18488723',
'listing': 'auction',
'location': 'Leicestershire Lutterworth',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 80160,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1384363,
'Height': 2507,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_front_driver-1769868561369.jpeg',
'Width': 3343},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1362994,
'Height': 2454,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_rear_driver-1769868680872.jpeg',
'Width': 3272},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1384723,
'Height': 2442,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_front_passenger-1769868576017.jpeg',
'Width': 3256},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1293775,
'Height': 2387,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8723/18488723/exterior_rear_passenger-1769868670160.jpeg',
'Width': 3183},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3032192,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8723/18488723/interior_front_seats-1769868851713.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2586166,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8723/18488723/interior_rear_seats-1769868771060.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1691463,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8723/18488723/interior_dashboard-1769868855243.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2488185,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8723/18488723/instrument_cluster-1769868743005.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3559881,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8723/18488723/interior_boot-1769868820377.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13/d88a06cf-7ee4-5ce0-9b4c-e553c5dc6f13_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492193,
'Height': 3507,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8723/18488723/docs_service_history-1774697121593.jpeg?ixlib=js-3.8.0&auto=format&s=6621536dc721ae30735e04c31287e6c5',
'Width': 2480}],
'price': 6414,
'price_includes_vat': False,
'registration_date': '2016-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Rrover Evoque HSE DYN LUX TD4A',
'transmission': 'automatic',
'trim': 'Rrover Evoque HSE DYN LUX TD4A',
'vin': 'SALVA2AN2GH122940',
'year': 2016}
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718488723%27 HTTP/1.1" 200 None
2026-03-29 20:08:23 [motorway.uk] INFO: Saving data for 18488723: {'created_time': 1774814903.298795, 'last_price_update_time': 1774814903.298806, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18488723') HTTP/1.1" 204 0
2026-03-29 20:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c9810a24-2233-526d-9ced-55a079645b4f with identifier: 20402579
2026-03-29 20:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c9810a24-2233-526d-9ced-55a079645b4f with identifier: 20402579
2026-03-29 20:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c9810a24-2233-526d-9ced-55a079645b4f with identifier: 20402579 to the API
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/2579/20402579/exterior_front_driver-1774267081874.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'c9810a24-2233-526d-9ced-55a079645b4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'M19 ECY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20402579',
'listing': 'auction',
'location': 'Staffordshire Cannock',
'make': 'Mercedes',
'model': 'C Class',
'odometer': 107000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2530281,
'Height': 2760,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2579/20402579/exterior_front_driver-1774267081874.jpg',
'Width': 3680},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1665470,
'Height': 2459,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2579/20402579/exterior_rear_driver-1774264571136.jpg',
'Width': 3279},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1632386,
'Height': 2381,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2579/20402579/exterior_front_passenger-1774264548352.jpg',
'Width': 3175},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1690205,
'Height': 2711,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2579/20402579/exterior_rear_passenger-1774264531472.jpg',
'Width': 3614},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2959613,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2579/20402579/interior_front_seats-1774264984948.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3163075,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2579/20402579/interior_rear_seats-1774264998818.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1506677,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2579/20402579/interior_dashboard-1774265023415.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2866848,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2579/20402579/interior_boot-1774265027728.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1763756,
'Height': 2464,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2579/20402579/docs_service_history-1774348886446.jpg?ixlib=js-3.8.0&auto=format&s=3ce37e6b24dc788a0f2aa01bac97a64d',
'Width': 1738},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9810a24-2233-526d-9ced-55a079645b4f/c9810a24-2233-526d-9ced-55a079645b4f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2294421,
'Height': 2558,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2579/20402579/docs_service_history-1774348886679.jpg?ixlib=js-3.8.0&auto=format&s=0b9ef4d76015e8fa3b78e95ad777bed1',
'Width': 1796}],
'price': 10817,
'price_includes_vat': False,
'registration_date': '2019-05-17',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes C 300 AMG Line Premium D Auto',
'transmission': 'automatic',
'trim': 'C 300 AMG Line Premium D Auto',
'vin': 'WDD2053182F886878',
'year': 2019}
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720402579%27 HTTP/1.1" 200 None
2026-03-29 20:08:23 [motorway.uk] INFO: Saving data for 20402579: {'created_time': 1774814903.6837, 'last_price_update_time': 1774814903.683712, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20402579') HTTP/1.1" 204 0
2026-03-29 20:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4293c30d-723b-53a6-ba49-a06c447f0246 with identifier: 20343893
2026-03-29 20:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4293c30d-723b-53a6-ba49-a06c447f0246 with identifier: 20343893
2026-03-29 20:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4293c30d-723b-53a6-ba49-a06c447f0246 with identifier: 20343893 to the API
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_front_driver-1774525042118.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '4293c30d-723b-53a6-ba49-a06c447f0246',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LG17 WTW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20343893',
'listing': 'auction',
'location': 'Surrey Coulsdon',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 64610,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 909719,
'Height': 1963,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_front_driver-1774525042118.jpg',
'Width': 2617},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2695376,
'Height': 3466,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_rear_driver-1774267966099.jpg',
'Width': 4621},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3536663,
'Height': 4125,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_front_passenger-1774609106622.jpg',
'Width': 5500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1173117,
'Height': 2320,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3893/20343893/exterior_rear_passenger-1774450095323.jpg',
'Width': 3093},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5136439,
'Height': 4248,
'OriginUrl': 'https://motorway-photos.imgix.net/3893/20343893/interior_front_seats-1774609081803.jpg',
'Width': 5664},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5012069,
'Height': 4248,
'OriginUrl': 'https://motorway-photos.imgix.net/3893/20343893/interior_rear_seats-1774457313975.jpg',
'Width': 5664},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5123234,
'Height': 4248,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3893/20343893/interior_dashboard-1774609046633.jpg',
'Width': 5664},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7237160,
'Height': 4248,
'OriginUrl': 'https://motorway-photos.imgix.net/3893/20343893/interior_boot-1774525096279.jpg',
'Width': 5664},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1542149,
'Height': 5664,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3893/20343893/docs_service_history-1774269723628.jpg?ixlib=js-3.8.0&auto=format&s=732443d44a96c1934f028270af73efab',
'Width': 4248},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4293c30d-723b-53a6-ba49-a06c447f0246/4293c30d-723b-53a6-ba49-a06c447f0246_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1617780,
'Height': 5664,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3893/20343893/docs_service_history-1774270108962.jpg?ixlib=js-3.8.0&auto=format&s=aa9bbdfff431c4ccf08e2015594fe17e',
'Width': 4248}],
'price': 8383,
'price_includes_vat': False,
'registration_date': '2017-03-16',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Octavia SE L TDI',
'transmission': 'manual',
'trim': 'SE L TDI',
'vin': 'TMBKJ7NE9J0016413',
'year': 2017}
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720343893%27 HTTP/1.1" 200 None
2026-03-29 20:08:24 [motorway.uk] INFO: Saving data for 20343893: {'created_time': 1774814904.09155, 'last_price_update_time': 1774814904.09156, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20343893') HTTP/1.1" 204 0
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9713/8969713/8969713-docs_service_history-default-1774217267064.jpg?ixlib=js-3.8.0&auto=format&s=e16a06f110947b6e56b87075458a594a> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_front_passenger-1774708769286.jpg> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4139/20374139/20374139-interior_dashboard-modified-1774772423395.jpeg> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9713/8969713/interior_boot-1774625273694.jpg> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4139/20374139/interior_rear_seats-1774711428852.jpg> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3412/20473412/interior_dashboard-1774783926705.jpeg> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3412/20473412/damage_scratches-1774784068680.jpeg> (referer: None)
2026-03-29 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3412/20473412/interior_boot-1774783958854.jpeg> (referer: None)
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8701c1ee10>
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9713%252F8969713%252F8969713-docs_service_history-default-1774217267064.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De16a06f110947b6e56b87075458a594a') HTTP/1.1" 204 0
2026-03-29 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9713/8969713/8969713-docs_service_history-default-1774217267064.jpg?ixlib=js-3.8.0&auto=format&s=e16a06f110947b6e56b87075458a594a saved to cache
2026-03-29 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12c39fd4-4285-546f-ac27-0719c42d1e8f
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010c7910>
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4139%252F20374139%252Fexterior_front_passenger-1774708769286.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_front_passenger-1774708769286.jpg saved to cache
2026-03-29 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f916b290>
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4139%252F20374139%252F20374139-interior_dashboard-modified-1774772423395.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4139/20374139/20374139-interior_dashboard-modified-1774772423395.jpeg saved to cache
2026-03-29 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faccd710>
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9713%252F8969713%252Finterior_boot-1774625273694.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9713/8969713/interior_boot-1774625273694.jpg saved to cache
2026-03-29 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12c39fd4-4285-546f-ac27-0719c42d1e8f
2026-03-29 20:08:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f966a290>
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4139%252F20374139%252Finterior_rear_seats-1774711428852.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4139/20374139/interior_rear_seats-1774711428852.jpg saved to cache
2026-03-29 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8
2026-03-29 20:08:24 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:24 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:24 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x005\xc8\x8f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03YH\x005\xbe\x85\x00\x00\x00\x00'
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad8ead0>
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3412%252F20473412%252Finterior_dashboard-1774783926705.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3412/20473412/interior_dashboard-1774783926705.jpeg saved to cache
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 613ee332-5aba-513c-904b-51832af61a86
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00=\xa8-\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x13\xe8\x00=\x9e#\x00\x00\x00\x00'
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac25c90>
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3412%252F20473412%252Fdamage_scratches-1774784068680.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3412/20473412/damage_scratches-1774784068680.jpeg saved to cache
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 613ee332-5aba-513c-904b-51832af61a86
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:25 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00H\x86\xf8\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03>^\x00H|\xee\x00\x00\x00\x00'
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9190f90>
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3412%252F20473412%252Finterior_boot-1774783958854.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3412/20473412/interior_boot-1774783958854.jpeg saved to cache
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 613ee332-5aba-513c-904b-51832af61a86
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9713/8969713/interior_rear_seats-1774625147117.jpg> (referer: None)
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_front_driver-1774708879391.jpg> (referer: None)
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_rear_driver-1774708888686.jpg> (referer: None)
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9713/8969713/interior_front_seats-1774625324395.jpg> (referer: None)
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9713/8969713/exterior_rear_passenger-1774624999817.jpg> (referer: None)
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9713/8969713/interior_dashboard-1774625201676.jpg> (referer: None)
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_rear_passenger-1774783618302.jpeg> (referer: None)
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7916/16857916/16857916-interior_boot-modified-1774689145192.jpeg> (referer: None)
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7916/16857916/docs_service_history-1774688370011.jpeg?ixlib=js-3.8.0&auto=format&s=916e9aba5e00e8547198be4b6612b3ee> (referer: None)
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3412/20473412/interior_front_seats-1774783788253.jpeg> (referer: None)
2026-03-29 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3412/20473412/interior_rear_seats-1774783897933.jpeg> (referer: None)
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cb0cd0>
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9713%252F8969713%252Finterior_rear_seats-1774625147117.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9713/8969713/interior_rear_seats-1774625147117.jpg saved to cache
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12c39fd4-4285-546f-ac27-0719c42d1e8f
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad73e90>
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4139%252F20374139%252Fexterior_front_driver-1774708879391.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_front_driver-1774708879391.jpg saved to cache
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90494d0>
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4139%252F20374139%252Fexterior_rear_driver-1774708888686.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_rear_driver-1774708888686.jpg saved to cache
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8
2026-03-29 20:08:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8, skipping ID generation
2026-03-29 20:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8 with scrape type 1
2026-03-29 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8 sending to next pipeline
2026-03-29 20:08:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8, identifier: 20374139
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f27410>
2026-03-29 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9713%252F8969713%252Finterior_front_seats-1774625324395.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9713/8969713/interior_front_seats-1774625324395.jpg saved to cache
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12c39fd4-4285-546f-ac27-0719c42d1e8f
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9169190>
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9713%252F8969713%252Fexterior_rear_passenger-1774624999817.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9713/8969713/exterior_rear_passenger-1774624999817.jpg saved to cache
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12c39fd4-4285-546f-ac27-0719c42d1e8f
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f966a650>
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9713%252F8969713%252Finterior_dashboard-1774625201676.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9713/8969713/interior_dashboard-1774625201676.jpg saved to cache
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12c39fd4-4285-546f-ac27-0719c42d1e8f
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faccd050>
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3412%252F20473412%252Fexterior_rear_passenger-1774783618302.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_rear_passenger-1774783618302.jpeg saved to cache
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 613ee332-5aba-513c-904b-51832af61a86
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f916b890>
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7916%252F16857916%252F16857916-interior_boot-modified-1774689145192.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7916/16857916/16857916-interior_boot-modified-1774689145192.jpeg saved to cache
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a98941ea-7b61-540d-8fcc-baa07bc55dba
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faccc690>
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7916%252F16857916%252Fdocs_service_history-1774688370011.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D916e9aba5e00e8547198be4b6612b3ee') HTTP/1.1" 204 0
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7916/16857916/docs_service_history-1774688370011.jpeg?ixlib=js-3.8.0&auto=format&s=916e9aba5e00e8547198be4b6612b3ee saved to cache
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a98941ea-7b61-540d-8fcc-baa07bc55dba
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000?\xe8\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xdf\xd4\x0005\xde\x00\x00\x00\x00'
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac94210>
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3412%252F20473412%252Finterior_front_seats-1774783788253.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3412/20473412/interior_front_seats-1774783788253.jpeg saved to cache
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 613ee332-5aba-513c-904b-51832af61a86
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:26 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00>\xbd\xcb\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xbc\xc0\x00>\xb3\xc1\x00\x00\x00\x00'
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad8d9d0>
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3412%252F20473412%252Finterior_rear_seats-1774783897933.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3412/20473412/interior_rear_seats-1774783897933.jpeg saved to cache
2026-03-29 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 613ee332-5aba-513c-904b-51832af61a86
2026-03-29 20:08:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8 with identifier: 20374139
2026-03-29 20:08:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8 with identifier: 20374139
2026-03-29 20:08:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0e597a3d-fa48-519d-aa0a-a96b95f8fbf8 with identifier: 20374139 to the API
2026-03-29 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_rear_driver-1774708888686.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '0e597a3d-fa48-519d-aa0a-a96b95f8fbf8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'M9 YTN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20374139',
'listing': 'auction',
'location': 'South Lanarkshire Larkhall',
'make': 'Audi',
'model': 'S3',
'odometer': 37400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1609327,
'Height': 2457,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_front_driver-1774708879391.jpg',
'Width': 3276},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1515446,
'Height': 2241,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_rear_driver-1774708888686.jpg',
'Width': 2988},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1437381,
'Height': 2138,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_front_passenger-1774708769286.jpg',
'Width': 2851},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1407736,
'Height': 2357,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4139/20374139/exterior_rear_passenger-1774708724649.jpg',
'Width': 3142},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3225010,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4139/20374139/interior_front_seats-1774711350993.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3187286,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4139/20374139/interior_rear_seats-1774711428852.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2221143,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4139/20374139/20374139-interior_dashboard-modified-1774772423395.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4358973,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4139/20374139/interior_boot-1774711813840.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213576,
'Height': 2672,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4139/20374139/20374139-docs_service_history-modified-1774774429605.jpeg?ixlib=js-3.8.0&auto=format&s=7f377851501c4492c450844b8a4d6ac2',
'Width': 2004},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e597a3d-fa48-519d-aa0a-a96b95f8fbf8/0e597a3d-fa48-519d-aa0a-a96b95f8fbf8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1596904,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4139/20374139/damage_paintwork-1774709045989.jpg',
'Width': 4032}],
'price': 24726,
'price_includes_vat': False,
'registration_date': '2021-02-23',
'seats_number': None,
'seller_name': None,
'title': 'Audi S3 TFSI Quattro S-A',
'transmission': 'automatic',
'trim': 'TFSI Quattro S-A',
'vin': 'WAUZZZGY8MA058951',
'year': 2021}
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720374139%27 HTTP/1.1" 200 None
2026-03-29 20:08:27 [motorway.uk] INFO: Saving data for 20374139: {'created_time': 1774814907.250007, 'last_price_update_time': 1774814907.250019, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20374139') HTTP/1.1" 204 0
2026-03-29 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7916/16857916/16857916-instrument_cluster-modified-1774689168790.jpeg> (referer: None)
2026-03-29 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6195/20496195/docs_service_history-1774772789013.jpg?ixlib=js-3.8.0&auto=format&s=393f3914d6fec3ef7041a33d91b36511> (referer: None)
2026-03-29 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7916/16857916/16857916-interior_dashboard-modified-1774689097161.jpeg> (referer: None)
2026-03-29 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9713/8969713/exterior_front_passenger-1774624952298.jpg> (referer: None)
2026-03-29 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6195/20496195/instrument_cluster-1774772174292.jpg> (referer: None)
2026-03-29 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_front_passenger-1774783604807.jpeg> (referer: None)
2026-03-29 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7916/16857916/interior_rear_seats-1774687765635.jpeg> (referer: None)
2026-03-29 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6195/20496195/interior_boot-1774772137424.jpg> (referer: None)
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87012cc4d0>
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7916%252F16857916%252F16857916-instrument_cluster-modified-1774689168790.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7916/16857916/16857916-instrument_cluster-modified-1774689168790.jpeg saved to cache
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a98941ea-7b61-540d-8fcc-baa07bc55dba
2026-03-29 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_rear_passenger-1774687347618.jpeg> (referer: None)
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ad1e50>
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6195%252F20496195%252Fdocs_service_history-1774772789013.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D393f3914d6fec3ef7041a33d91b36511') HTTP/1.1" 204 0
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6195/20496195/docs_service_history-1774772789013.jpg?ixlib=js-3.8.0&auto=format&s=393f3914d6fec3ef7041a33d91b36511 saved to cache
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc4c82c5-cd98-500b-8281-51819578e163
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ac6a50>
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7916%252F16857916%252F16857916-interior_dashboard-modified-1774689097161.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7916/16857916/16857916-interior_dashboard-modified-1774689097161.jpeg saved to cache
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a98941ea-7b61-540d-8fcc-baa07bc55dba
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9423010>
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9713%252F8969713%252Fexterior_front_passenger-1774624952298.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9713/8969713/exterior_front_passenger-1774624952298.jpg saved to cache
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12c39fd4-4285-546f-ac27-0719c42d1e8f
2026-03-29 20:08:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94de0d0>
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6195%252F20496195%252Finstrument_cluster-1774772174292.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6195/20496195/instrument_cluster-1774772174292.jpg saved to cache
2026-03-29 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc4c82c5-cd98-500b-8281-51819578e163
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9421b90>
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3412%252F20473412%252Fexterior_front_passenger-1774783604807.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_front_passenger-1774783604807.jpeg saved to cache
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 613ee332-5aba-513c-904b-51832af61a86
2026-03-29 20:08:28 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:28 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:28 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1c\x8dn\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02&z\x00\x1c\x82\xec\x00\x00\x00\x00'
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac24b90>
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7916%252F16857916%252Finterior_rear_seats-1774687765635.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7916/16857916/interior_rear_seats-1774687765635.jpeg saved to cache
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a98941ea-7b61-540d-8fcc-baa07bc55dba
2026-03-29 20:08:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa6fa50>
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6195%252F20496195%252Finterior_boot-1774772137424.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6195/20496195/interior_boot-1774772137424.jpg saved to cache
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc4c82c5-cd98-500b-8281-51819578e163
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9135110>
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7916%252F16857916%252Fexterior_rear_passenger-1774687347618.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_rear_passenger-1774687347618.jpeg saved to cache
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a98941ea-7b61-540d-8fcc-baa07bc55dba
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2109/20402109/docs_service_history-1774697681356.jpg?ixlib=js-3.8.0&auto=format&s=2f5f65c64415d668edbdecd41c42ad54> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_front_passenger-1774687319749.jpeg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_rear_driver-1774687341229.jpeg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6195/20496195/interior_dashboard-1774772533629.jpg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_rear_passenger-1774771815594.jpg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9713/8969713/8969713-exterior_front_driver-modified-1774627108104.jpeg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7916/16857916/interior_front_seats-1774687712637.jpeg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_front_driver-1774783596983.jpeg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6195/20496195/interior_front_seats-1774772069301.jpg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2109/20402109/interior_boot-1774697468259.jpg> (referer: None)
2026-03-29 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6195/20496195/interior_rear_seats-1774772081340.jpg> (referer: None)
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa13c5d0>
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2109%252F20402109%252Fdocs_service_history-1774697681356.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2f5f65c64415d668edbdecd41c42ad54') HTTP/1.1" 204 0
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2109/20402109/docs_service_history-1774697681356.jpg?ixlib=js-3.8.0&auto=format&s=2f5f65c64415d668edbdecd41c42ad54 saved to cache
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d360b184-71d7-5a14-bba8-7a136df92017
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89a5e90>
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7916%252F16857916%252Fexterior_front_passenger-1774687319749.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_front_passenger-1774687319749.jpeg saved to cache
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a98941ea-7b61-540d-8fcc-baa07bc55dba
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94f3890>
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7916%252F16857916%252Fexterior_rear_driver-1774687341229.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_rear_driver-1774687341229.jpeg saved to cache
2026-03-29 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a98941ea-7b61-540d-8fcc-baa07bc55dba
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d2e50>
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6195%252F20496195%252Finterior_dashboard-1774772533629.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6195/20496195/interior_dashboard-1774772533629.jpg saved to cache
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc4c82c5-cd98-500b-8281-51819578e163
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89a5150>
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6195%252F20496195%252Fexterior_rear_passenger-1774771815594.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_rear_passenger-1774771815594.jpg saved to cache
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc4c82c5-cd98-500b-8281-51819578e163
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94f2990>
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9713%252F8969713%252F8969713-exterior_front_driver-modified-1774627108104.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9713/8969713/8969713-exterior_front_driver-modified-1774627108104.jpeg saved to cache
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12c39fd4-4285-546f-ac27-0719c42d1e8f
2026-03-29 20:08:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12c39fd4-4285-546f-ac27-0719c42d1e8f, skipping ID generation
2026-03-29 20:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12c39fd4-4285-546f-ac27-0719c42d1e8f with scrape type 1
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12c39fd4-4285-546f-ac27-0719c42d1e8f sending to next pipeline
2026-03-29 20:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 12c39fd4-4285-546f-ac27-0719c42d1e8f, identifier: 8969713
2026-03-29 20:08:29 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:29 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:29 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00!\xcbW\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02G\x7f\x00!\xc0\xd5\x00\x00\x00\x00'
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfeef90>
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7916%252F16857916%252Finterior_front_seats-1774687712637.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7916/16857916/interior_front_seats-1774687712637.jpeg saved to cache
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a98941ea-7b61-540d-8fcc-baa07bc55dba
2026-03-29 20:08:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a98941ea-7b61-540d-8fcc-baa07bc55dba, skipping ID generation
2026-03-29 20:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a98941ea-7b61-540d-8fcc-baa07bc55dba with scrape type 1
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a98941ea-7b61-540d-8fcc-baa07bc55dba sending to next pipeline
2026-03-29 20:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a98941ea-7b61-540d-8fcc-baa07bc55dba, identifier: 16857916
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f926b890>
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3412%252F20473412%252Fexterior_front_driver-1774783596983.jpeg') HTTP/1.1" 204 0
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_front_driver-1774783596983.jpeg saved to cache
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 613ee332-5aba-513c-904b-51832af61a86
2026-03-29 20:08:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 613ee332-5aba-513c-904b-51832af61a86, skipping ID generation
2026-03-29 20:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 613ee332-5aba-513c-904b-51832af61a86 with scrape type 1
2026-03-29 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 613ee332-5aba-513c-904b-51832af61a86 sending to next pipeline
2026-03-29 20:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 613ee332-5aba-513c-904b-51832af61a86, identifier: 20473412
2026-03-29 20:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 12c39fd4-4285-546f-ac27-0719c42d1e8f with identifier: 8969713
2026-03-29 20:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 12c39fd4-4285-546f-ac27-0719c42d1e8f with identifier: 8969713
2026-03-29 20:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 12c39fd4-4285-546f-ac27-0719c42d1e8f with identifier: 8969713 to the API
2026-03-29 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/9713/8969713/8969713-exterior_front_driver-modified-1774627108104.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '12c39fd4-4285-546f-ac27-0719c42d1e8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MK67 TUO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/8969713',
'listing': 'auction',
'location': 'South Yorkshire Sheffield',
'make': 'MINI',
'model': 'Cooper',
'odometer': 35000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2213199,
'Height': 2419,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9713/8969713/8969713-exterior_front_driver-modified-1774627108104.jpeg',
'Width': 3225},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1550946,
'Height': 2332,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9713/8969713/exterior_rear_driver-1774625028646.jpg',
'Width': 3109},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1380738,
'Height': 2408,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9713/8969713/exterior_front_passenger-1774624952298.jpg',
'Width': 3210},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1625392,
'Height': 2584,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9713/8969713/exterior_rear_passenger-1774624999817.jpg',
'Width': 3445},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3165218,
'Height': 3468,
'OriginUrl': 'https://motorway-photos.imgix.net/9713/8969713/interior_front_seats-1774625324395.jpg',
'Width': 4624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1688158,
'Height': 3468,
'OriginUrl': 'https://motorway-photos.imgix.net/9713/8969713/interior_rear_seats-1774625147117.jpg',
'Width': 4624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1862842,
'Height': 3468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9713/8969713/interior_dashboard-1774625201676.jpg',
'Width': 4624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2154986,
'Height': 3468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9713/8969713/instrument_cluster-1774625230559.jpg',
'Width': 4624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2705596,
'Height': 3468,
'OriginUrl': 'https://motorway-photos.imgix.net/9713/8969713/interior_boot-1774625273694.jpg',
'Width': 4624},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12c39fd4-4285-546f-ac27-0719c42d1e8f/12c39fd4-4285-546f-ac27-0719c42d1e8f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1036932,
'Height': 4624,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9713/8969713/8969713-docs_service_history-default-1774217267064.jpg?ixlib=js-3.8.0&auto=format&s=e16a06f110947b6e56b87075458a594a',
'Width': 2084}],
'price': 7816,
'price_includes_vat': False,
'registration_date': '2017-09-28',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper',
'transmission': 'manual',
'trim': '',
'vin': 'WMWXS520802G53327',
'year': 2017}
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278969713%27 HTTP/1.1" 200 None
2026-03-29 20:08:30 [motorway.uk] INFO: Saving data for 8969713: {'created_time': 1774814910.257452, 'last_price_update_time': 1774814910.257462, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='8969713') HTTP/1.1" 204 0
2026-03-29 20:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a98941ea-7b61-540d-8fcc-baa07bc55dba with identifier: 16857916
2026-03-29 20:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a98941ea-7b61-540d-8fcc-baa07bc55dba with identifier: 16857916
2026-03-29 20:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a98941ea-7b61-540d-8fcc-baa07bc55dba with identifier: 16857916 to the API
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7916/16857916/interior_front_seats-1774687712637.jpeg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'a98941ea-7b61-540d-8fcc-baa07bc55dba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'UR08 RJB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16857916',
'listing': 'auction',
'location': 'Cheshire East Nantwich',
'make': 'Audi',
'model': 'A6',
'odometer': 78337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 857705,
'Height': 2062,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_front_driver-1774687348812.jpeg',
'Width': 2749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1280088,
'Height': 2402,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_rear_driver-1774687341229.jpeg',
'Width': 3202},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1245250,
'Height': 2153,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_front_passenger-1774687319749.jpeg',
'Width': 2870},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 896246,
'Height': 2030,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7916/16857916/exterior_rear_passenger-1774687347618.jpeg',
'Width': 2706},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2364118,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7916/16857916/interior_front_seats-1774687712637.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2012136,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7916/16857916/interior_rear_seats-1774687765635.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1609142,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7916/16857916/16857916-interior_dashboard-modified-1774689097161.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1100625,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7916/16857916/16857916-instrument_cluster-modified-1774689168790.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3323760,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7916/16857916/16857916-interior_boot-modified-1774689145192.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a98941ea-7b61-540d-8fcc-baa07bc55dba/a98941ea-7b61-540d-8fcc-baa07bc55dba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2548816,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7916/16857916/docs_service_history-1774688370011.jpeg?ixlib=js-3.8.0&auto=format&s=916e9aba5e00e8547198be4b6612b3ee',
'Width': 4032}],
'price': 12682,
'price_includes_vat': False,
'registration_date': '2015-11-10',
'seats_number': None,
'seller_name': None,
'title': 'Audi A6 S Line Black ED TDI Quat SA',
'transmission': 'automatic',
'trim': 'S Line Black ED TDI Quat SA',
'vin': 'WAUZZZ4G5GN099997',
'year': 2015}
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716857916%27 HTTP/1.1" 200 None
2026-03-29 20:08:30 [motorway.uk] INFO: Saving data for 16857916: {'created_time': 1774814910.609438, 'last_price_update_time': 1774814910.609448, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16857916') HTTP/1.1" 204 0
2026-03-29 20:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 613ee332-5aba-513c-904b-51832af61a86 with identifier: 20473412
2026-03-29 20:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 613ee332-5aba-513c-904b-51832af61a86 with identifier: 20473412
2026-03-29 20:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 613ee332-5aba-513c-904b-51832af61a86 with identifier: 20473412 to the API
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_front_driver-1774783596983.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '613ee332-5aba-513c-904b-51832af61a86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD17 WHZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20473412',
'listing': 'auction',
'location': 'Surrey Camberley',
'make': 'Ford',
'model': 'Focus',
'odometer': 92237,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2465294,
'Height': 2642,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_front_driver-1774783596983.jpeg',
'Width': 3522},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1618251,
'Height': 2326,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_rear_driver-1774783639194.jpeg',
'Width': 3101},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1825556,
'Height': 2457,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_front_passenger-1774783604807.jpeg',
'Width': 3276},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2202680,
'Height': 2661,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3412/20473412/exterior_rear_passenger-1774783618302.jpeg',
'Width': 3548},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3350460,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3412/20473412/interior_front_seats-1774783788253.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4291211,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3412/20473412/interior_rear_seats-1774783897933.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3744215,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3412/20473412/interior_dashboard-1774783926705.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2721539,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3412/20473412/instrument_cluster-1774783967744.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4965718,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3412/20473412/interior_boot-1774783958854.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613ee332-5aba-513c-904b-51832af61a86/613ee332-5aba-513c-904b-51832af61a86_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4176917,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3412/20473412/damage_scratches-1774784068680.jpeg',
'Width': 4032}],
'price': 2267,
'price_includes_vat': False,
'registration_date': '2017-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus Zetec Edition',
'transmission': 'manual',
'trim': 'Zetec Edition',
'vin': 'WF05XXGCC5HM08282',
'year': 2017}
2026-03-29 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473412%27 HTTP/1.1" 200 None
2026-03-29 20:08:31 [motorway.uk] INFO: Saving data for 20473412: {'created_time': 1774814911.004508, 'last_price_update_time': 1774814911.004518, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20473412') HTTP/1.1" 204 0
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad57450>
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6195%252F20496195%252Finterior_front_seats-1774772069301.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6195/20496195/interior_front_seats-1774772069301.jpg saved to cache
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc4c82c5-cd98-500b-8281-51819578e163
2026-03-29 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_front_driver-1774771753814.jpg> (referer: None)
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8971a90>
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2109%252F20402109%252Finterior_boot-1774697468259.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2109/20402109/interior_boot-1774697468259.jpg saved to cache
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d360b184-71d7-5a14-bba8-7a136df92017
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafea010>
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6195%252F20496195%252Finterior_rear_seats-1774772081340.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6195/20496195/interior_rear_seats-1774772081340.jpg saved to cache
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc4c82c5-cd98-500b-8281-51819578e163
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadace90>
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6195%252F20496195%252Fexterior_front_driver-1774771753814.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_front_driver-1774771753814.jpg saved to cache
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc4c82c5-cd98-500b-8281-51819578e163
2026-03-29 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_front_passenger-1774107369694.jpg> (referer: None)
2026-03-29 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2332/20502332/docs_service_history-1774787327211.jpg?ixlib=js-3.8.0&auto=format&s=a88fcf30e5c7a856faf8baba0158fe16> (referer: None)
2026-03-29 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_front_passenger-1774771787911.jpg> (referer: None)
2026-03-29 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_rear_driver-1774771916491.jpg> (referer: None)
2026-03-29 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2109/20402109/instrument_cluster-1774697295576.jpg> (referer: None)
2026-03-29 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2332/20502332/interior_boot-1774787120582.jpg> (referer: None)
2026-03-29 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2109/20402109/interior_front_seats-1774697186533.jpg> (referer: None)
2026-03-29 20:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2109/20402109/interior_rear_seats-1774697243900.jpg> (referer: None)
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cc34d0>
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2202%252F19182202%252Fexterior_front_passenger-1774107369694.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_front_passenger-1774107369694.jpg saved to cache
2026-03-29 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efcf04b4-eb56-533f-86b2-e1e3275c0e93
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95d46d0>
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2332%252F20502332%252Fdocs_service_history-1774787327211.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da88fcf30e5c7a856faf8baba0158fe16') HTTP/1.1" 204 0
2026-03-29 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2332/20502332/docs_service_history-1774787327211.jpg?ixlib=js-3.8.0&auto=format&s=a88fcf30e5c7a856faf8baba0158fe16 saved to cache
2026-03-29 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9604ad0>
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6195%252F20496195%252Fexterior_front_passenger-1774771787911.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_front_passenger-1774771787911.jpg saved to cache
2026-03-29 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc4c82c5-cd98-500b-8281-51819578e163
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa13cd10>
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6195%252F20496195%252Fexterior_rear_driver-1774771916491.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_rear_driver-1774771916491.jpg saved to cache
2026-03-29 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc4c82c5-cd98-500b-8281-51819578e163
2026-03-29 20:08:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc4c82c5-cd98-500b-8281-51819578e163, skipping ID generation
2026-03-29 20:08:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc4c82c5-cd98-500b-8281-51819578e163 with scrape type 1
2026-03-29 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc4c82c5-cd98-500b-8281-51819578e163 sending to next pipeline
2026-03-29 20:08:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bc4c82c5-cd98-500b-8281-51819578e163, identifier: 20496195
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9668610>
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2109%252F20402109%252Finstrument_cluster-1774697295576.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2109/20402109/instrument_cluster-1774697295576.jpg saved to cache
2026-03-29 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d360b184-71d7-5a14-bba8-7a136df92017
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8267450>
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2332%252F20502332%252Finterior_boot-1774787120582.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2332/20502332/interior_boot-1774787120582.jpg saved to cache
2026-03-29 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf59b10>
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2109%252F20402109%252Finterior_front_seats-1774697186533.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2109/20402109/interior_front_seats-1774697186533.jpg saved to cache
2026-03-29 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d360b184-71d7-5a14-bba8-7a136df92017
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88d9810>
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2109%252F20402109%252Finterior_rear_seats-1774697243900.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2109/20402109/interior_rear_seats-1774697243900.jpg saved to cache
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d360b184-71d7-5a14-bba8-7a136df92017
2026-03-29 20:08:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d360b184-71d7-5a14-bba8-7a136df92017, skipping ID generation
2026-03-29 20:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d360b184-71d7-5a14-bba8-7a136df92017 with scrape type 1
2026-03-29 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d360b184-71d7-5a14-bba8-7a136df92017 sending to next pipeline
2026-03-29 20:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d360b184-71d7-5a14-bba8-7a136df92017, identifier: 20402109
2026-03-29 20:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bc4c82c5-cd98-500b-8281-51819578e163 with identifier: 20496195
2026-03-29 20:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bc4c82c5-cd98-500b-8281-51819578e163 with identifier: 20496195
2026-03-29 20:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bc4c82c5-cd98-500b-8281-51819578e163 with identifier: 20496195 to the API
2026-03-29 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_rear_driver-1774771916491.jpg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bc4c82c5-cd98-500b-8281-51819578e163',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'M14 BHG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20496195',
'listing': 'auction',
'location': 'West Midlands Bilston',
'make': 'Fiat',
'model': '500',
'odometer': 51265,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1501794,
'Height': 2736,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_front_driver-1774771753814.jpg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1751236,
'Height': 3000,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_rear_driver-1774771916491.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1657523,
'Height': 2897,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_front_passenger-1774771787911.jpg',
'Width': 3863},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1588566,
'Height': 2984,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6195/20496195/exterior_rear_passenger-1774771815594.jpg',
'Width': 3979},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4257823,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6195/20496195/interior_front_seats-1774772069301.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5226864,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6195/20496195/interior_rear_seats-1774772081340.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1848506,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6195/20496195/interior_dashboard-1774772533629.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1970248,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6195/20496195/instrument_cluster-1774772174292.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3147608,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6195/20496195/interior_boot-1774772137424.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc4c82c5-cd98-500b-8281-51819578e163/bc4c82c5-cd98-500b-8281-51819578e163_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605100,
'Height': 3517,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6195/20496195/docs_service_history-1774772789013.jpg?ixlib=js-3.8.0&auto=format&s=393f3914d6fec3ef7041a33d91b36511',
'Width': 2359}],
'price': 2957,
'price_includes_vat': False,
'registration_date': '2015-08-11',
'seats_number': None,
'seller_name': None,
'title': 'Fiat 500 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'vin': 'ZFA3120000J449241',
'year': 2015}
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720496195%27 HTTP/1.1" 200 None
2026-03-29 20:08:34 [motorway.uk] INFO: Saving data for 20496195: {'created_time': 1774814914.250721, 'last_price_update_time': 1774814914.250738, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20496195') HTTP/1.1" 204 0
2026-03-29 20:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d360b184-71d7-5a14-bba8-7a136df92017 with identifier: 20402109
2026-03-29 20:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d360b184-71d7-5a14-bba8-7a136df92017 with identifier: 20402109
2026-03-29 20:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d360b184-71d7-5a14-bba8-7a136df92017 with identifier: 20402109 to the API
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2109/20402109/interior_rear_seats-1774697243900.jpg>
{'auction_title': '',
'category': None,
'color': 'Orange',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd360b184-71d7-5a14-bba8-7a136df92017',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV18 SZE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20402109',
'listing': 'auction',
'location': 'Gloucestershire Dursley',
'make': 'Vauxhall',
'model': 'Mokka',
'odometer': 91118,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2235382,
'Height': 2876,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_front_driver-1774696604912.jpg',
'Width': 3834},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1576850,
'Height': 2586,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_rear_driver-1774696619636.jpg',
'Width': 3448},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1441876,
'Height': 2552,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_front_passenger-1774696649705.jpg',
'Width': 3403},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1679489,
'Height': 2852,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2109/20402109/exterior_rear_passenger-1774696682416.jpg',
'Width': 3803},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4269745,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2109/20402109/interior_front_seats-1774697186533.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5616359,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2109/20402109/interior_rear_seats-1774697243900.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2743277,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2109/20402109/interior_dashboard-1774697311384.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2453113,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2109/20402109/instrument_cluster-1774697295576.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4767053,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2109/20402109/interior_boot-1774697468259.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d360b184-71d7-5a14-bba8-7a136df92017/d360b184-71d7-5a14-bba8-7a136df92017_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370259,
'Height': 1129,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2109/20402109/docs_service_history-1774697681356.jpg?ixlib=js-3.8.0&auto=format&s=2f5f65c64415d668edbdecd41c42ad54',
'Width': 3118}],
'price': 3271,
'price_includes_vat': False,
'registration_date': '2018-06-18',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Mokka X Active Ecotec S/S',
'transmission': 'manual',
'trim': 'X Active Ecotec S/S',
'vin': 'W0VJC7E84JB702904',
'year': 2018}
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720402109%27 HTTP/1.1" 200 None
2026-03-29 20:08:34 [motorway.uk] INFO: Saving data for 20402109: {'created_time': 1774814914.639612, 'last_price_update_time': 1774814914.639628, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20402109') HTTP/1.1" 204 0
2026-03-29 20:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_rear_driver-1774107341747.jpg> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_front_driver-1774107385017.jpg> (referer: None)
2026-03-29 20:08:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7464/20417464/docs_service_history-1774673984639.jpg?ixlib=js-3.8.0&auto=format&s=b5d5c3a78202a77e12acc1489f39d904> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7464/20417464/instrument_cluster-1774340320332.jpg> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7464/20417464/interior_dashboard-1774779413487.jpg> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2332/20502332/instrument_cluster-1774787168846.jpg> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2332/20502332/interior_front_seats-1774787073690.jpg> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2332/20502332/interior_rear_seats-1774787090641.jpg> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2332/20502332/interior_dashboard-1774787167348.jpg> (referer: None)
2026-03-29 20:08:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7464/20417464/interior_boot-1774340297153.jpg> (referer: None)
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f870119ccd0>
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2202%252F19182202%252Fexterior_rear_driver-1774107341747.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_rear_driver-1774107341747.jpg saved to cache
2026-03-29 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efcf04b4-eb56-533f-86b2-e1e3275c0e93
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa155f50>
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2202%252F19182202%252Fexterior_front_driver-1774107385017.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_front_driver-1774107385017.jpg saved to cache
2026-03-29 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efcf04b4-eb56-533f-86b2-e1e3275c0e93
2026-03-29 20:08:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efcf04b4-eb56-533f-86b2-e1e3275c0e93, skipping ID generation
2026-03-29 20:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efcf04b4-eb56-533f-86b2-e1e3275c0e93 with scrape type 1
2026-03-29 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efcf04b4-eb56-533f-86b2-e1e3275c0e93 sending to next pipeline
2026-03-29 20:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: efcf04b4-eb56-533f-86b2-e1e3275c0e93, identifier: 19182202
2026-03-29 20:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: efcf04b4-eb56-533f-86b2-e1e3275c0e93 with identifier: 19182202
2026-03-29 20:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: efcf04b4-eb56-533f-86b2-e1e3275c0e93 with identifier: 19182202
2026-03-29 20:08:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: efcf04b4-eb56-533f-86b2-e1e3275c0e93 with identifier: 19182202 to the API
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_front_driver-1774107385017.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'efcf04b4-eb56-533f-86b2-e1e3275c0e93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BC16 SXD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19182202',
'listing': 'auction',
'location': 'Warwickshire Coventry',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 78411,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 843669,
'Height': 1817,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_front_driver-1774107385017.jpg',
'Width': 2423},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 936549,
'Height': 1855,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_rear_driver-1774107341747.jpg',
'Width': 2473},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1112194,
'Height': 2135,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_front_passenger-1774107369694.jpg',
'Width': 2846},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 663757,
'Height': 1733,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2202/19182202/exterior_rear_passenger-1774107353667.jpg',
'Width': 2310},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2597266,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2202/19182202/interior_front_seats-1774629176067.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2613853,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2202/19182202/interior_rear_seats-1774629233295.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 769820,
'Height': 1827,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2202/19182202/interior_dashboard-1774702518894.jpg',
'Width': 2436},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2197104,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2202/19182202/instrument_cluster-1774108362600.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3464933,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2202/19182202/interior_boot-1774108116507.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efcf04b4-eb56-533f-86b2-e1e3275c0e93/efcf04b4-eb56-533f-86b2-e1e3275c0e93_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 515682,
'Height': 2655,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2202/19182202/docs_service_history-1774277326225.jpg?ixlib=js-3.8.0&auto=format&s=a0a0283dadc59db8191963b3b33c8d7d',
'Width': 1937}],
'price': 4215,
'price_includes_vat': False,
'registration_date': '2016-08-20',
'seats_number': None,
'seller_name': None,
'title': 'Ford Mondeo Zetec Econetic TDCI',
'transmission': 'manual',
'trim': 'Zetec Econetic TDCI',
'vin': 'WF0EXXWPCEGK53862',
'year': 2016}
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719182202%27 HTTP/1.1" 200 None
2026-03-29 20:08:35 [motorway.uk] INFO: Saving data for 19182202: {'created_time': 1774814915.427058, 'last_price_update_time': 1774814915.427068, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19182202') HTTP/1.1" 204 0
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa48610>
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7464%252F20417464%252Fdocs_service_history-1774673984639.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db5d5c3a78202a77e12acc1489f39d904') HTTP/1.1" 204 0
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7464/20417464/docs_service_history-1774673984639.jpg?ixlib=js-3.8.0&auto=format&s=b5d5c3a78202a77e12acc1489f39d904 saved to cache
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c918b564-9ffe-5877-8970-b8ff9bffee8f
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faca8610>
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7464%252F20417464%252Finstrument_cluster-1774340320332.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7464/20417464/instrument_cluster-1774340320332.jpg saved to cache
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c918b564-9ffe-5877-8970-b8ff9bffee8f
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa02eb90>
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7464%252F20417464%252Finterior_dashboard-1774779413487.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7464/20417464/interior_dashboard-1774779413487.jpg saved to cache
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c918b564-9ffe-5877-8970-b8ff9bffee8f
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa49850>
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2332%252F20502332%252Finstrument_cluster-1774787168846.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2332/20502332/instrument_cluster-1774787168846.jpg saved to cache
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9099790>
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2332%252F20502332%252Finterior_front_seats-1774787073690.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2332/20502332/interior_front_seats-1774787073690.jpg saved to cache
2026-03-29 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cb3250>
2026-03-29 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2332%252F20502332%252Finterior_rear_seats-1774787090641.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2332/20502332/interior_rear_seats-1774787090641.jpg saved to cache
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f828c5d0>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2332%252F20502332%252Finterior_dashboard-1774787167348.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2332/20502332/interior_dashboard-1774787167348.jpg saved to cache
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facabb10>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7464%252F20417464%252Finterior_boot-1774340297153.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7464/20417464/interior_boot-1774340297153.jpg saved to cache
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c918b564-9ffe-5877-8970-b8ff9bffee8f
2026-03-29 20:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_front_passenger-1774339856516.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_rear_driver-1774339808190.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_rear_driver-1774786641223.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_rear_passenger-1774786653687.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_rear_passenger-1774339836616.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_front_driver-1774786624968.jpg> (referer: None)
2026-03-29 20:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7464/20417464/interior_front_seats-1774340216933.jpg> (referer: None)
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f951ad10>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7464%252F20417464%252Fexterior_front_passenger-1774339856516.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_front_passenger-1774339856516.jpg saved to cache
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c918b564-9ffe-5877-8970-b8ff9bffee8f
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f3c490>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7464%252F20417464%252Fexterior_rear_driver-1774339808190.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_rear_driver-1774339808190.jpg saved to cache
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c918b564-9ffe-5877-8970-b8ff9bffee8f
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadaebd0>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2332%252F20502332%252Fexterior_rear_driver-1774786641223.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_rear_driver-1774786641223.jpg saved to cache
2026-03-29 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa1d2d0>
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2332%252F20502332%252Fexterior_rear_passenger-1774786653687.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_rear_passenger-1774786653687.jpg saved to cache
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafea610>
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7464%252F20417464%252Fexterior_rear_passenger-1774339836616.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_rear_passenger-1774339836616.jpg saved to cache
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c918b564-9ffe-5877-8970-b8ff9bffee8f
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9519150>
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2332%252F20502332%252Fexterior_front_driver-1774786624968.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_front_driver-1774786624968.jpg saved to cache
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e
2026-03-29 20:08:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24ecfa21-23ac-52ac-8997-2524c5af1f5e, skipping ID generation
2026-03-29 20:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e with scrape type 1
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24ecfa21-23ac-52ac-8997-2524c5af1f5e sending to next pipeline
2026-03-29 20:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 24ecfa21-23ac-52ac-8997-2524c5af1f5e, identifier: 20502332
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8dd15d0>
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7464%252F20417464%252Finterior_front_seats-1774340216933.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7464/20417464/interior_front_seats-1774340216933.jpg saved to cache
2026-03-29 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c918b564-9ffe-5877-8970-b8ff9bffee8f
2026-03-29 20:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 24ecfa21-23ac-52ac-8997-2524c5af1f5e with identifier: 20502332
2026-03-29 20:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 24ecfa21-23ac-52ac-8997-2524c5af1f5e with identifier: 20502332
2026-03-29 20:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 24ecfa21-23ac-52ac-8997-2524c5af1f5e with identifier: 20502332 to the API
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_front_driver-1774786624968.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '24ecfa21-23ac-52ac-8997-2524c5af1f5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SA62 VBM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20502332',
'listing': 'auction',
'location': 'Brighton and Hove Brighton',
'make': 'Hyundai',
'model': 'I10',
'odometer': 58000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2509613,
'Height': 2881,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_front_driver-1774786624968.jpg',
'Width': 3841},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1580771,
'Height': 2410,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_rear_driver-1774786641223.jpg',
'Width': 3213},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1981794,
'Height': 2738,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_front_passenger-1774786674558.jpg',
'Width': 3651},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1652319,
'Height': 2324,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2332/20502332/exterior_rear_passenger-1774786653687.jpg',
'Width': 3099},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3509414,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2332/20502332/interior_front_seats-1774787073690.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3710980,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2332/20502332/interior_rear_seats-1774787090641.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3839072,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2332/20502332/interior_dashboard-1774787167348.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3133631,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2332/20502332/instrument_cluster-1774787168846.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3518505,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2332/20502332/interior_boot-1774787120582.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ecfa21-23ac-52ac-8997-2524c5af1f5e/24ecfa21-23ac-52ac-8997-2524c5af1f5e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 844796,
'Height': 2153,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2332/20502332/docs_service_history-1774787327211.jpg?ixlib=js-3.8.0&auto=format&s=a88fcf30e5c7a856faf8baba0158fe16',
'Width': 4295}],
'price': 1763,
'price_includes_vat': False,
'registration_date': '2012-09-28',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai I10 Classic',
'transmission': 'manual',
'trim': 'Classic',
'vin': 'MALAN51CLDM231287',
'year': 2012}
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720502332%27 HTTP/1.1" 200 None
2026-03-29 20:08:37 [motorway.uk] INFO: Saving data for 20502332: {'created_time': 1774814917.831153, 'last_price_update_time': 1774814917.831164, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20502332') HTTP/1.1" 204 0
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1476&page=41&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_front_passenger-1774699333787.jpg> (referer: None)
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_front_driver-1774339777959.jpg> (referer: None)
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_rear_driver-1774699300212.jpg> (referer: None)
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2278/11012278/interior_front_seats-1774700950326.jpg> (referer: None)
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2278/11012278/interior_rear_seats-1774700921316.jpg> (referer: None)
2026-03-29 20:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9067/19609067/damage_scratches-1774697154025.jpg> (referer: None)
2026-03-29 20:08:37 [motorway.uk] INFO: Found listing with ID: 20486464
2026-03-29 20:08:37 [motorway.uk] INFO: Found listing with ID: 20440188
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720440188%27 HTTP/1.1" 200 None
2026-03-29 20:08:37 [motorway.uk] INFO: Scrape type for 20440188: 1
2026-03-29 20:08:37 [motorway.uk] INFO: Found listing with ID: 19993213
2026-03-29 20:08:37 [motorway.uk] INFO: Found listing with ID: 20487855
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487855%27 HTTP/1.1" 200 None
2026-03-29 20:08:38 [motorway.uk] INFO: Scrape type for 20487855: 1
2026-03-29 20:08:38 [motorway.uk] INFO: Found listing with ID: 20286408
2026-03-29 20:08:38 [motorway.uk] INFO: Found listing with ID: 20343631
2026-03-29 20:08:38 [motorway.uk] INFO: Found listing with ID: 18279854
2026-03-29 20:08:38 [motorway.uk] INFO: Found listing with ID: 20486910
2026-03-29 20:08:38 [motorway.uk] INFO: Found listing with ID: 20396662
2026-03-29 20:08:38 [motorway.uk] INFO: Found listing with ID: 20497111
2026-03-29 20:08:38 [motorway.uk] INFO: Found listing with ID: 18991251
2026-03-29 20:08:38 [motorway.uk] INFO: Found listing with ID: 19358574
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719358574%27 HTTP/1.1" 200 None
2026-03-29 20:08:38 [motorway.uk] INFO: Scrape type for 19358574: 1
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9171190>
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2278%252F11012278%252Fexterior_front_passenger-1774699333787.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_front_passenger-1774699333787.jpg saved to cache
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad8fa90>
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7464%252F20417464%252Fexterior_front_driver-1774339777959.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_front_driver-1774339777959.jpg saved to cache
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c918b564-9ffe-5877-8970-b8ff9bffee8f
2026-03-29 20:08:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c918b564-9ffe-5877-8970-b8ff9bffee8f, skipping ID generation
2026-03-29 20:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c918b564-9ffe-5877-8970-b8ff9bffee8f with scrape type 1
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c918b564-9ffe-5877-8970-b8ff9bffee8f sending to next pipeline
2026-03-29 20:08:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c918b564-9ffe-5877-8970-b8ff9bffee8f, identifier: 20417464
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafeaad0>
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2278%252F11012278%252Fexterior_rear_driver-1774699300212.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_rear_driver-1774699300212.jpg saved to cache
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0
2026-03-29 20:08:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad8c950>
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2278%252F11012278%252Finterior_front_seats-1774700950326.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2278/11012278/interior_front_seats-1774700950326.jpg saved to cache
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0
2026-03-29 20:08:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f944bd10>
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2278%252F11012278%252Finterior_rear_seats-1774700921316.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2278/11012278/interior_rear_seats-1774700921316.jpg saved to cache
2026-03-29 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0
2026-03-29 20:08:38 [motorway.uk] INFO: Found listing with ID: 19916190
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719916190%27 HTTP/1.1" 200 None
2026-03-29 20:08:38 [motorway.uk] INFO: Scrape type for 19916190: 1
2026-03-29 20:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c918b564-9ffe-5877-8970-b8ff9bffee8f with identifier: 20417464
2026-03-29 20:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c918b564-9ffe-5877-8970-b8ff9bffee8f with identifier: 20417464
2026-03-29 20:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c918b564-9ffe-5877-8970-b8ff9bffee8f with identifier: 20417464 to the API
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_front_driver-1774339777959.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c918b564-9ffe-5877-8970-b8ff9bffee8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BJ68 YFV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20417464',
'listing': 'auction',
'location': 'Suffolk Woodbridge',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 72875,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1921353,
'Height': 2450,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_front_driver-1774339777959.jpg',
'Width': 3267},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1107180,
'Height': 1937,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_rear_driver-1774339808190.jpg',
'Width': 2583},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1018572,
'Height': 1877,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_front_passenger-1774339856516.jpg',
'Width': 2502},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1851040,
'Height': 2437,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7464/20417464/exterior_rear_passenger-1774339836616.jpg',
'Width': 3249},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3492083,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7464/20417464/interior_front_seats-1774340216933.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2959053,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7464/20417464/interior_rear_seats-1774340235657.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2335757,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7464/20417464/interior_dashboard-1774779413487.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2245041,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7464/20417464/instrument_cluster-1774340320332.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4225302,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7464/20417464/interior_boot-1774340297153.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c918b564-9ffe-5877-8970-b8ff9bffee8f/c918b564-9ffe-5877-8970-b8ff9bffee8f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1302152,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7464/20417464/docs_service_history-1774673984639.jpg?ixlib=js-3.8.0&auto=format&s=b5d5c3a78202a77e12acc1489f39d904',
'Width': 3024}],
'price': 4209,
'price_includes_vat': False,
'registration_date': '2018-09-26',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Zetec',
'transmission': 'manual',
'trim': 'Zetec',
'vin': 'WF0FXXGAHFJU20643',
'year': 2018}
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720417464%27 HTTP/1.1" 200 None
2026-03-29 20:08:38 [motorway.uk] INFO: Saving data for 20417464: {'created_time': 1774814918.953828, 'last_price_update_time': 1774814918.953839, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20417464') HTTP/1.1" 204 0
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fb9190>
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_462f132d-00b0-5fda-8de3-ae57293b496e/462f132d-00b0-5fda-8de3-ae57293b496e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9067%252F19609067%252Fdamage_scratches-1774697154025.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9067/19609067/damage_scratches-1774697154025.jpg saved to cache
2026-03-29 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 462f132d-00b0-5fda-8de3-ae57293b496e
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20386914
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20473571
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20372718
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 19803994
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 6427001
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 18641808
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20288623
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20475034
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 18052166
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20487961
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 19939510
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719939510%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Scrape type for 19939510: 1
2026-03-29 20:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20461256
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720461256%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Scrape type for 20461256: 1
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 19966592
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 18928323
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20009911
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20350681
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720350681%27 HTTP/1.1" 200 None
2026-03-29 20:08:39 [motorway.uk] INFO: Scrape type for 20350681: 1
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4485/20474485/docs_service_history-1774708582270.jpg?ixlib=js-3.8.0&auto=format&s=a25fd08292f534d61941e65449f4771a> (referer: None)
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20480204
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 17069635
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 19856222
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 19751356
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 6251802
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 16994244
2026-03-29 20:08:39 [motorway.uk] INFO: Found listing with ID: 20200314
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9067/19609067/interior_boot-1774356458428.jpg> (referer: None)
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9067/19609067/interior_rear_seats-1774358017285.jpg> (referer: None)
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_front_driver-1774699249100.jpg> (referer: None)
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9067/19609067/interior_front_seats-1774695851449.jpg> (referer: None)
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4485/20474485/interior_dashboard-1774708291897.jpg> (referer: None)
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4485/20474485/interior_boot-1774708307349.jpg> (referer: None)
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac24a10>
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dc8c59c-3467-5a4e-8fcc-1049589942b3/6dc8c59c-3467-5a4e-8fcc-1049589942b3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4485%252F20474485%252Fdocs_service_history-1774708582270.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da25fd08292f534d61941e65449f4771a') HTTP/1.1" 204 0
2026-03-29 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4485/20474485/docs_service_history-1774708582270.jpg?ixlib=js-3.8.0&auto=format&s=a25fd08292f534d61941e65449f4771a saved to cache
2026-03-29 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6dc8c59c-3467-5a4e-8fcc-1049589942b3
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18256517.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487830.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19333728.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f934c250>
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_462f132d-00b0-5fda-8de3-ae57293b496e/462f132d-00b0-5fda-8de3-ae57293b496e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9067%252F19609067%252Finterior_boot-1774356458428.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9067/19609067/interior_boot-1774356458428.jpg saved to cache
2026-03-29 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 462f132d-00b0-5fda-8de3-ae57293b496e
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad244d0>
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_462f132d-00b0-5fda-8de3-ae57293b496e/462f132d-00b0-5fda-8de3-ae57293b496e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9067%252F19609067%252Finterior_rear_seats-1774358017285.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9067/19609067/interior_rear_seats-1774358017285.jpg saved to cache
2026-03-29 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 462f132d-00b0-5fda-8de3-ae57293b496e
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebeab4d0>
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2278%252F11012278%252Fexterior_front_driver-1774699249100.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_front_driver-1774699249100.jpg saved to cache
2026-03-29 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0
2026-03-29 20:08:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7e3bd637-ae50-566a-852c-f7d1368fc5a0, skipping ID generation
2026-03-29 20:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0 with scrape type 1
2026-03-29 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7e3bd637-ae50-566a-852c-f7d1368fc5a0 sending to next pipeline
2026-03-29 20:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7e3bd637-ae50-566a-852c-f7d1368fc5a0, identifier: 11012278
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8111290>
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_462f132d-00b0-5fda-8de3-ae57293b496e/462f132d-00b0-5fda-8de3-ae57293b496e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9067%252F19609067%252Finterior_front_seats-1774695851449.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9067/19609067/interior_front_seats-1774695851449.jpg saved to cache
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 462f132d-00b0-5fda-8de3-ae57293b496e
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f880aed0>
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dc8c59c-3467-5a4e-8fcc-1049589942b3/6dc8c59c-3467-5a4e-8fcc-1049589942b3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F20474485%252Finterior_dashboard-1774708291897.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/20474485/interior_dashboard-1774708291897.jpg saved to cache
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6dc8c59c-3467-5a4e-8fcc-1049589942b3
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cc3410>
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dc8c59c-3467-5a4e-8fcc-1049589942b3/6dc8c59c-3467-5a4e-8fcc-1049589942b3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4485%252F20474485%252Finterior_boot-1774708307349.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4485/20474485/interior_boot-1774708307349.jpg saved to cache
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6dc8c59c-3467-5a4e-8fcc-1049589942b3
2026-03-29 20:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7e3bd637-ae50-566a-852c-f7d1368fc5a0 with identifier: 11012278
2026-03-29 20:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7e3bd637-ae50-566a-852c-f7d1368fc5a0 with identifier: 11012278
2026-03-29 20:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7e3bd637-ae50-566a-852c-f7d1368fc5a0 with identifier: 11012278 to the API
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_front_driver-1774699249100.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7e3bd637-ae50-566a-852c-f7d1368fc5a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KO17 NFN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/11012278',
'listing': 'auction',
'location': 'North Somerset Clevedon',
'make': 'BMW',
'model': '1 Series',
'odometer': 75600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2671881,
'Height': 2748,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_front_driver-1774699249100.jpg',
'Width': 3664},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2148135,
'Height': 2660,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_rear_driver-1774699300212.jpg',
'Width': 3546},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1075687,
'Height': 2069,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_front_passenger-1774699333787.jpg',
'Width': 2759},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1677959,
'Height': 2420,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2278/11012278/exterior_rear_passenger-1774699315746.jpg',
'Width': 3227},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3189667,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2278/11012278/interior_front_seats-1774700950326.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3248050,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2278/11012278/interior_rear_seats-1774700921316.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2281836,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2278/11012278/interior_dashboard-1774702851615.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4130911,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2278/11012278/interior_boot-1774700898194.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1410840,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2278/11012278/docs_service_history-1774702183646.jpg?ixlib=js-3.8.0&auto=format&s=23f50d046c202053aba24e53d5be58e8',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e3bd637-ae50-566a-852c-f7d1368fc5a0/7e3bd637-ae50-566a-852c-f7d1368fc5a0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 605327,
'Height': 2532,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2278/11012278/docs_service_history-1774702209271.jpg?ixlib=js-3.8.0&auto=format&s=c3a537c7bd15f5b642c42bc68a72a93f',
'Width': 1170}],
'price': 7395,
'price_includes_vat': False,
'registration_date': '2017-06-08',
'seats_number': None,
'seller_name': None,
'title': 'BMW 118I M Sport',
'transmission': 'manual',
'trim': '118I M Sport',
'vin': 'WBA1R520005D47559',
'year': 2017}
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711012278%27 HTTP/1.1" 200 None
2026-03-29 20:08:40 [motorway.uk] INFO: Saving data for 11012278: {'created_time': 1774814920.676562, 'last_price_update_time': 1774814920.676572, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='11012278') HTTP/1.1" 204 0
2026-03-29 20:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14034746.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 480f8f19-a5c2-5972-8784-684ba4d731dd with identifier: 18256517
2026-03-29 20:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 480f8f19-a5c2-5972-8784-684ba4d731dd with scrape type 1
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 480f8f19-a5c2-5972-8784-684ba4d731dd
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6517%252F18256517%252Fexterior_front_driver-1774693473585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6517/18256517/exterior_front_driver-1774693473585.jpg not downloaded yet
2026-03-29 20:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a77d16fc-de8a-5e5b-8235-e57c217245e6 with identifier: 20487830
2026-03-29 20:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a77d16fc-de8a-5e5b-8235-e57c217245e6 with scrape type 1
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a77d16fc-de8a-5e5b-8235-e57c217245e6
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7830%252F20487830%252Fexterior_front_driver-1774702332588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7830/20487830/exterior_front_driver-1774702332588.jpg not downloaded yet
2026-03-29 20:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc8a22b-5330-5244-9afd-41d06f41bf9e with identifier: 19333728
2026-03-29 20:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecc8a22b-5330-5244-9afd-41d06f41bf9e with scrape type 1
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ecc8a22b-5330-5244-9afd-41d06f41bf9e
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3728%252F19333728%252Fexterior_front_driver-1774705123026.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3728/19333728/exterior_front_driver-1774705123026.jpeg not downloaded yet
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6517%252F18256517%252Fexterior_rear_driver-1774693508669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6517/18256517/exterior_rear_driver-1774693508669.jpg not downloaded yet
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7830%252F20487830%252Fexterior_rear_driver-1774702331649.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7830/20487830/exterior_rear_driver-1774702331649.jpg not downloaded yet
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3728%252F19333728%252Fexterior_rear_driver-1774705496050.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3728/19333728/exterior_rear_driver-1774705496050.jpeg not downloaded yet
2026-03-29 20:08:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b1b9467-95c7-57e5-bcb9-7a995a57c8ad with identifier: 14034746
2026-03-29 20:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b1b9467-95c7-57e5-bcb9-7a995a57c8ad with scrape type 1
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b1b9467-95c7-57e5-bcb9-7a995a57c8ad
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4746%252F14034746%252Fexterior_front_driver-1774694641366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4746/14034746/exterior_front_driver-1774694641366.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6517%252F18256517%252Fexterior_front_passenger-1774693546493.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6517/18256517/exterior_front_passenger-1774693546493.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7830%252F20487830%252Fexterior_front_passenger-1774702336703.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7830/20487830/exterior_front_passenger-1774702336703.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3728%252F19333728%252Fexterior_front_passenger-1774705151430.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3728/19333728/exterior_front_passenger-1774705151430.jpeg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4746%252F14034746%252Fexterior_rear_driver-1774694656020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4746/14034746/exterior_rear_driver-1774694656020.jpg not downloaded yet
2026-03-29 20:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20113566.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6517%252F18256517%252Fexterior_rear_passenger-1774693524924.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6517/18256517/exterior_rear_passenger-1774693524924.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7830%252F20487830%252Fexterior_rear_passenger-1774702334273.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7830/20487830/exterior_rear_passenger-1774702334273.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3728%252F19333728%252Fexterior_rear_passenger-1774705493807.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3728/19333728/exterior_rear_passenger-1774705493807.jpeg not downloaded yet
2026-03-29 20:08:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4746%252F14034746%252Fexterior_front_passenger-1774693795938.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4746/14034746/exterior_front_passenger-1774693795938.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6517%252F18256517%252Finterior_front_seats-1774693364509.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6517/18256517/interior_front_seats-1774693364509.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7830%252F20487830%252Finterior_front_seats-1774703746366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7830/20487830/interior_front_seats-1774703746366.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3728%252F19333728%252Finterior_front_seats-1774705301941.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3728/19333728/interior_front_seats-1774705301941.jpeg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4746%252F14034746%252Fexterior_rear_passenger-1774693824166.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4746/14034746/exterior_rear_passenger-1774693824166.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6517%252F18256517%252Finterior_rear_seats-1774693355143.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6517/18256517/interior_rear_seats-1774693355143.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7830%252F20487830%252Finterior_rear_seats-1774703745333.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7830/20487830/interior_rear_seats-1774703745333.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3728%252F19333728%252Finterior_rear_seats-1774705417784.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3728/19333728/interior_rear_seats-1774705417784.jpeg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4746%252F14034746%252Finterior_front_seats-1774695403654.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4746/14034746/interior_front_seats-1774695403654.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6517%252F18256517%252Finterior_dashboard-1774693370137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6517/18256517/interior_dashboard-1774693370137.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7830%252F20487830%252Finterior_dashboard-1774703759886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7830/20487830/interior_dashboard-1774703759886.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3728%252F19333728%252Finterior_dashboard-1774705458464.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3728/19333728/interior_dashboard-1774705458464.jpeg not downloaded yet
2026-03-29 20:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19358574.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbcfeb1b-6fbb-52bb-a537-5a400e24269a with identifier: 20113566
2026-03-29 20:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbcfeb1b-6fbb-52bb-a537-5a400e24269a with scrape type 1
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbcfeb1b-6fbb-52bb-a537-5a400e24269a
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3566%252F20113566%252Fexterior_front_driver-1774701918835.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3566/20113566/exterior_front_driver-1774701918835.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4746%252F14034746%252Finterior_rear_seats-1774695455576.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4746/14034746/interior_rear_seats-1774695455576.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6517%252F18256517%252Finstrument_cluster-1774693385819.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6517/18256517/instrument_cluster-1774693385819.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7830%252F20487830%252Finterior_boot-1774703743887.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7830/20487830/interior_boot-1774703743887.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3728%252F19333728%252Finstrument_cluster-1774705456239.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3728/19333728/instrument_cluster-1774705456239.jpeg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3566%252F20113566%252Fexterior_rear_driver-1774701920479.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3566/20113566/exterior_rear_driver-1774701920479.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4746%252F14034746%252Finterior_dashboard-1774695584412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4746/14034746/interior_dashboard-1774695584412.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6517%252F18256517%252Finterior_boot-1774693349368.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6517/18256517/interior_boot-1774693349368.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7830%252F20487830%252Fdamage_scratches-1774702431228.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7830/20487830/damage_scratches-1774702431228.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3728%252F19333728%252Finterior_boot-1774705387503.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3728/19333728/interior_boot-1774705387503.jpeg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3566%252F20113566%252Fexterior_front_passenger-1774701915508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3566/20113566/exterior_front_passenger-1774701915508.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4746%252F14034746%252Finstrument_cluster-1774695442558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4746/14034746/instrument_cluster-1774695442558.jpg not downloaded yet
2026-03-29 20:08:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8a1055f-8404-5d55-a5d8-a0848d0a78fb with identifier: 19358574
2026-03-29 20:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a1055f-8404-5d55-a5d8-a0848d0a78fb with scrape type 1
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8a1055f-8404-5d55-a5d8-a0848d0a78fb
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8574%252F19358574%252Fexterior_front_driver-1774694222544.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8574/19358574/exterior_front_driver-1774694222544.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6517%252F18256517%252Fdocs_service_history-1774701645531.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4f79e2039fa7872a7db35a7657a3b77e%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6517/18256517/docs_service_history-1774701645531.jpg?ixlib=js-3.8.0&auto=format&s=4f79e2039fa7872a7db35a7657a3b77e not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7830%252F20487830%252Fdamage_scratches-1774702475286.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7830/20487830/damage_scratches-1774702475286.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3728%252F19333728%252Fdocs_service_history-1774711308514.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D53b36ad0019de9075b634060b09e82b3%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3728/19333728/docs_service_history-1774711308514.jpeg?ixlib=js-3.8.0&auto=format&s=53b36ad0019de9075b634060b09e82b3 not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3566%252F20113566%252Fexterior_rear_passenger-1774701919500.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3566/20113566/exterior_rear_passenger-1774701919500.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4746%252F14034746%252Finterior_boot-1774695872893.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4746/14034746/interior_boot-1774695872893.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8574%252F19358574%252Fexterior_rear_driver-1774694236101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8574/19358574/exterior_rear_driver-1774694236101.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3566%252F20113566%252Finterior_front_seats-1774702937876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3566/20113566/interior_front_seats-1774702937876.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4746%252F14034746%252Fdocs_service_history-1774696204430.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4b3d4d07ecb1b31a77d206236fc7b967%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4746/14034746/docs_service_history-1774696204430.jpg?ixlib=js-3.8.0&auto=format&s=4b3d4d07ecb1b31a77d206236fc7b967 not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8574%252F19358574%252Fexterior_front_passenger-1774694261523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8574/19358574/exterior_front_passenger-1774694261523.jpg not downloaded yet
2026-03-29 20:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1512&page=42&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3566%252F20113566%252Finterior_rear_seats-1774703837598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3566/20113566/interior_rear_seats-1774703837598.jpg not downloaded yet
2026-03-29 20:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4602/17064602/docs_service_history-1774699520432.jpg?ixlib=js-3.8.0&auto=format&s=8bc18cf11b7f6bc470c3ab74c9508470> (referer: None)
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8574%252F19358574%252Fexterior_rear_passenger-1774694247295.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8574/19358574/exterior_rear_passenger-1774694247295.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3566%252F20113566%252Finterior_dashboard-1774703753103.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3566/20113566/interior_dashboard-1774703753103.jpg not downloaded yet
2026-03-29 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8574%252F19358574%252Finterior_front_seats-1774694989422.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8574/19358574/interior_front_seats-1774694989422.jpg not downloaded yet
2026-03-29 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9067/19609067/exterior_front_passenger-1774358409013.jpg> (referer: None)
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3566%252F20113566%252Finstrument_cluster-1774702976780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3566/20113566/instrument_cluster-1774702976780.jpg not downloaded yet
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8574%252F19358574%252Finterior_rear_seats-1774695007380.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8574/19358574/interior_rear_seats-1774695007380.jpg not downloaded yet
2026-03-29 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3566/20113566/exterior_front_driver-1774701918835.jpg> (referer: None)
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3566%252F20113566%252Finterior_boot-1774703765770.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3566/20113566/interior_boot-1774703765770.jpg not downloaded yet
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8574%252F19358574%252Finterior_dashboard-1774695064535.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8574/19358574/interior_dashboard-1774695064535.jpg not downloaded yet
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 19943403
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719943403%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [motorway.uk] INFO: Scrape type for 19943403: 1
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1f44d0>
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e593c016-dfff-5800-ab51-95189876095c/e593c016-dfff-5800-ab51-95189876095c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4602%252F17064602%252Fdocs_service_history-1774699520432.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8bc18cf11b7f6bc470c3ab74c9508470') HTTP/1.1" 204 0
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4602/17064602/docs_service_history-1774699520432.jpg?ixlib=js-3.8.0&auto=format&s=8bc18cf11b7f6bc470c3ab74c9508470 saved to cache
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e593c016-dfff-5800-ab51-95189876095c
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3566%252F20113566%252Fdocs_service_history-1774703548303.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbe59a8af22ffb501b36cf5fa3097f3db%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3566/20113566/docs_service_history-1774703548303.jpg?ixlib=js-3.8.0&auto=format&s=be59a8af22ffb501b36cf5fa3097f3db not downloaded yet
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8574%252F19358574%252Finstrument_cluster-1774695092486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8574/19358574/instrument_cluster-1774695092486.jpg not downloaded yet
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20465481
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 19602701
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 19736042
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20475976
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 8134023
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 18661288
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 4637064
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 9361295
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20320814
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20076402
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20391441
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720391441%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [motorway.uk] INFO: Scrape type for 20391441: 1
2026-03-29 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19916190.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facc2b50>
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_462f132d-00b0-5fda-8de3-ae57293b496e/462f132d-00b0-5fda-8de3-ae57293b496e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9067%252F19609067%252Fexterior_front_passenger-1774358409013.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9067/19609067/exterior_front_passenger-1774358409013.jpg saved to cache
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 462f132d-00b0-5fda-8de3-ae57293b496e
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e29050>
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcfeb1b-6fbb-52bb-a537-5a400e24269a/dbcfeb1b-6fbb-52bb-a537-5a400e24269a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3566%252F20113566%252Fexterior_front_driver-1774701918835.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3566/20113566/exterior_front_driver-1774701918835.jpg saved to cache
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbcfeb1b-6fbb-52bb-a537-5a400e24269a
2026-03-29 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4485/20474485/exterior_rear_passenger-1774707419262.jpg> (referer: None)
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8574%252F19358574%252Finterior_boot-1774695075824.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8574/19358574/interior_boot-1774695075824.jpg not downloaded yet
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20455567
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 12337686
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 16283042
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20488544
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 7801463
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 19420355
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 19358892
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20427982
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 19234910
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20380457
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 5025216
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275025216%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [motorway.uk] INFO: Scrape type for 5025216: 1
2026-03-29 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487855.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/0683/9530683/9530683-docs_service_history-default-1729497800104.jpg?ixlib=js-3.8.0&auto=format&s=0fe8e3f218efd8076eaad388b484ed29> (referer: None)
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8574%252F19358574%252Fdocs_service_history-1774696077425.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D22833652c46e373b65949e7a42adeebe%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8574/19358574/docs_service_history-1774696077425.jpg?ixlib=js-3.8.0&auto=format&s=22833652c46e373b65949e7a42adeebe not downloaded yet
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 3991169
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 9765536
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 13033676
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20499852
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499852%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [motorway.uk] INFO: Scrape type for 20499852: 1
2026-03-29 20:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 994707c6-dc1f-5685-9370-d22a85780558 with identifier: 19916190
2026-03-29 20:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 994707c6-dc1f-5685-9370-d22a85780558 with scrape type 1
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 994707c6-dc1f-5685-9370-d22a85780558
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6190%252F19916190%252Fexterior_front_driver-1771777473621.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_front_driver-1771777473621.jpg not downloaded yet
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 18764881
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20490232
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20084784
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720084784%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [motorway.uk] INFO: Scrape type for 20084784: 1
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6190%252F19916190%252Fexterior_rear_driver-1771777333219.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_rear_driver-1771777333219.jpg not downloaded yet
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 14381280
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20489994
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489994%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [motorway.uk] INFO: Scrape type for 20489994: 1
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6190%252F19916190%252Fexterior_front_passenger-1771777822017.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_front_passenger-1771777822017.jpg not downloaded yet
2026-03-29 20:08:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84f4090>
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dc8c59c-3467-5a4e-8fcc-1049589942b3/6dc8c59c-3467-5a4e-8fcc-1049589942b3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F20474485%252Fexterior_rear_passenger-1774707419262.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/20474485/exterior_rear_passenger-1774707419262.jpg saved to cache
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6dc8c59c-3467-5a4e-8fcc-1049589942b3
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20471821
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 19513424
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20467422
2026-03-29 20:08:42 [motorway.uk] INFO: Found listing with ID: 20191328
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6190%252F19916190%252Fexterior_rear_passenger-1771777729528.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_rear_passenger-1771777729528.jpg not downloaded yet
2026-03-29 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3269/20473269/interior_boot-1774621213869.jpg> (referer: None)
2026-03-29 20:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cddb25d9-08c2-51f2-b91d-eb4d89c686d1 with identifier: 20487855
2026-03-29 20:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1 with scrape type 1
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7855%252F20487855%252Fexterior_front_driver-1774702724666.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_front_driver-1774702724666.jpg not downloaded yet
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad69a50>
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0ee90e8-1369-5d44-a413-a1283248c0e2/a0ee90e8-1369-5d44-a413-a1283248c0e2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F0683%252F9530683%252F9530683-docs_service_history-default-1729497800104.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0fe8e3f218efd8076eaad388b484ed29') HTTP/1.1" 204 0
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/0683/9530683/9530683-docs_service_history-default-1729497800104.jpg?ixlib=js-3.8.0&auto=format&s=0fe8e3f218efd8076eaad388b484ed29 saved to cache
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0ee90e8-1369-5d44-a413-a1283248c0e2
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6190%252F19916190%252Finterior_front_seats-1774712922915.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6190/19916190/interior_front_seats-1774712922915.jpg not downloaded yet
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7855%252F20487855%252Fexterior_rear_driver-1774702902363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_rear_driver-1774702902363.jpg not downloaded yet
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6190%252F19916190%252Finterior_rear_seats-1774712792178.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6190/19916190/interior_rear_seats-1774712792178.jpg not downloaded yet
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f953d3d0>
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c6c5eea-d88c-548d-a2a2-5dc6e9183f4e/3c6c5eea-d88c-548d-a2a2-5dc6e9183f4e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3269%252F20473269%252Finterior_boot-1774621213869.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3269/20473269/interior_boot-1774621213869.jpg saved to cache
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c6c5eea-d88c-548d-a2a2-5dc6e9183f4e
2026-03-29 20:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4746/14034746/exterior_rear_driver-1774694656020.jpg> (referer: None)
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7855%252F20487855%252Fexterior_front_passenger-1774702901332.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_front_passenger-1774702901332.jpg not downloaded yet
2026-03-29 20:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3269/20473269/docs_service_history-1774621311277.jpg?ixlib=js-3.8.0&auto=format&s=91640f0380ca0e7888264f9964547c03> (referer: None)
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6190%252F19916190%252Finterior_dashboard-1774712755203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6190/19916190/interior_dashboard-1774712755203.jpg not downloaded yet
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7855%252F20487855%252Fexterior_rear_passenger-1774702901588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_rear_passenger-1774702901588.jpg not downloaded yet
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6190%252F19916190%252Finstrument_cluster-1774712777022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6190/19916190/instrument_cluster-1774712777022.jpg not downloaded yet
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7855%252F20487855%252Finterior_front_seats-1774703982620.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7855/20487855/interior_front_seats-1774703982620.jpg not downloaded yet
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6190%252F19916190%252Finterior_boot-1774712746976.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6190/19916190/interior_boot-1774712746976.jpg not downloaded yet
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7855%252F20487855%252Finterior_rear_seats-1774703954740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7855/20487855/interior_rear_seats-1774703954740.jpg not downloaded yet
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6190%252F19916190%252Fdocs_service_history-1774713066206.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1ba05becc43b9a354a1ce4e1f3e149a8%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6190/19916190/docs_service_history-1774713066206.jpg?ixlib=js-3.8.0&auto=format&s=1ba05becc43b9a354a1ce4e1f3e149a8 not downloaded yet
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fade0190>
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1b9467-95c7-57e5-bcb9-7a995a57c8ad/4b1b9467-95c7-57e5-bcb9-7a995a57c8ad_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4746%252F14034746%252Fexterior_rear_driver-1774694656020.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4746/14034746/exterior_rear_driver-1774694656020.jpg saved to cache
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b1b9467-95c7-57e5-bcb9-7a995a57c8ad
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7855%252F20487855%252Finterior_dashboard-1774703857151.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7855/20487855/interior_dashboard-1774703857151.jpg not downloaded yet
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:08:43 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00( \x0f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01,C\x00(\x18u\x00\x00\x00\x00'
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab77750>
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c6c5eea-d88c-548d-a2a2-5dc6e9183f4e/3c6c5eea-d88c-548d-a2a2-5dc6e9183f4e_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3269%252F20473269%252Fdocs_service_history-1774621311277.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D91640f0380ca0e7888264f9964547c03') HTTP/1.1" 204 0
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3269/20473269/docs_service_history-1774621311277.jpg?ixlib=js-3.8.0&auto=format&s=91640f0380ca0e7888264f9964547c03 saved to cache
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c6c5eea-d88c-548d-a2a2-5dc6e9183f4e
2026-03-29 20:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8574/19358574/exterior_front_passenger-1774694261523.jpg> (referer: None)
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7855%252F20487855%252Finstrument_cluster-1774703779848.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7855/20487855/instrument_cluster-1774703779848.jpg not downloaded yet
2026-03-29 20:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3566/20113566/interior_dashboard-1774703753103.jpg> (referer: None)
2026-03-29 20:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_front_driver-1771777473621.jpg> (referer: None)
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7855%252F20487855%252Finterior_boot-1774703788950.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7855/20487855/interior_boot-1774703788950.jpg not downloaded yet
2026-03-29 20:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_rear_driver-1771777333219.jpg> (referer: None)
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7855%252F20487855%252Fdocs_service_history-1774704300359.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D48e265c9e17651e374e7fc69b894bd8d%27 HTTP/1.1" 200 None
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7855/20487855/docs_service_history-1774704300359.jpg?ixlib=js-3.8.0&auto=format&s=48e265c9e17651e374e7fc69b894bd8d not downloaded yet
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8943bd0>
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a1055f-8404-5d55-a5d8-a0848d0a78fb/e8a1055f-8404-5d55-a5d8-a0848d0a78fb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8574%252F19358574%252Fexterior_front_passenger-1774694261523.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8574/19358574/exterior_front_passenger-1774694261523.jpg saved to cache
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8a1055f-8404-5d55-a5d8-a0848d0a78fb
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8941fd0>
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcfeb1b-6fbb-52bb-a537-5a400e24269a/dbcfeb1b-6fbb-52bb-a537-5a400e24269a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3566%252F20113566%252Finterior_dashboard-1774703753103.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3566/20113566/interior_dashboard-1774703753103.jpg saved to cache
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbcfeb1b-6fbb-52bb-a537-5a400e24269a
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa4e2d0>
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6190%252F19916190%252Fexterior_front_driver-1771777473621.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_front_driver-1771777473621.jpg saved to cache
2026-03-29 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 994707c6-dc1f-5685-9370-d22a85780558
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f824cc90>
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6190%252F19916190%252Fexterior_rear_driver-1771777333219.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_rear_driver-1771777333219.jpg saved to cache
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 994707c6-dc1f-5685-9370-d22a85780558
2026-03-29 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4746/14034746/docs_service_history-1774696204430.jpg?ixlib=js-3.8.0&auto=format&s=4b3d4d07ecb1b31a77d206236fc7b967> (referer: None)
2026-03-29 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8574/19358574/interior_rear_seats-1774695007380.jpg> (referer: None)
2026-03-29 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4485/20474485/interior_rear_seats-1774708260594.jpg> (referer: None)
2026-03-29 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7855/20487855/instrument_cluster-1774703779848.jpg> (referer: None)
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95a7f10>
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1b9467-95c7-57e5-bcb9-7a995a57c8ad/4b1b9467-95c7-57e5-bcb9-7a995a57c8ad_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4746%252F14034746%252Fdocs_service_history-1774696204430.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4b3d4d07ecb1b31a77d206236fc7b967') HTTP/1.1" 204 0
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4746/14034746/docs_service_history-1774696204430.jpg?ixlib=js-3.8.0&auto=format&s=4b3d4d07ecb1b31a77d206236fc7b967 saved to cache
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b1b9467-95c7-57e5-bcb9-7a995a57c8ad
2026-03-29 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7855/20487855/interior_front_seats-1774703982620.jpg> (referer: None)
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa4e7d0>
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a1055f-8404-5d55-a5d8-a0848d0a78fb/e8a1055f-8404-5d55-a5d8-a0848d0a78fb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8574%252F19358574%252Finterior_rear_seats-1774695007380.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8574/19358574/interior_rear_seats-1774695007380.jpg saved to cache
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8a1055f-8404-5d55-a5d8-a0848d0a78fb
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9449510>
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6dc8c59c-3467-5a4e-8fcc-1049589942b3/6dc8c59c-3467-5a4e-8fcc-1049589942b3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4485%252F20474485%252Finterior_rear_seats-1774708260594.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4485/20474485/interior_rear_seats-1774708260594.jpg saved to cache
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6dc8c59c-3467-5a4e-8fcc-1049589942b3
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ad2390>
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7855%252F20487855%252Finstrument_cluster-1774703779848.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7855/20487855/instrument_cluster-1774703779848.jpg saved to cache
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1
2026-03-29 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20461256.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19939510.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe64e50>
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7855%252F20487855%252Finterior_front_seats-1774703982620.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7855/20487855/interior_front_seats-1774703982620.jpg saved to cache
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1
2026-03-29 20:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e5c390-55e2-5b03-9156-d336ff049f20 with identifier: 20461256
2026-03-29 20:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e5c390-55e2-5b03-9156-d336ff049f20 with scrape type 1
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11e5c390-55e2-5b03-9156-d336ff049f20
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20461256%252Fexterior_front_driver-1774548378207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_front_driver-1774548378207.jpg not downloaded yet
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20461256%252Fexterior_rear_driver-1774548383692.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_rear_driver-1774548383692.jpg not downloaded yet
2026-03-29 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20440188.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73d67cc2-d057-5af5-9b96-34305b62dd09 with identifier: 19939510
2026-03-29 20:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73d67cc2-d057-5af5-9b96-34305b62dd09 with scrape type 1
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73d67cc2-d057-5af5-9b96-34305b62dd09
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9510%252F19939510%252Fexterior_front_driver-1774693689277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9510/19939510/exterior_front_driver-1774693689277.jpg not downloaded yet
2026-03-29 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7855/20487855/interior_dashboard-1774703857151.jpg> (referer: None)
2026-03-29 20:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20350681.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20461256%252Fexterior_front_passenger-1774548405423.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_front_passenger-1774548405423.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9510%252F19939510%252Fexterior_rear_driver-1774693702120.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9510/19939510/exterior_rear_driver-1774693702120.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20461256%252Fexterior_rear_passenger-1774548398813.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_rear_passenger-1774548398813.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9510%252F19939510%252Fexterior_front_passenger-1774697111468.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9510/19939510/exterior_front_passenger-1774697111468.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20461256%252Finterior_front_seats-1774697317122.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20461256/interior_front_seats-1774697317122.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9510%252F19939510%252Fexterior_rear_passenger-1774693715538.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9510/19939510/exterior_rear_passenger-1774693715538.jpg not downloaded yet
2026-03-29 20:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a1d7549-2384-537d-ab85-b61173993995 with identifier: 20440188
2026-03-29 20:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a1d7549-2384-537d-ab85-b61173993995 with scrape type 1
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a1d7549-2384-537d-ab85-b61173993995
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0188%252F20440188%252Fexterior_front_driver-1774622280398.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_front_driver-1774622280398.jpg not downloaded yet
2026-03-29 20:08:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f934ad90>
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7855%252F20487855%252Finterior_dashboard-1774703857151.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7855/20487855/interior_dashboard-1774703857151.jpg saved to cache
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1
2026-03-29 20:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fce55a7a-eb17-501d-bf34-98a8a3b97996 with identifier: 20350681
2026-03-29 20:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce55a7a-eb17-501d-bf34-98a8a3b97996 with scrape type 1
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fce55a7a-eb17-501d-bf34-98a8a3b97996
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0681%252F20350681%252Fexterior_front_driver-1774276776612.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_front_driver-1774276776612.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20461256%252Finterior_dashboard-1774697278783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20461256/interior_dashboard-1774697278783.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9510%252F19939510%252Finterior_front_seats-1774694131469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9510/19939510/interior_front_seats-1774694131469.jpg not downloaded yet
2026-03-29 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7855/20487855/docs_service_history-1774704300359.jpg?ixlib=js-3.8.0&auto=format&s=48e265c9e17651e374e7fc69b894bd8d> (referer: None)
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0188%252F20440188%252Fexterior_rear_driver-1774622312034.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_rear_driver-1774622312034.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0681%252F20350681%252Fexterior_rear_driver-1774276697157.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_rear_driver-1774276697157.jpg not downloaded yet
2026-03-29 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20499852.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7855/20487855/interior_rear_seats-1774703954740.jpg> (referer: None)
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20461256%252Finstrument_cluster-1774697455238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20461256/instrument_cluster-1774697455238.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9510%252F19939510%252Finterior_rear_seats-1774694151778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9510/19939510/interior_rear_seats-1774694151778.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0188%252F20440188%252Fexterior_front_passenger-1774622378305.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_front_passenger-1774622378305.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0681%252F20350681%252Fexterior_front_passenger-1774276736880.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_front_passenger-1774276736880.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20461256%252Finterior_boot-1774697294946.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20461256/interior_boot-1774697294946.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9510%252F19939510%252Finterior_dashboard-1774694223231.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9510/19939510/interior_dashboard-1774694223231.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0188%252F20440188%252Fexterior_rear_passenger-1774622336604.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_rear_passenger-1774622336604.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0681%252F20350681%252Fexterior_rear_passenger-1774276958258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_rear_passenger-1774276958258.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20461256%252Fdamage_paintwork-1774548439888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20461256/damage_paintwork-1774548439888.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9510%252F19939510%252Finstrument_cluster-1774697003870.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9510/19939510/instrument_cluster-1774697003870.jpg not downloaded yet
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81ec450>
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7855%252F20487855%252Fdocs_service_history-1774704300359.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D48e265c9e17651e374e7fc69b894bd8d') HTTP/1.1" 204 0
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7855/20487855/docs_service_history-1774704300359.jpg?ixlib=js-3.8.0&auto=format&s=48e265c9e17651e374e7fc69b894bd8d saved to cache
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0188%252F20440188%252Finterior_front_seats-1774623742572.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0188/20440188/interior_front_seats-1774623742572.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0681%252F20350681%252Finterior_front_seats-1774277910973.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0681/20350681/interior_front_seats-1774277910973.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20461256%252Fdamage_paintwork-1774548465499.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20461256/damage_paintwork-1774548465499.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9510%252F19939510%252Finterior_boot-1774694179175.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9510/19939510/interior_boot-1774694179175.jpg not downloaded yet
2026-03-29 20:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 926430ac-3c96-59ad-a65b-4cab7548e398 with identifier: 20499852
2026-03-29 20:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 926430ac-3c96-59ad-a65b-4cab7548e398 with scrape type 1
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 926430ac-3c96-59ad-a65b-4cab7548e398
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9852%252F20499852%252Fexterior_front_driver-1774778856653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_front_driver-1774778856653.jpg not downloaded yet
2026-03-29 20:08:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae72d90>
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7855%252F20487855%252Finterior_rear_seats-1774703954740.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7855/20487855/interior_rear_seats-1774703954740.jpg saved to cache
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0188%252F20440188%252Finterior_rear_seats-1774623302055.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0188/20440188/interior_rear_seats-1774623302055.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0681%252F20350681%252Finterior_rear_seats-1774277937491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0681/20350681/interior_rear_seats-1774277937491.jpg not downloaded yet
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9510%252F19939510%252Fdocs_service_history-1774694357998.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D13ee69f104e4950de0981c4b49957ae5%27 HTTP/1.1" 200 None
2026-03-29 20:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9510/19939510/docs_service_history-1774694357998.jpg?ixlib=js-3.8.0&auto=format&s=13ee69f104e4950de0981c4b49957ae5 not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9852%252F20499852%252Fexterior_rear_driver-1774778868795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_rear_driver-1774778868795.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0188%252F20440188%252Finterior_dashboard-1774623346253.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0188/20440188/interior_dashboard-1774623346253.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0681%252F20350681%252Finterior_dashboard-1774278105873.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0681/20350681/interior_dashboard-1774278105873.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9852%252F20499852%252Fexterior_front_passenger-1774778864572.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_front_passenger-1774778864572.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0188%252F20440188%252Finstrument_cluster-1774623335030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0188/20440188/instrument_cluster-1774623335030.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0681%252F20350681%252Finterior_boot-1774277996400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0681/20350681/interior_boot-1774277996400.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9852%252F20499852%252Fexterior_rear_passenger-1774778861750.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_rear_passenger-1774778861750.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0188%252F20440188%252Finterior_boot-1774623367373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0188/20440188/interior_boot-1774623367373.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0681%252F20350681%252Fdocs_service_history-1774450279286.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D52bc6158926d94e7cdafe7b73a308674%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0681/20350681/docs_service_history-1774450279286.jpg?ixlib=js-3.8.0&auto=format&s=52bc6158926d94e7cdafe7b73a308674 not downloaded yet
2026-03-29 20:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6190/19916190/interior_dashboard-1774712755203.jpg> (referer: None)
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9852%252F20499852%252Finterior_front_seats-1774779200251.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9852/20499852/interior_front_seats-1774779200251.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0188%252F20440188%252Fdocs_service_history-1774624408048.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D729f5f8758f5ca7180ad642e67f6aa15%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0188/20440188/docs_service_history-1774624408048.jpg?ixlib=js-3.8.0&auto=format&s=729f5f8758f5ca7180ad642e67f6aa15 not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0681%252F20350681%252Fdamage_scratches-1774277314271.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0681/20350681/damage_scratches-1774277314271.jpg not downloaded yet
2026-03-29 20:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6190/19916190/interior_boot-1774712746976.jpg> (referer: None)
2026-03-29 20:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6190/19916190/instrument_cluster-1774712777022.jpg> (referer: None)
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9852%252F20499852%252Finterior_dashboard-1774781258053.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9852/20499852/interior_dashboard-1774781258053.jpg not downloaded yet
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9852%252F20499852%252Finstrument_cluster-1774779264641.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9852/20499852/instrument_cluster-1774779264641.jpg not downloaded yet
2026-03-29 20:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_rear_driver-1774702902363.jpg> (referer: None)
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9852%252F20499852%252Finterior_boot-1774779203446.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9852/20499852/interior_boot-1774779203446.jpg not downloaded yet
2026-03-29 20:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_rear_passenger-1774702901588.jpg> (referer: None)
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9852%252F20499852%252Fdocs_service_history-1774779838600.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4539e6b592a90e3090750499e47110f0%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9852/20499852/docs_service_history-1774779838600.jpg?ixlib=js-3.8.0&auto=format&s=4539e6b592a90e3090750499e47110f0 not downloaded yet
2026-03-29 20:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_front_passenger-1774702901332.jpg> (referer: None)
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a075d0>
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6190%252F19916190%252Finterior_dashboard-1774712755203.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6190/19916190/interior_dashboard-1774712755203.jpg saved to cache
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 994707c6-dc1f-5685-9370-d22a85780558
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9852%252F20499852%252Fdocs_service_history-1774779893419.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7131e37b84a9dc1da83c3181968ec2b0%27 HTTP/1.1" 200 None
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9852/20499852/docs_service_history-1774779893419.jpg?ixlib=js-3.8.0&auto=format&s=7131e37b84a9dc1da83c3181968ec2b0 not downloaded yet
2026-03-29 20:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9510/19939510/docs_service_history-1774694357998.jpg?ixlib=js-3.8.0&auto=format&s=13ee69f104e4950de0981c4b49957ae5> (referer: None)
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xf0\x0f\x00\x00'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-A556B\x00'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'A556BXXSDCZB5\x00'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xf4\x0b\x00\x00'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe1\x00\x00\x00'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:46 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:28 15:45:27\x00'
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabd7d10>
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6190%252F19916190%252Finterior_boot-1774712746976.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6190/19916190/interior_boot-1774712746976.jpg saved to cache
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 994707c6-dc1f-5685-9370-d22a85780558
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9025310>
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6190%252F19916190%252Finstrument_cluster-1774712777022.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6190/19916190/instrument_cluster-1774712777022.jpg saved to cache
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 994707c6-dc1f-5685-9370-d22a85780558
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f91931d0>
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7855%252F20487855%252Fexterior_rear_driver-1774702902363.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_rear_driver-1774702902363.jpg saved to cache
2026-03-29 20:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa6d1d0>
2026-03-29 20:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7855%252F20487855%252Fexterior_rear_passenger-1774702901588.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_rear_passenger-1774702901588.jpg saved to cache
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9368810>
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7855%252F20487855%252Fexterior_front_passenger-1774702901332.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_front_passenger-1774702901332.jpg saved to cache
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95932d0>
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9510%252F19939510%252Fdocs_service_history-1774694357998.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D13ee69f104e4950de0981c4b49957ae5') HTTP/1.1" 204 0
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9510/19939510/docs_service_history-1774694357998.jpg?ixlib=js-3.8.0&auto=format&s=13ee69f104e4950de0981c4b49957ae5 saved to cache
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73d67cc2-d057-5af5-9b96-34305b62dd09
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_front_driver-1774778856653.jpg> (referer: None)
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6190/19916190/docs_service_history-1774713066206.jpg?ixlib=js-3.8.0&auto=format&s=1ba05becc43b9a354a1ce4e1f3e149a8> (referer: None)
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7855/20487855/interior_boot-1774703788950.jpg> (referer: None)
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_rear_driver-1774778868795.jpg> (referer: None)
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0188/20440188/interior_rear_seats-1774623302055.jpg> (referer: None)
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9510/19939510/interior_boot-1774694179175.jpg> (referer: None)
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0681/20350681/interior_rear_seats-1774277937491.jpg> (referer: None)
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6190/19916190/interior_rear_seats-1774712792178.jpg> (referer: None)
2026-03-29 20:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0681/20350681/docs_service_history-1774450279286.jpg?ixlib=js-3.8.0&auto=format&s=52bc6158926d94e7cdafe7b73a308674> (referer: None)
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9590610>
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9852%252F20499852%252Fexterior_front_driver-1774778856653.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_front_driver-1774778856653.jpg saved to cache
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 926430ac-3c96-59ad-a65b-4cab7548e398
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xf0\x0f\x00\x00'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-A556B\x00'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'A556BXXSDCZB5\x00'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xf4\x0b\x00\x00'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe1\x00\x00\x00'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:28 15:50:48\x00'
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa6d150>
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6190%252F19916190%252Fdocs_service_history-1774713066206.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1ba05becc43b9a354a1ce4e1f3e149a8') HTTP/1.1" 204 0
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6190/19916190/docs_service_history-1774713066206.jpg?ixlib=js-3.8.0&auto=format&s=1ba05becc43b9a354a1ce4e1f3e149a8 saved to cache
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 994707c6-dc1f-5685-9370-d22a85780558
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81bd690>
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7855%252F20487855%252Finterior_boot-1774703788950.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7855/20487855/interior_boot-1774703788950.jpg saved to cache
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa1c790>
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9852%252F20499852%252Fexterior_rear_driver-1774778868795.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_rear_driver-1774778868795.jpg saved to cache
2026-03-29 20:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 926430ac-3c96-59ad-a65b-4cab7548e398
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9033ed0>
2026-03-29 20:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0188%252F20440188%252Finterior_rear_seats-1774623302055.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0188/20440188/interior_rear_seats-1774623302055.jpg saved to cache
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a1d7549-2384-537d-ab85-b61173993995
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac273d0>
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9510%252F19939510%252Finterior_boot-1774694179175.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9510/19939510/interior_boot-1774694179175.jpg saved to cache
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73d67cc2-d057-5af5-9b96-34305b62dd09
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1d0590>
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0681%252F20350681%252Finterior_rear_seats-1774277937491.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0681/20350681/interior_rear_seats-1774277937491.jpg saved to cache
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fce55a7a-eb17-501d-bf34-98a8a3b97996
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xf0\x0f\x00\x00'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-A556B\x00'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'A556BXXSDCZB5\x00'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xf4\x0b\x00\x00'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe1\x00\x00\x00'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:28 15:46:20\x00'
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa1c790>
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6190%252F19916190%252Finterior_rear_seats-1774712792178.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6190/19916190/interior_rear_seats-1774712792178.jpg saved to cache
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 994707c6-dc1f-5685-9370-d22a85780558
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9032a10>
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0681%252F20350681%252Fdocs_service_history-1774450279286.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D52bc6158926d94e7cdafe7b73a308674') HTTP/1.1" 204 0
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0681/20350681/docs_service_history-1774450279286.jpg?ixlib=js-3.8.0&auto=format&s=52bc6158926d94e7cdafe7b73a308674 saved to cache
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fce55a7a-eb17-501d-bf34-98a8a3b97996
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9852/20499852/docs_service_history-1774779893419.jpg?ixlib=js-3.8.0&auto=format&s=7131e37b84a9dc1da83c3181968ec2b0> (referer: None)
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0188/20440188/docs_service_history-1774624408048.jpg?ixlib=js-3.8.0&auto=format&s=729f5f8758f5ca7180ad642e67f6aa15> (referer: None)
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9852/20499852/docs_service_history-1774779838600.jpg?ixlib=js-3.8.0&auto=format&s=4539e6b592a90e3090750499e47110f0> (referer: None)
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9852/20499852/instrument_cluster-1774779264641.jpg> (referer: None)
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9852/20499852/interior_boot-1774779203446.jpg> (referer: None)
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9852/20499852/interior_dashboard-1774781258053.jpg> (referer: None)
2026-03-29 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0681/20350681/damage_scratches-1774277314271.jpg> (referer: None)
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8444ad0>
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9852%252F20499852%252Fdocs_service_history-1774779893419.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7131e37b84a9dc1da83c3181968ec2b0') HTTP/1.1" 204 0
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9852/20499852/docs_service_history-1774779893419.jpg?ixlib=js-3.8.0&auto=format&s=7131e37b84a9dc1da83c3181968ec2b0 saved to cache
2026-03-29 20:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 926430ac-3c96-59ad-a65b-4cab7548e398
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f48410>
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0188%252F20440188%252Fdocs_service_history-1774624408048.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D729f5f8758f5ca7180ad642e67f6aa15') HTTP/1.1" 204 0
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0188/20440188/docs_service_history-1774624408048.jpg?ixlib=js-3.8.0&auto=format&s=729f5f8758f5ca7180ad642e67f6aa15 saved to cache
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a1d7549-2384-537d-ab85-b61173993995
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f932d750>
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9852%252F20499852%252Fdocs_service_history-1774779838600.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4539e6b592a90e3090750499e47110f0') HTTP/1.1" 204 0
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9852/20499852/docs_service_history-1774779838600.jpg?ixlib=js-3.8.0&auto=format&s=4539e6b592a90e3090750499e47110f0 saved to cache
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 926430ac-3c96-59ad-a65b-4cab7548e398
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9049290>
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9852%252F20499852%252Finstrument_cluster-1774779264641.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9852/20499852/instrument_cluster-1774779264641.jpg saved to cache
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 926430ac-3c96-59ad-a65b-4cab7548e398
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9193e10>
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9852%252F20499852%252Finterior_boot-1774779203446.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9852/20499852/interior_boot-1774779203446.jpg saved to cache
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 926430ac-3c96-59ad-a65b-4cab7548e398
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facaa990>
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9852%252F20499852%252Finterior_dashboard-1774781258053.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9852/20499852/interior_dashboard-1774781258053.jpg saved to cache
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 926430ac-3c96-59ad-a65b-4cab7548e398
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa485d0>
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0681%252F20350681%252Fdamage_scratches-1774277314271.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0681/20350681/damage_scratches-1774277314271.jpg saved to cache
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fce55a7a-eb17-501d-bf34-98a8a3b97996
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9510/19939510/instrument_cluster-1774697003870.jpg> (referer: None)
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_front_passenger-1774778864572.jpg> (referer: None)
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0188/20440188/instrument_cluster-1774623335030.jpg> (referer: None)
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_rear_passenger-1774778861750.jpg> (referer: None)
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9852/20499852/interior_front_seats-1774779200251.jpg> (referer: None)
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0188/20440188/interior_dashboard-1774623346253.jpg> (referer: None)
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0188/20440188/interior_boot-1774623367373.jpg> (referer: None)
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1256/20461256/damage_paintwork-1774548465499.jpg> (referer: None)
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0681/20350681/interior_front_seats-1774277910973.jpg> (referer: None)
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0681/20350681/interior_dashboard-1774278105873.jpg> (referer: None)
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0681/20350681/interior_boot-1774277996400.jpg> (referer: None)
2026-03-29 20:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0188/20440188/interior_front_seats-1774623742572.jpg> (referer: None)
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfff590>
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9510%252F19939510%252Finstrument_cluster-1774697003870.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9510/19939510/instrument_cluster-1774697003870.jpg saved to cache
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73d67cc2-d057-5af5-9b96-34305b62dd09
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf4e950>
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9852%252F20499852%252Fexterior_front_passenger-1774778864572.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_front_passenger-1774778864572.jpg saved to cache
2026-03-29 20:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 926430ac-3c96-59ad-a65b-4cab7548e398
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8491510>
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0188%252F20440188%252Finstrument_cluster-1774623335030.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0188/20440188/instrument_cluster-1774623335030.jpg saved to cache
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a1d7549-2384-537d-ab85-b61173993995
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9031a50>
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9852%252F20499852%252Fexterior_rear_passenger-1774778861750.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_rear_passenger-1774778861750.jpg saved to cache
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 926430ac-3c96-59ad-a65b-4cab7548e398
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faad7990>
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9852%252F20499852%252Finterior_front_seats-1774779200251.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9852/20499852/interior_front_seats-1774779200251.jpg saved to cache
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 926430ac-3c96-59ad-a65b-4cab7548e398
2026-03-29 20:08:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 926430ac-3c96-59ad-a65b-4cab7548e398, skipping ID generation
2026-03-29 20:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 926430ac-3c96-59ad-a65b-4cab7548e398 with scrape type 1
2026-03-29 20:08:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 926430ac-3c96-59ad-a65b-4cab7548e398 sending to next pipeline
2026-03-29 20:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 926430ac-3c96-59ad-a65b-4cab7548e398, identifier: 20499852
2026-03-29 20:08:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95d4690>
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0188%252F20440188%252Finterior_dashboard-1774623346253.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0188/20440188/interior_dashboard-1774623346253.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a1d7549-2384-537d-ab85-b61173993995
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa23d10>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0188%252F20440188%252Finterior_boot-1774623367373.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0188/20440188/interior_boot-1774623367373.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a1d7549-2384-537d-ab85-b61173993995
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f919ffd0>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20461256%252Fdamage_paintwork-1774548465499.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20461256/damage_paintwork-1774548465499.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11e5c390-55e2-5b03-9156-d336ff049f20
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f880a2d0>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0681%252F20350681%252Finterior_front_seats-1774277910973.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0681/20350681/interior_front_seats-1774277910973.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fce55a7a-eb17-501d-bf34-98a8a3b97996
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa02c110>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0681%252F20350681%252Finterior_dashboard-1774278105873.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0681/20350681/interior_dashboard-1774278105873.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fce55a7a-eb17-501d-bf34-98a8a3b97996
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95908d0>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0681%252F20350681%252Finterior_boot-1774277996400.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0681/20350681/interior_boot-1774277996400.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fce55a7a-eb17-501d-bf34-98a8a3b97996
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f919cdd0>
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0188%252F20440188%252Finterior_front_seats-1774623742572.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0188/20440188/interior_front_seats-1774623742572.jpg saved to cache
2026-03-29 20:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a1d7549-2384-537d-ab85-b61173993995
2026-03-29 20:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 926430ac-3c96-59ad-a65b-4cab7548e398 with identifier: 20499852
2026-03-29 20:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 926430ac-3c96-59ad-a65b-4cab7548e398 with identifier: 20499852
2026-03-29 20:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 926430ac-3c96-59ad-a65b-4cab7548e398 with identifier: 20499852 to the API
2026-03-29 20:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9852/20499852/interior_front_seats-1774779200251.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '926430ac-3c96-59ad-a65b-4cab7548e398',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV61 VBF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20499852',
'listing': 'auction',
'location': 'Carmarthenshire Llanelli',
'make': 'Mercedes',
'model': 'SLK',
'odometer': 47000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1515103,
'Height': 2254,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_front_driver-1774778856653.jpg',
'Width': 3005},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1505482,
'Height': 2258,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_rear_driver-1774778868795.jpg',
'Width': 3010},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1276278,
'Height': 1967,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_front_passenger-1774778864572.jpg',
'Width': 2622},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1717535,
'Height': 2338,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9852/20499852/exterior_rear_passenger-1774778861750.jpg',
'Width': 3117},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1586554,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9852/20499852/interior_front_seats-1774779200251.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1363175,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9852/20499852/interior_dashboard-1774781258053.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1231218,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9852/20499852/instrument_cluster-1774779264641.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1432286,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9852/20499852/interior_boot-1774779203446.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1050132,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9852/20499852/docs_service_history-1774779838600.jpg?ixlib=js-3.8.0&auto=format&s=4539e6b592a90e3090750499e47110f0',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_926430ac-3c96-59ad-a65b-4cab7548e398/926430ac-3c96-59ad-a65b-4cab7548e398_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 520738,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9852/20499852/docs_service_history-1774779893419.jpg?ixlib=js-3.8.0&auto=format&s=7131e37b84a9dc1da83c3181968ec2b0',
'Width': 3840}],
'price': 5644,
'price_includes_vat': False,
'registration_date': '2011-09-16',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes SLK200 Edition 125 BlueEFFICIENCY A',
'transmission': 'automatic',
'trim': '200 Edition 125 BlueEFFICIENCY A',
'vin': 'WDD1724482F021300',
'year': 2011}
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720499852%27 HTTP/1.1" 200 None
2026-03-29 20:08:52 [motorway.uk] INFO: Saving data for 20499852: {'created_time': 1774814932.109088, 'last_price_update_time': 1774814932.109099, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20499852') HTTP/1.1" 204 0
2026-03-29 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_front_passenger-1774276736880.jpg> (referer: None)
2026-03-29 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_rear_passenger-1774622336604.jpg> (referer: None)
2026-03-29 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_rear_passenger-1774276958258.jpg> (referer: None)
2026-03-29 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9510/19939510/interior_dashboard-1774694223231.jpg> (referer: None)
2026-03-29 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1256/20461256/damage_paintwork-1774548439888.jpg> (referer: None)
2026-03-29 20:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1256/20461256/interior_boot-1774697294946.jpg> (referer: None)
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf6dc90>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0681%252F20350681%252Fexterior_front_passenger-1774276736880.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_front_passenger-1774276736880.jpg saved to cache
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fce55a7a-eb17-501d-bf34-98a8a3b97996
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81f33d0>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0188%252F20440188%252Fexterior_rear_passenger-1774622336604.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_rear_passenger-1774622336604.jpg saved to cache
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a1d7549-2384-537d-ab85-b61173993995
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae19b10>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0681%252F20350681%252Fexterior_rear_passenger-1774276958258.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_rear_passenger-1774276958258.jpg saved to cache
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fce55a7a-eb17-501d-bf34-98a8a3b97996
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d6d90>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9510%252F19939510%252Finterior_dashboard-1774694223231.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9510/19939510/interior_dashboard-1774694223231.jpg saved to cache
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73d67cc2-d057-5af5-9b96-34305b62dd09
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95aaf10>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20461256%252Fdamage_paintwork-1774548439888.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20461256/damage_paintwork-1774548439888.jpg saved to cache
2026-03-29 20:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11e5c390-55e2-5b03-9156-d336ff049f20
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d6810>
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20461256%252Finterior_boot-1774697294946.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20461256/interior_boot-1774697294946.jpg saved to cache
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11e5c390-55e2-5b03-9156-d336ff049f20
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_front_driver-1774622280398.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20084784.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_rear_driver-1774622312034.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_front_passenger-1774622378305.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9510/19939510/exterior_front_passenger-1774697111468.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_rear_driver-1774276697157.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_front_driver-1774276776612.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9510/19939510/exterior_rear_passenger-1774693715538.jpg> (referer: None)
2026-03-29 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1256/20461256/instrument_cluster-1774697455238.jpg> (referer: None)
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f91b5950>
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0188%252F20440188%252Fexterior_front_driver-1774622280398.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_front_driver-1774622280398.jpg saved to cache
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a1d7549-2384-537d-ab85-b61173993995
2026-03-29 20:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e357175-4060-5445-ba82-db72f188d622 with identifier: 20084784
2026-03-29 20:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e357175-4060-5445-ba82-db72f188d622 with scrape type 1
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e357175-4060-5445-ba82-db72f188d622
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4784%252F20084784%252Fexterior_front_driver-1773684352617.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_front_driver-1773684352617.jpg not downloaded yet
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9190790>
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0188%252F20440188%252Fexterior_rear_driver-1774622312034.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_rear_driver-1774622312034.jpg saved to cache
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a1d7549-2384-537d-ab85-b61173993995
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f907e190>
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0188%252F20440188%252Fexterior_front_passenger-1774622378305.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_front_passenger-1774622378305.jpg saved to cache
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a1d7549-2384-537d-ab85-b61173993995
2026-03-29 20:08:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a1d7549-2384-537d-ab85-b61173993995, skipping ID generation
2026-03-29 20:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a1d7549-2384-537d-ab85-b61173993995 with scrape type 1
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a1d7549-2384-537d-ab85-b61173993995 sending to next pipeline
2026-03-29 20:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3a1d7549-2384-537d-ab85-b61173993995, identifier: 20440188
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf6c390>
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9510%252F19939510%252Fexterior_front_passenger-1774697111468.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9510/19939510/exterior_front_passenger-1774697111468.jpg saved to cache
2026-03-29 20:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73d67cc2-d057-5af5-9b96-34305b62dd09
2026-03-29 20:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3a1d7549-2384-537d-ab85-b61173993995 with identifier: 20440188
2026-03-29 20:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3a1d7549-2384-537d-ab85-b61173993995 with identifier: 20440188
2026-03-29 20:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3a1d7549-2384-537d-ab85-b61173993995 with identifier: 20440188 to the API
2026-03-29 20:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_front_passenger-1774622378305.jpg>
{'auction_title': '',
'category': None,
'color': 'Beige',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '3a1d7549-2384-537d-ab85-b61173993995',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'NJ18 XNA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20440188',
'listing': 'auction',
'location': 'Tyne and Wear Sunderland',
'make': 'Citroen',
'model': 'C3',
'odometer': 34984,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1007738,
'Height': 2388,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_front_driver-1774622280398.jpg',
'Width': 3184},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 908470,
'Height': 2467,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_rear_driver-1774622312034.jpg',
'Width': 3289},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1257772,
'Height': 2561,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_front_passenger-1774622378305.jpg',
'Width': 3415},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1661304,
'Height': 2885,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0188/20440188/exterior_rear_passenger-1774622336604.jpg',
'Width': 3846},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4161830,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0188/20440188/interior_front_seats-1774623742572.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3178739,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0188/20440188/interior_rear_seats-1774623302055.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2027306,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0188/20440188/interior_dashboard-1774623346253.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1476049,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0188/20440188/instrument_cluster-1774623335030.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2359391,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0188/20440188/interior_boot-1774623367373.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a1d7549-2384-537d-ab85-b61173993995/3a1d7549-2384-537d-ab85-b61173993995_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 597874,
'Height': 1917,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0188/20440188/docs_service_history-1774624408048.jpg?ixlib=js-3.8.0&auto=format&s=729f5f8758f5ca7180ad642e67f6aa15',
'Width': 2834}],
'price': 7826,
'price_includes_vat': False,
'registration_date': '2018-08-20',
'seats_number': None,
'seller_name': None,
'title': 'Citroen C3 Aircross Flair P-TECH SS A',
'transmission': 'automatic',
'trim': 'Aircross Flair P-TECH SS A',
'vin': 'VF72RHNZWJ4416848',
'year': 2018}
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720440188%27 HTTP/1.1" 200 None
2026-03-29 20:08:54 [motorway.uk] INFO: Saving data for 20440188: {'created_time': 1774814934.114445, 'last_price_update_time': 1774814934.114455, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20440188') HTTP/1.1" 204 0
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4784%252F20084784%252Fexterior_rear_driver-1773684368339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_rear_driver-1773684368339.jpg not downloaded yet
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95a8110>
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0681%252F20350681%252Fexterior_rear_driver-1774276697157.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_rear_driver-1774276697157.jpg saved to cache
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fce55a7a-eb17-501d-bf34-98a8a3b97996
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf7a7d0>
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0681%252F20350681%252Fexterior_front_driver-1774276776612.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_front_driver-1774276776612.jpg saved to cache
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fce55a7a-eb17-501d-bf34-98a8a3b97996
2026-03-29 20:08:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fce55a7a-eb17-501d-bf34-98a8a3b97996, skipping ID generation
2026-03-29 20:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce55a7a-eb17-501d-bf34-98a8a3b97996 with scrape type 1
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fce55a7a-eb17-501d-bf34-98a8a3b97996 sending to next pipeline
2026-03-29 20:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fce55a7a-eb17-501d-bf34-98a8a3b97996, identifier: 20350681
2026-03-29 20:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1256/20461256/interior_front_seats-1774697317122.jpg> (referer: None)
2026-03-29 20:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fce55a7a-eb17-501d-bf34-98a8a3b97996 with identifier: 20350681
2026-03-29 20:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fce55a7a-eb17-501d-bf34-98a8a3b97996 with identifier: 20350681
2026-03-29 20:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fce55a7a-eb17-501d-bf34-98a8a3b97996 with identifier: 20350681 to the API
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_front_driver-1774276776612.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'fce55a7a-eb17-501d-bf34-98a8a3b97996',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HJ16 ZWK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20350681',
'listing': 'auction',
'location': 'Hampshire Fordingbridge',
'make': 'Audi',
'model': 'A3',
'odometer': 49000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2053796,
'Height': 2828,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_front_driver-1774276776612.jpg',
'Width': 3770},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1425909,
'Height': 2299,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_rear_driver-1774276697157.jpg',
'Width': 3065},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1445438,
'Height': 2273,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_front_passenger-1774276736880.jpg',
'Width': 3030},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1595753,
'Height': 2396,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0681/20350681/exterior_rear_passenger-1774276958258.jpg',
'Width': 3194},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2881386,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0681/20350681/interior_front_seats-1774277910973.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3630071,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0681/20350681/interior_rear_seats-1774277937491.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2876360,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0681/20350681/interior_dashboard-1774278105873.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3679072,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0681/20350681/interior_boot-1774277996400.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5946546,
'Height': 4421,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0681/20350681/docs_service_history-1774450279286.jpg?ixlib=js-3.8.0&auto=format&s=52bc6158926d94e7cdafe7b73a308674',
'Width': 2753},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fce55a7a-eb17-501d-bf34-98a8a3b97996/fce55a7a-eb17-501d-bf34-98a8a3b97996_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2192496,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0681/20350681/damage_scratches-1774277314271.jpg',
'Width': 4032}],
'price': 7677,
'price_includes_vat': False,
'registration_date': '2016-05-13',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 SE TFSI S-A',
'transmission': 'automatic',
'trim': 'SE TFSI S-A',
'vin': 'WAUZZZ8V7GA160041',
'year': 2016}
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720350681%27 HTTP/1.1" 200 None
2026-03-29 20:08:54 [motorway.uk] INFO: Saving data for 20350681: {'created_time': 1774814934.908316, 'last_price_update_time': 1774814934.908326, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20350681') HTTP/1.1" 204 0
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4784%252F20084784%252Fexterior_front_passenger-1773684400123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_front_passenger-1773684400123.jpg not downloaded yet
2026-03-29 20:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1256/20461256/interior_dashboard-1774697278783.jpg> (referer: None)
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f84750>
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9510%252F19939510%252Fexterior_rear_passenger-1774693715538.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9510/19939510/exterior_rear_passenger-1774693715538.jpg saved to cache
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73d67cc2-d057-5af5-9b96-34305b62dd09
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88f8350>
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20461256%252Finstrument_cluster-1774697455238.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20461256/instrument_cluster-1774697455238.jpg saved to cache
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11e5c390-55e2-5b03-9156-d336ff049f20
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4784%252F20084784%252Fexterior_rear_passenger-1773684446559.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_rear_passenger-1773684446559.jpg not downloaded yet
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88d6d90>
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1256%252F20461256%252Finterior_front_seats-1774697317122.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1256/20461256/interior_front_seats-1774697317122.jpg saved to cache
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11e5c390-55e2-5b03-9156-d336ff049f20
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4784%252F20084784%252Finterior_front_seats-1774783413981.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4784/20084784/interior_front_seats-1774783413981.jpg not downloaded yet
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa13cc50>
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20461256%252Finterior_dashboard-1774697278783.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20461256/interior_dashboard-1774697278783.jpg saved to cache
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11e5c390-55e2-5b03-9156-d336ff049f20
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4784%252F20084784%252Finterior_rear_seats-1773684970870.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4784/20084784/interior_rear_seats-1773684970870.jpg not downloaded yet
2026-03-29 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9510/19939510/interior_rear_seats-1774694151778.jpg> (referer: None)
2026-03-29 20:08:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4784%252F20084784%252Finterior_dashboard-1774782439147.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4784/20084784/interior_dashboard-1774782439147.jpg not downloaded yet
2026-03-29 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_rear_passenger-1774548398813.jpg> (referer: None)
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4784%252F20084784%252Finterior_boot-1774782401837.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4784/20084784/interior_boot-1774782401837.jpg not downloaded yet
2026-03-29 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_front_passenger-1774548405423.jpg> (referer: None)
2026-03-29 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_rear_driver-1774548383692.jpg> (referer: None)
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4784%252F20084784%252Fdocs_service_history-1774782960686.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6432c1aeaa21c56583657c74c7fec7f0%27 HTTP/1.1" 200 None
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4784/20084784/docs_service_history-1774782960686.jpg?ixlib=js-3.8.0&auto=format&s=6432c1aeaa21c56583657c74c7fec7f0 not downloaded yet
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4784%252F20084784%252Fdocs_service_history-1774782961007.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9581e7d1a1d3728b86e169cf3646e0a1%27 HTTP/1.1" 200 None
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4784/20084784/docs_service_history-1774782961007.jpg?ixlib=js-3.8.0&auto=format&s=9581e7d1a1d3728b86e169cf3646e0a1 not downloaded yet
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f907f450>
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9510%252F19939510%252Finterior_rear_seats-1774694151778.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9510/19939510/interior_rear_seats-1774694151778.jpg saved to cache
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73d67cc2-d057-5af5-9b96-34305b62dd09
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf69690>
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20461256%252Fexterior_rear_passenger-1774548398813.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_rear_passenger-1774548398813.jpg saved to cache
2026-03-29 20:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11e5c390-55e2-5b03-9156-d336ff049f20
2026-03-29 20:08:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9510/19939510/interior_front_seats-1774694131469.jpg> (referer: None)
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ce3f90>
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20461256%252Fexterior_front_passenger-1774548405423.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_front_passenger-1774548405423.jpg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11e5c390-55e2-5b03-9156-d336ff049f20
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f20050>
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20461256%252Fexterior_rear_driver-1774548383692.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_rear_driver-1774548383692.jpg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11e5c390-55e2-5b03-9156-d336ff049f20
2026-03-29 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9510/19939510/exterior_front_driver-1774693689277.jpg> (referer: None)
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:08:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9598750>
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9510%252F19939510%252Finterior_front_seats-1774694131469.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9510/19939510/interior_front_seats-1774694131469.jpg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73d67cc2-d057-5af5-9b96-34305b62dd09
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa1ba10>
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9510%252F19939510%252Fexterior_front_driver-1774693689277.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9510/19939510/exterior_front_driver-1774693689277.jpg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73d67cc2-d057-5af5-9b96-34305b62dd09
2026-03-29 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9510/19939510/exterior_rear_driver-1774693702120.jpg> (referer: None)
2026-03-29 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_front_driver-1774548378207.jpg> (referer: None)
2026-03-29 20:08:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_rear_driver-1773684368339.jpg> (referer: None)
2026-03-29 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_rear_passenger-1773684446559.jpg> (referer: None)
2026-03-29 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_front_passenger-1773684400123.jpg> (referer: None)
2026-03-29 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_front_driver-1773684352617.jpg> (referer: None)
2026-03-29 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_front_driver-1774702724666.jpg> (referer: None)
2026-03-29 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6190/19916190/interior_front_seats-1774712922915.jpg> (referer: None)
2026-03-29 20:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_rear_passenger-1771777729528.jpg> (referer: None)
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f960d8d0>
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9510%252F19939510%252Fexterior_rear_driver-1774693702120.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9510/19939510/exterior_rear_driver-1774693702120.jpg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73d67cc2-d057-5af5-9b96-34305b62dd09
2026-03-29 20:08:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73d67cc2-d057-5af5-9b96-34305b62dd09, skipping ID generation
2026-03-29 20:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73d67cc2-d057-5af5-9b96-34305b62dd09 with scrape type 1
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73d67cc2-d057-5af5-9b96-34305b62dd09 sending to next pipeline
2026-03-29 20:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 73d67cc2-d057-5af5-9b96-34305b62dd09, identifier: 19939510
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f855e9d0>
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1256%252F20461256%252Fexterior_front_driver-1774548378207.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_front_driver-1774548378207.jpg saved to cache
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11e5c390-55e2-5b03-9156-d336ff049f20
2026-03-29 20:08:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11e5c390-55e2-5b03-9156-d336ff049f20, skipping ID generation
2026-03-29 20:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e5c390-55e2-5b03-9156-d336ff049f20 with scrape type 1
2026-03-29 20:08:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11e5c390-55e2-5b03-9156-d336ff049f20 sending to next pipeline
2026-03-29 20:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 11e5c390-55e2-5b03-9156-d336ff049f20, identifier: 20461256
2026-03-29 20:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 73d67cc2-d057-5af5-9b96-34305b62dd09 with identifier: 19939510
2026-03-29 20:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 73d67cc2-d057-5af5-9b96-34305b62dd09 with identifier: 19939510
2026-03-29 20:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 73d67cc2-d057-5af5-9b96-34305b62dd09 with identifier: 19939510 to the API
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9510/19939510/exterior_rear_driver-1774693702120.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '73d67cc2-d057-5af5-9b96-34305b62dd09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SA21 NLL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19939510',
'listing': 'auction',
'location': 'Greater Manchester Wigan',
'make': 'Vauxhall',
'model': 'Grandland',
'odometer': 42291,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1893893,
'Height': 2894,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9510/19939510/exterior_front_driver-1774693689277.jpg',
'Width': 3858},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1944046,
'Height': 2736,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9510/19939510/exterior_rear_driver-1774693702120.jpg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2168044,
'Height': 2543,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9510/19939510/exterior_front_passenger-1774697111468.jpg',
'Width': 3391},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1841740,
'Height': 2583,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9510/19939510/exterior_rear_passenger-1774693715538.jpg',
'Width': 3444},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4427568,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9510/19939510/interior_front_seats-1774694131469.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3832785,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9510/19939510/interior_rear_seats-1774694151778.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2224956,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9510/19939510/interior_dashboard-1774694223231.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570284,
'Height': 1742,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9510/19939510/instrument_cluster-1774697003870.jpg',
'Width': 2322},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3504035,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9510/19939510/interior_boot-1774694179175.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73d67cc2-d057-5af5-9b96-34305b62dd09/73d67cc2-d057-5af5-9b96-34305b62dd09_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 826107,
'Height': 1581,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9510/19939510/docs_service_history-1774694357998.jpg?ixlib=js-3.8.0&auto=format&s=13ee69f104e4950de0981c4b49957ae5',
'Width': 4137}],
'price': 10539,
'price_includes_vat': False,
'registration_date': '2021-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Grandland X SRI NAV Turbo A',
'transmission': 'automatic',
'trim': 'X SRI NAV Turbo A',
'vin': 'W0VZRHNS5M6812747',
'year': 2021}
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719939510%27 HTTP/1.1" 200 None
2026-03-29 20:08:57 [motorway.uk] INFO: Saving data for 19939510: {'created_time': 1774814937.377739, 'last_price_update_time': 1774814937.377749, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19939510') HTTP/1.1" 204 0
2026-03-29 20:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 11e5c390-55e2-5b03-9156-d336ff049f20 with identifier: 20461256
2026-03-29 20:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 11e5c390-55e2-5b03-9156-d336ff049f20 with identifier: 20461256
2026-03-29 20:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 11e5c390-55e2-5b03-9156-d336ff049f20 with identifier: 20461256 to the API
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_front_driver-1774548378207.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '11e5c390-55e2-5b03-9156-d336ff049f20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SK61 UVH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20461256',
'listing': 'auction',
'location': 'Dorset Poole',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 126171,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1903203,
'Height': 2952,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_front_driver-1774548378207.jpg',
'Width': 3936},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 921767,
'Height': 2397,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_rear_driver-1774548383692.jpg',
'Width': 3196},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 968354,
'Height': 2276,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_front_passenger-1774548405423.jpg',
'Width': 3035},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 792659,
'Height': 2129,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1256/20461256/exterior_rear_passenger-1774548398813.jpg',
'Width': 2838},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3271251,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1256/20461256/interior_front_seats-1774697317122.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3402673,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1256/20461256/interior_dashboard-1774697278783.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2311895,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1256/20461256/instrument_cluster-1774697455238.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3060512,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1256/20461256/interior_boot-1774697294946.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2343816,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1256/20461256/damage_paintwork-1774548439888.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11e5c390-55e2-5b03-9156-d336ff049f20/11e5c390-55e2-5b03-9156-d336ff049f20_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2472119,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1256/20461256/damage_paintwork-1774548465499.jpg',
'Width': 4032}],
'price': 636,
'price_includes_vat': False,
'registration_date': '2011-09-01',
'seats_number': None,
'seller_name': None,
'title': 'Citroen Berlingo 625 EN-PRISE HDi',
'transmission': 'manual',
'trim': '625 EN-PRISE HDi',
'vin': 'VF77B9HTCBJ726151',
'year': 2011}
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720461256%27 HTTP/1.1" 200 None
2026-03-29 20:08:57 [motorway.uk] INFO: Saving data for 20461256: {'created_time': 1774814937.832238, 'last_price_update_time': 1774814937.832256, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20461256') HTTP/1.1" 204 0
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad92e90>
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4784%252F20084784%252Fexterior_rear_driver-1773684368339.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_rear_driver-1773684368339.jpg saved to cache
2026-03-29 20:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e357175-4060-5445-ba82-db72f188d622
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac964d0>
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4784%252F20084784%252Fexterior_rear_passenger-1773684446559.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_rear_passenger-1773684446559.jpg saved to cache
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e357175-4060-5445-ba82-db72f188d622
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f957c5d0>
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4784%252F20084784%252Fexterior_front_passenger-1773684400123.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_front_passenger-1773684400123.jpg saved to cache
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e357175-4060-5445-ba82-db72f188d622
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac94bd0>
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4784%252F20084784%252Fexterior_front_driver-1773684352617.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_front_driver-1773684352617.jpg saved to cache
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e357175-4060-5445-ba82-db72f188d622
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ed1290>
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7855%252F20487855%252Fexterior_front_driver-1774702724666.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_front_driver-1774702724666.jpg saved to cache
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1
2026-03-29 20:08:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cddb25d9-08c2-51f2-b91d-eb4d89c686d1, skipping ID generation
2026-03-29 20:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1 with scrape type 1
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cddb25d9-08c2-51f2-b91d-eb4d89c686d1 sending to next pipeline
2026-03-29 20:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cddb25d9-08c2-51f2-b91d-eb4d89c686d1, identifier: 20487855
2026-03-29 20:08:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:08:58 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xf0\x0f\x00\x00'
2026-03-29 20:08:58 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-A556B\x00'
2026-03-29 20:08:58 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:08:58 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'A556BXXSDCZB5\x00'
2026-03-29 20:08:58 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xf4\x0b\x00\x00'
2026-03-29 20:08:58 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:08:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe1\x00\x00\x00'
2026-03-29 20:08:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:08:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:08:58 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:28 15:48:28\x00'
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9314290>
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6190%252F19916190%252Finterior_front_seats-1774712922915.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6190/19916190/interior_front_seats-1774712922915.jpg saved to cache
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 994707c6-dc1f-5685-9370-d22a85780558
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9295a50>
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6190%252F19916190%252Fexterior_rear_passenger-1771777729528.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_rear_passenger-1771777729528.jpg saved to cache
2026-03-29 20:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 994707c6-dc1f-5685-9370-d22a85780558
2026-03-29 20:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cddb25d9-08c2-51f2-b91d-eb4d89c686d1 with identifier: 20487855
2026-03-29 20:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cddb25d9-08c2-51f2-b91d-eb4d89c686d1 with identifier: 20487855
2026-03-29 20:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cddb25d9-08c2-51f2-b91d-eb4d89c686d1 with identifier: 20487855 to the API
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_front_driver-1774702724666.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'cddb25d9-08c2-51f2-b91d-eb4d89c686d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YV19 ZWX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487855',
'listing': 'auction',
'location': 'South Yorkshire Sheffield',
'make': 'Honda',
'model': 'Civic',
'odometer': 66788,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2192811,
'Height': 2541,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_front_driver-1774702724666.jpg',
'Width': 3388},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1528778,
'Height': 2359,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_rear_driver-1774702902363.jpg',
'Width': 3145},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1941556,
'Height': 2409,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_front_passenger-1774702901332.jpg',
'Width': 3212},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1804758,
'Height': 2505,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7855/20487855/exterior_rear_passenger-1774702901588.jpg',
'Width': 3340},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3313373,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7855/20487855/interior_front_seats-1774703982620.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3753001,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7855/20487855/interior_rear_seats-1774703954740.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3200274,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7855/20487855/interior_dashboard-1774703857151.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2702652,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7855/20487855/instrument_cluster-1774703779848.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4240584,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7855/20487855/interior_boot-1774703788950.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cddb25d9-08c2-51f2-b91d-eb4d89c686d1/cddb25d9-08c2-51f2-b91d-eb4d89c686d1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1143767,
'Height': 3015,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7855/20487855/docs_service_history-1774704300359.jpg?ixlib=js-3.8.0&auto=format&s=48e265c9e17651e374e7fc69b894bd8d',
'Width': 4818}],
'price': 7588,
'price_includes_vat': False,
'registration_date': '2019-07-23',
'seats_number': None,
'seller_name': None,
'title': 'Honda Civic SR VTEC',
'transmission': 'manual',
'trim': 'SR VTEC',
'vin': 'SHHFK6760KU001365',
'year': 2019}
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487855%27 HTTP/1.1" 200 None
2026-03-29 20:08:59 [motorway.uk] INFO: Saving data for 20487855: {'created_time': 1774814939.053682, 'last_price_update_time': 1774814939.053692, 'auction_closing_time': 1774884600.0}
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487855') HTTP/1.1" 204 0
2026-03-29 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1548&page=43&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4784/20084784/docs_service_history-1774782960686.jpg?ixlib=js-3.8.0&auto=format&s=6432c1aeaa21c56583657c74c7fec7f0> (referer: None)
2026-03-29 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4784/20084784/docs_service_history-1774782961007.jpg?ixlib=js-3.8.0&auto=format&s=9581e7d1a1d3728b86e169cf3646e0a1> (referer: None)
2026-03-29 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_front_passenger-1771777822017.jpg> (referer: None)
2026-03-29 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4784/20084784/interior_front_seats-1774783413981.jpg> (referer: None)
2026-03-29 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4784/20084784/interior_rear_seats-1773684970870.jpg> (referer: None)
2026-03-29 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4784/20084784/interior_dashboard-1774782439147.jpg> (referer: None)
2026-03-29 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4784/20084784/interior_boot-1774782401837.jpg> (referer: None)
2026-03-29 20:08:59 [motorway.uk] INFO: Found listing with ID: 20440595
2026-03-29 20:08:59 [motorway.uk] INFO: Found listing with ID: 20484011
2026-03-29 20:08:59 [motorway.uk] INFO: Found listing with ID: 20329533
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720329533%27 HTTP/1.1" 200 None
2026-03-29 20:08:59 [motorway.uk] INFO: Scrape type for 20329533: 1
2026-03-29 20:08:59 [motorway.uk] INFO: Found listing with ID: 19798498
2026-03-29 20:08:59 [motorway.uk] INFO: Found listing with ID: 20066226
2026-03-29 20:08:59 [motorway.uk] INFO: Found listing with ID: 18421687
2026-03-29 20:08:59 [motorway.uk] INFO: Found listing with ID: 20199197
2026-03-29 20:08:59 [motorway.uk] INFO: Found listing with ID: 19475567
2026-03-29 20:08:59 [motorway.uk] INFO: Found listing with ID: 19580249
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719580249%27 HTTP/1.1" 200 None
2026-03-29 20:08:59 [motorway.uk] INFO: Scrape type for 19580249: 1
2026-03-29 20:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3566/20113566/docs_service_history-1774703548303.jpg?ixlib=js-3.8.0&auto=format&s=be59a8af22ffb501b36cf5fa3097f3db> (referer: None)
2026-03-29 20:08:59 [motorway.uk] INFO: Found listing with ID: 9018744
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279018744%27 HTTP/1.1" 200 None
2026-03-29 20:08:59 [motorway.uk] INFO: Scrape type for 9018744: 2
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a5a910>
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4784%252F20084784%252Fdocs_service_history-1774782960686.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6432c1aeaa21c56583657c74c7fec7f0') HTTP/1.1" 204 0
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4784/20084784/docs_service_history-1774782960686.jpg?ixlib=js-3.8.0&auto=format&s=6432c1aeaa21c56583657c74c7fec7f0 saved to cache
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e357175-4060-5445-ba82-db72f188d622
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94c81d0>
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4784%252F20084784%252Fdocs_service_history-1774782961007.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9581e7d1a1d3728b86e169cf3646e0a1') HTTP/1.1" 204 0
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4784/20084784/docs_service_history-1774782961007.jpg?ixlib=js-3.8.0&auto=format&s=9581e7d1a1d3728b86e169cf3646e0a1 saved to cache
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e357175-4060-5445-ba82-db72f188d622
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a58350>
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6190%252F19916190%252Fexterior_front_passenger-1771777822017.jpg') HTTP/1.1" 204 0
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_front_passenger-1771777822017.jpg saved to cache
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 994707c6-dc1f-5685-9370-d22a85780558
2026-03-29 20:08:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 994707c6-dc1f-5685-9370-d22a85780558, skipping ID generation
2026-03-29 20:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 994707c6-dc1f-5685-9370-d22a85780558 with scrape type 1
2026-03-29 20:08:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 994707c6-dc1f-5685-9370-d22a85780558 sending to next pipeline
2026-03-29 20:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 994707c6-dc1f-5685-9370-d22a85780558, identifier: 19916190
2026-03-29 20:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 994707c6-dc1f-5685-9370-d22a85780558 with identifier: 19916190
2026-03-29 20:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 994707c6-dc1f-5685-9370-d22a85780558 with identifier: 19916190
2026-03-29 20:08:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 994707c6-dc1f-5685-9370-d22a85780558 with identifier: 19916190 to the API
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:08:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_front_passenger-1771777822017.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '994707c6-dc1f-5685-9370-d22a85780558',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MK66 XTG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19916190',
'listing': 'auction',
'location': 'Cumbria Carlisle',
'make': 'MINI',
'model': 'Clubman',
'odometer': 46541,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 878015,
'Height': 2118,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_front_driver-1771777473621.jpg',
'Width': 2824},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 930350,
'Height': 2165,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_rear_driver-1771777333219.jpg',
'Width': 2887},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 849274,
'Height': 2029,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_front_passenger-1771777822017.jpg',
'Width': 2705},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 826732,
'Height': 1988,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6190/19916190/exterior_rear_passenger-1771777729528.jpg',
'Width': 2651},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8086171,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/6190/19916190/interior_front_seats-1774712922915.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7951519,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/6190/19916190/interior_rear_seats-1774712792178.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1483137,
'Height': 4080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6190/19916190/interior_dashboard-1774712755203.jpg',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1422370,
'Height': 4080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6190/19916190/instrument_cluster-1774712777022.jpg',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 9052063,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/6190/19916190/interior_boot-1774712746976.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_994707c6-dc1f-5685-9370-d22a85780558/994707c6-dc1f-5685-9370-d22a85780558_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8574193,
'Height': 3060,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6190/19916190/docs_service_history-1774713066206.jpg?ixlib=js-3.8.0&auto=format&s=1ba05becc43b9a354a1ce4e1f3e149a8',
'Width': 4080}],
'price': 9661,
'price_includes_vat': False,
'registration_date': '2016-09-13',
'seats_number': None,
'seller_name': None,
'title': 'MINI Clubman Cooper Auto',
'transmission': 'automatic',
'trim': 'Cooper Auto',
'vin': 'WMWLN320102E15765',
'year': 2016}
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719916190%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [motorway.uk] INFO: Saving data for 19916190: {'created_time': 1774814940.056174, 'last_price_update_time': 1774814940.056191, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19916190') HTTP/1.1" 204 0
2026-03-29 20:09:00 [motorway.uk] INFO: Found listing with ID: 20414685
2026-03-29 20:09:00 [motorway.uk] INFO: Found listing with ID: 14657011
2026-03-29 20:09:00 [motorway.uk] INFO: Found listing with ID: 19911856
2026-03-29 20:09:00 [motorway.uk] INFO: Found listing with ID: 10143250
2026-03-29 20:09:00 [motorway.uk] INFO: Found listing with ID: 20267897
2026-03-29 20:09:00 [motorway.uk] INFO: Found listing with ID: 19688766
2026-03-29 20:09:00 [motorway.uk] INFO: Found listing with ID: 20489770
2026-03-29 20:09:00 [motorway.uk] INFO: Found listing with ID: 16571680
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716571680%27 HTTP/1.1" 200 None
2026-03-29 20:09:00 [motorway.uk] INFO: Scrape type for 16571680: 1
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faad7bd0>
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4784%252F20084784%252Finterior_front_seats-1774783413981.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4784/20084784/interior_front_seats-1774783413981.jpg saved to cache
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e357175-4060-5445-ba82-db72f188d622
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9099cd0>
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4784%252F20084784%252Finterior_rear_seats-1773684970870.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4784/20084784/interior_rear_seats-1773684970870.jpg saved to cache
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e357175-4060-5445-ba82-db72f188d622
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa157410>
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4784%252F20084784%252Finterior_dashboard-1774782439147.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4784/20084784/interior_dashboard-1774782439147.jpg saved to cache
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e357175-4060-5445-ba82-db72f188d622
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9098350>
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4784%252F20084784%252Finterior_boot-1774782401837.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4784/20084784/interior_boot-1774782401837.jpg saved to cache
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e357175-4060-5445-ba82-db72f188d622
2026-03-29 20:09:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e357175-4060-5445-ba82-db72f188d622, skipping ID generation
2026-03-29 20:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e357175-4060-5445-ba82-db72f188d622 with scrape type 1
2026-03-29 20:09:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e357175-4060-5445-ba82-db72f188d622 sending to next pipeline
2026-03-29 20:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8e357175-4060-5445-ba82-db72f188d622, identifier: 20084784
2026-03-29 20:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8e357175-4060-5445-ba82-db72f188d622 with identifier: 20084784
2026-03-29 20:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8e357175-4060-5445-ba82-db72f188d622 with identifier: 20084784
2026-03-29 20:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8e357175-4060-5445-ba82-db72f188d622 with identifier: 20084784 to the API
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4784/20084784/interior_boot-1774782401837.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8e357175-4060-5445-ba82-db72f188d622',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP15 YBL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20084784',
'listing': 'auction',
'location': 'Leicestershire Derby',
'make': 'Peugeot',
'model': '308',
'odometer': 41714,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1812889,
'Height': 2839,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_front_driver-1773684352617.jpg',
'Width': 3785},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1609751,
'Height': 2625,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_rear_driver-1773684368339.jpg',
'Width': 3500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2008443,
'Height': 2922,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_front_passenger-1773684400123.jpg',
'Width': 3896},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1994123,
'Height': 2935,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4784/20084784/exterior_rear_passenger-1773684446559.jpg',
'Width': 3913},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3996054,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4784/20084784/interior_front_seats-1774783413981.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2582824,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4784/20084784/interior_rear_seats-1773684970870.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3505418,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4784/20084784/interior_dashboard-1774782439147.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3828998,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4784/20084784/interior_boot-1774782401837.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646494,
'Height': 2083,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4784/20084784/docs_service_history-1774782960686.jpg?ixlib=js-3.8.0&auto=format&s=6432c1aeaa21c56583657c74c7fec7f0',
'Width': 3559},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e357175-4060-5445-ba82-db72f188d622/8e357175-4060-5445-ba82-db72f188d622_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 795945,
'Height': 2167,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4784/20084784/docs_service_history-1774782961007.jpg?ixlib=js-3.8.0&auto=format&s=9581e7d1a1d3728b86e169cf3646e0a1',
'Width': 3267}],
'price': 4269,
'price_includes_vat': False,
'registration_date': '2015-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 308 Allure HDi S/S',
'transmission': 'manual',
'trim': 'Allure HDi S/S',
'vin': 'VF3LB9HCGFS108149',
'year': 2015}
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720084784%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [motorway.uk] INFO: Saving data for 20084784: {'created_time': 1774814941.058096, 'last_price_update_time': 1774814941.05811, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20084784') HTTP/1.1" 204 0
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 20430888
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 20485034
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485034%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [motorway.uk] INFO: Scrape type for 20485034: 1
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f960f5d0>
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcfeb1b-6fbb-52bb-a537-5a400e24269a/dbcfeb1b-6fbb-52bb-a537-5a400e24269a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3566%252F20113566%252Fdocs_service_history-1774703548303.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbe59a8af22ffb501b36cf5fa3097f3db') HTTP/1.1" 204 0
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3566/20113566/docs_service_history-1774703548303.jpg?ixlib=js-3.8.0&auto=format&s=be59a8af22ffb501b36cf5fa3097f3db saved to cache
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbcfeb1b-6fbb-52bb-a537-5a400e24269a
2026-03-29 20:09:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 3044789
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273044789%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [motorway.uk] INFO: Scrape type for 3044789: 1
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 20138195
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 20392438
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 16417496
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 18624558
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 19258894
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 13525953
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713525953%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [motorway.uk] INFO: Scrape type for 13525953: 1
2026-03-29 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8574/19358574/docs_service_history-1774696077425.jpg?ixlib=js-3.8.0&auto=format&s=22833652c46e373b65949e7a42adeebe> (referer: None)
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 17208307
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 17537906
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 15848839
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715848839%27 HTTP/1.1" 200 None
2026-03-29 20:09:01 [motorway.uk] INFO: Scrape type for 15848839: 1
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 20122744
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 20442189
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 19052068
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 20414776
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 10974269
2026-03-29 20:09:01 [motorway.uk] INFO: Found listing with ID: 20354803
2026-03-29 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3566/20113566/instrument_cluster-1774702976780.jpg> (referer: None)
2026-03-29 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3566/20113566/interior_boot-1774703765770.jpg> (referer: None)
2026-03-29 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8574/19358574/interior_dashboard-1774695064535.jpg> (referer: None)
2026-03-29 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8574/19358574/instrument_cluster-1774695092486.jpg> (referer: None)
2026-03-29 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8574/19358574/interior_front_seats-1774694989422.jpg> (referer: None)
2026-03-29 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8574/19358574/interior_boot-1774695075824.jpg> (referer: None)
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f91b7e90>
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a1055f-8404-5d55-a5d8-a0848d0a78fb/e8a1055f-8404-5d55-a5d8-a0848d0a78fb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8574%252F19358574%252Fdocs_service_history-1774696077425.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D22833652c46e373b65949e7a42adeebe') HTTP/1.1" 204 0
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8574/19358574/docs_service_history-1774696077425.jpg?ixlib=js-3.8.0&auto=format&s=22833652c46e373b65949e7a42adeebe saved to cache
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8a1055f-8404-5d55-a5d8-a0848d0a78fb
2026-03-29 20:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489994.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f960dfd0>
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcfeb1b-6fbb-52bb-a537-5a400e24269a/dbcfeb1b-6fbb-52bb-a537-5a400e24269a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3566%252F20113566%252Finstrument_cluster-1774702976780.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3566/20113566/instrument_cluster-1774702976780.jpg saved to cache
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbcfeb1b-6fbb-52bb-a537-5a400e24269a
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa1bad0>
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcfeb1b-6fbb-52bb-a537-5a400e24269a/dbcfeb1b-6fbb-52bb-a537-5a400e24269a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3566%252F20113566%252Finterior_boot-1774703765770.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3566/20113566/interior_boot-1774703765770.jpg saved to cache
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbcfeb1b-6fbb-52bb-a537-5a400e24269a
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f25b90>
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a1055f-8404-5d55-a5d8-a0848d0a78fb/e8a1055f-8404-5d55-a5d8-a0848d0a78fb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8574%252F19358574%252Finterior_dashboard-1774695064535.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8574/19358574/interior_dashboard-1774695064535.jpg saved to cache
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8a1055f-8404-5d55-a5d8-a0848d0a78fb
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f90d7e10>
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a1055f-8404-5d55-a5d8-a0848d0a78fb/e8a1055f-8404-5d55-a5d8-a0848d0a78fb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8574%252F19358574%252Finstrument_cluster-1774695092486.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8574/19358574/instrument_cluster-1774695092486.jpg saved to cache
2026-03-29 20:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8a1055f-8404-5d55-a5d8-a0848d0a78fb
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f27890>
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a1055f-8404-5d55-a5d8-a0848d0a78fb/e8a1055f-8404-5d55-a5d8-a0848d0a78fb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8574%252F19358574%252Finterior_front_seats-1774694989422.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8574/19358574/interior_front_seats-1774694989422.jpg saved to cache
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8a1055f-8404-5d55-a5d8-a0848d0a78fb
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faad6190>
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a1055f-8404-5d55-a5d8-a0848d0a78fb/e8a1055f-8404-5d55-a5d8-a0848d0a78fb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8574%252F19358574%252Finterior_boot-1774695075824.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8574/19358574/interior_boot-1774695075824.jpg saved to cache
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8a1055f-8404-5d55-a5d8-a0848d0a78fb
2026-03-29 20:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a with identifier: 20489994
2026-03-29 20:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a with scrape type 1
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9994%252F20489994%252Fexterior_front_driver-1774714077947.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9994/20489994/exterior_front_driver-1774714077947.jpg not downloaded yet
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9994%252F20489994%252Fexterior_rear_driver-1774713658495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9994/20489994/exterior_rear_driver-1774713658495.jpg not downloaded yet
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9994%252F20489994%252Fexterior_front_passenger-1774713675597.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9994/20489994/exterior_front_passenger-1774713675597.jpg not downloaded yet
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9994%252F20489994%252Fexterior_rear_passenger-1774713687443.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9994/20489994/exterior_rear_passenger-1774713687443.jpg not downloaded yet
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9994%252F20489994%252Finterior_front_seats-1774711536431.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9994/20489994/interior_front_seats-1774711536431.jpg not downloaded yet
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9994%252F20489994%252Finterior_rear_seats-1774711544886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9994/20489994/interior_rear_seats-1774711544886.jpg not downloaded yet
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9994%252F20489994%252Finterior_dashboard-1774713701007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9994/20489994/interior_dashboard-1774713701007.jpg not downloaded yet
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9994%252F20489994%252Finstrument_cluster-1774711760460.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9994/20489994/instrument_cluster-1774711760460.jpg not downloaded yet
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9994%252F20489994%252Finterior_boot-1774711584178.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9994/20489994/interior_boot-1774711584178.jpg not downloaded yet
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9994%252F20489994%252Fdocs_service_history-1774711806196.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D65be2d77e6e2863a322ea36e5e7725da%27 HTTP/1.1" 200 None
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9994/20489994/docs_service_history-1774711806196.jpg?ixlib=js-3.8.0&auto=format&s=65be2d77e6e2863a322ea36e5e7725da not downloaded yet
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8574/19358574/exterior_rear_passenger-1774694247295.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3566/20113566/interior_rear_seats-1774703837598.jpg> (referer: None)
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cfa310>
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a1055f-8404-5d55-a5d8-a0848d0a78fb/e8a1055f-8404-5d55-a5d8-a0848d0a78fb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8574%252F19358574%252Fexterior_rear_passenger-1774694247295.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8574/19358574/exterior_rear_passenger-1774694247295.jpg saved to cache
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8a1055f-8404-5d55-a5d8-a0848d0a78fb
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95a9050>
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcfeb1b-6fbb-52bb-a537-5a400e24269a/dbcfeb1b-6fbb-52bb-a537-5a400e24269a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3566%252F20113566%252Finterior_rear_seats-1774703837598.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3566/20113566/interior_rear_seats-1774703837598.jpg saved to cache
2026-03-29 20:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbcfeb1b-6fbb-52bb-a537-5a400e24269a
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3566/20113566/interior_front_seats-1774702937876.jpg> (referer: None)
2026-03-29 20:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8574/19358574/exterior_rear_driver-1774694236101.jpg> (referer: None)
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac24c10>
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbcfeb1b-6fbb-52bb-a537-5a400e24269a/dbcfeb1b-6fbb-52bb-a537-5a400e24269a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3566%252F20113566%252Finterior_front_seats-1774702937876.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3566/20113566/interior_front_seats-1774702937876.jpg saved to cache
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbcfeb1b-6fbb-52bb-a537-5a400e24269a
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cf9190>
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8a1055f-8404-5d55-a5d8-a0848d0a78fb/e8a1055f-8404-5d55-a5d8-a0848d0a78fb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8574%252F19358574%252Fexterior_rear_driver-1774694236101.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8574/19358574/exterior_rear_driver-1774694236101.jpg saved to cache
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8a1055f-8404-5d55-a5d8-a0848d0a78fb
2026-03-29 20:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9994/20489994/interior_dashboard-1774713701007.jpg> (referer: None)
2026-03-29 20:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/5025216.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9994/20489994/docs_service_history-1774711806196.jpg?ixlib=js-3.8.0&auto=format&s=65be2d77e6e2863a322ea36e5e7725da> (referer: None)
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa13ddd0>
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9994%252F20489994%252Finterior_dashboard-1774713701007.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9994/20489994/interior_dashboard-1774713701007.jpg saved to cache
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a
2026-03-29 20:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1014eb9b-c103-5686-ac51-3846fe06778d with identifier: 5025216
2026-03-29 20:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1014eb9b-c103-5686-ac51-3846fe06778d with scrape type 1
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1014eb9b-c103-5686-ac51-3846fe06778d
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5216%252F5025216%252Fexterior_front_driver-1774787979295.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_front_driver-1774787979295.jpg not downloaded yet
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89d8b10>
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9994%252F20489994%252Fdocs_service_history-1774711806196.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D65be2d77e6e2863a322ea36e5e7725da') HTTP/1.1" 204 0
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9994/20489994/docs_service_history-1774711806196.jpg?ixlib=js-3.8.0&auto=format&s=65be2d77e6e2863a322ea36e5e7725da saved to cache
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5216%252F5025216%252Fexterior_rear_driver-1774787994414.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_rear_driver-1774787994414.jpg not downloaded yet
2026-03-29 20:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9994/20489994/instrument_cluster-1774711760460.jpg> (referer: None)
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5216%252F5025216%252Fexterior_front_passenger-1774788054146.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_front_passenger-1774788054146.jpg not downloaded yet
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5216%252F5025216%252Fexterior_rear_passenger-1774788018511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_rear_passenger-1774788018511.jpg not downloaded yet
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5216%252F5025216%252Finterior_front_seats-1774788428746.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5216/5025216/interior_front_seats-1774788428746.jpg not downloaded yet
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5216%252F5025216%252Finterior_rear_seats-1774788433842.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5216/5025216/interior_rear_seats-1774788433842.jpg not downloaded yet
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5216%252F5025216%252Finterior_dashboard-1774788498895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5216/5025216/interior_dashboard-1774788498895.jpg not downloaded yet
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5216%252F5025216%252Finstrument_cluster-1774788531641.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5216/5025216/instrument_cluster-1774788531641.jpg not downloaded yet
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5216%252F5025216%252Finterior_boot-1774788508990.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5216/5025216/interior_boot-1774788508990.jpg not downloaded yet
2026-03-29 20:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9994/20489994/interior_boot-1774711584178.jpg> (referer: None)
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0d5590>
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9994%252F20489994%252Finstrument_cluster-1774711760460.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9994/20489994/instrument_cluster-1774711760460.jpg saved to cache
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5216%252F5025216%252Fdocs_service_history-1774789182687.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbcd109eaef2a6a244c7ceb15d4e65248%27 HTTP/1.1" 200 None
2026-03-29 20:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5216/5025216/docs_service_history-1774789182687.jpg?ixlib=js-3.8.0&auto=format&s=bcd109eaef2a6a244c7ceb15d4e65248 not downloaded yet
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8dc2cd0>
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9994%252F20489994%252Finterior_boot-1774711584178.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9994/20489994/interior_boot-1774711584178.jpg saved to cache
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_rear_driver-1774787994414.jpg> (referer: None)
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9994/20489994/interior_rear_seats-1774711544886.jpg> (referer: None)
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9994/20489994/interior_front_seats-1774711536431.jpg> (referer: None)
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9994/20489994/exterior_rear_passenger-1774713687443.jpg> (referer: None)
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20391441.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5216/5025216/docs_service_history-1774789182687.jpg?ixlib=js-3.8.0&auto=format&s=bcd109eaef2a6a244c7ceb15d4e65248> (referer: None)
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8dc1e90>
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5216%252F5025216%252Fexterior_rear_driver-1774787994414.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_rear_driver-1774787994414.jpg saved to cache
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1014eb9b-c103-5686-ac51-3846fe06778d
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20329533.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf6c3d0>
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9994%252F20489994%252Finterior_rear_seats-1774711544886.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9994/20489994/interior_rear_seats-1774711544886.jpg saved to cache
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88ed290>
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9994%252F20489994%252Finterior_front_seats-1774711536431.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9994/20489994/interior_front_seats-1774711536431.jpg saved to cache
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f91da6d0>
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9994%252F20489994%252Fexterior_rear_passenger-1774713687443.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9994/20489994/exterior_rear_passenger-1774713687443.jpg saved to cache
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a
2026-03-29 20:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d52d825d-0b86-51a3-bf94-dc369e652fdb with identifier: 20391441
2026-03-29 20:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d52d825d-0b86-51a3-bf94-dc369e652fdb with scrape type 1
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d52d825d-0b86-51a3-bf94-dc369e652fdb
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1441%252F20391441%252Fexterior_front_driver-1774193147316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_front_driver-1774193147316.jpg not downloaded yet
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9313750>
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5216%252F5025216%252Fdocs_service_history-1774789182687.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbcd109eaef2a6a244c7ceb15d4e65248') HTTP/1.1" 204 0
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5216/5025216/docs_service_history-1774789182687.jpg?ixlib=js-3.8.0&auto=format&s=bcd109eaef2a6a244c7ceb15d4e65248 saved to cache
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1014eb9b-c103-5686-ac51-3846fe06778d
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1441%252F20391441%252Fexterior_rear_driver-1774193173600.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_rear_driver-1774193173600.jpg not downloaded yet
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9018744.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1584&page=44&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1441%252F20391441%252Fexterior_front_passenger-1774193207001.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_front_passenger-1774193207001.jpg not downloaded yet
2026-03-29 20:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab0870f9-cf68-55f5-9d85-de9bafaee685 with identifier: 20329533
2026-03-29 20:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab0870f9-cf68-55f5-9d85-de9bafaee685 with scrape type 1
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab0870f9-cf68-55f5-9d85-de9bafaee685
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9533%252F20329533%252Fexterior_front_driver-1774188039113.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_front_driver-1774188039113.jpg not downloaded yet
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1441%252F20391441%252Fexterior_rear_passenger-1774193190323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_rear_passenger-1774193190323.jpg not downloaded yet
2026-03-29 20:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9533%252F20329533%252Fexterior_rear_driver-1774187996818.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_rear_driver-1774187996818.jpg not downloaded yet
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1441%252F20391441%252Finterior_front_seats-1774193728522.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1441/20391441/interior_front_seats-1774193728522.jpg not downloaded yet
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9533%252F20329533%252Fexterior_front_passenger-1774187956608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_front_passenger-1774187956608.jpg not downloaded yet
2026-03-29 20:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a445e1f1-f3e9-577d-90c5-72ca52c509f9 with identifier: 9018744
2026-03-29 20:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a445e1f1-f3e9-577d-90c5-72ca52c509f9 with scrape type 2
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a445e1f1-f3e9-577d-90c5-72ca52c509f9 with scrape type 2
2026-03-29 20:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a445e1f1-f3e9-577d-90c5-72ca52c509f9, identifier: 9018744
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 20451003
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 14684218
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 20422948
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 20499385
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 16912620
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 20290355
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 20346452
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 20492694
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 20488759
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488759%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [motorway.uk] INFO: Scrape type for 20488759: 1
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1441%252F20391441%252Finterior_rear_seats-1774193810668.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1441/20391441/interior_rear_seats-1774193810668.jpg not downloaded yet
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9533%252F20329533%252Fexterior_rear_passenger-1774187978792.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_rear_passenger-1774187978792.jpg not downloaded yet
2026-03-29 20:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a445e1f1-f3e9-577d-90c5-72ca52c509f9 with identifier: 9018744
2026-03-29 20:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a445e1f1-f3e9-577d-90c5-72ca52c509f9 with identifier: 9018744
2026-03-29 20:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a445e1f1-f3e9-577d-90c5-72ca52c509f9 with identifier: 9018744 to the API
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9018744.json>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a445e1f1-f3e9-577d-90c5-72ca52c509f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE15 USU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/9018744',
'listing': 'auction',
'location': 'Cambridgeshire Newmarket',
'make': 'MINI',
'model': 'Roadster',
'odometer': 95459,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 2300,
'price_includes_vat': False,
'registration_date': '2015-03-02',
'seats_number': None,
'seller_name': None,
'title': 'MINI Roadster Cooper S',
'transmission': 'manual',
'trim': 'Cooper S',
'vin': 'WMWSY32050T659512',
'year': 2015}
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279018744%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [motorway.uk] INFO: Saving data for 9018744: {'auction_closing_time': 1774884600.0, 'created_time': 1774211891.454732, 'last_price_update_time': 1774814945.717847}
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='9018744') HTTP/1.1" 204 0
2026-03-29 20:09:05 [scrapy.extensions.logstats] INFO: Crawled 381 pages (at 34 pages/min), scraped 210 items (at 25 items/min)
2026-03-29 20:09:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 309MiB
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 19778290
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719778290%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [motorway.uk] INFO: Scrape type for 19778290: 1
2026-03-29 20:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13525953.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16571680.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1441%252F20391441%252Finterior_dashboard-1774193847183.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1441/20391441/interior_dashboard-1774193847183.jpg not downloaded yet
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9533%252F20329533%252Finterior_front_seats-1774188461144.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9533/20329533/interior_front_seats-1774188461144.jpg not downloaded yet
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 20235127
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 20357385
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720357385%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [motorway.uk] INFO: Scrape type for 20357385: 2
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1441%252F20391441%252Finstrument_cluster-1774193819679.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1441/20391441/instrument_cluster-1774193819679.jpg not downloaded yet
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9533%252F20329533%252Finterior_rear_seats-1774188439802.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9533/20329533/interior_rear_seats-1774188439802.jpg not downloaded yet
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 5496276
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 20398366
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 20488805
2026-03-29 20:09:05 [motorway.uk] INFO: Found listing with ID: 19217492
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719217492%27 HTTP/1.1" 200 None
2026-03-29 20:09:05 [motorway.uk] INFO: Scrape type for 19217492: 1
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1441%252F20391441%252Finterior_boot-1774193919327.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1441/20391441/interior_boot-1774193919327.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9533%252F20329533%252Finterior_dashboard-1774710562887.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9533/20329533/interior_dashboard-1774710562887.jpg not downloaded yet
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 20311195
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 20418338
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720418338%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [motorway.uk] INFO: Scrape type for 20418338: 1
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1441%252F20391441%252Fdocs_service_history-1774194212928.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df1c85da3744787b5a0b32e1302b1d0f4%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1441/20391441/docs_service_history-1774194212928.jpg?ixlib=js-3.8.0&auto=format&s=f1c85da3744787b5a0b32e1302b1d0f4 not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9533%252F20329533%252Finstrument_cluster-1774188604412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9533/20329533/instrument_cluster-1774188604412.jpg not downloaded yet
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 16896697
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 20269930
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 20489216
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 19118754
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 16543574
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 19621328
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 20409554
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 19689914
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 20145284
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 20286923
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 15579981
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 16616720
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716616720%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [motorway.uk] INFO: Scrape type for 16616720: 1
2026-03-29 20:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5 with identifier: 13525953
2026-03-29 20:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5 with scrape type 1
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F13525953%252Fexterior_front_driver-1774697713128.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_front_driver-1774697713128.jpg not downloaded yet
2026-03-29 20:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72d4a6a6-656e-5ede-802c-ae3ec726e5b1 with identifier: 16571680
2026-03-29 20:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1 with scrape type 1
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1680%252F16571680%252Fexterior_front_driver-1774702701597.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_front_driver-1774702701597.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9533%252F20329533%252Finterior_boot-1774188372259.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9533/20329533/interior_boot-1774188372259.jpg not downloaded yet
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 7172629
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 7903453
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 19401646
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 20291009
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 19871725
2026-03-29 20:09:06 [motorway.uk] INFO: Found listing with ID: 19394258
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F13525953%252Fexterior_rear_driver-1774697700900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_rear_driver-1774697700900.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1680%252F16571680%252Fexterior_rear_driver-1774702716084.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_rear_driver-1774702716084.jpg not downloaded yet
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19580249.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19943403.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9533%252F20329533%252Fdocs_service_history-1774188596502.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D406d56770426bb9e484da81d2613d0a5%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9533/20329533/docs_service_history-1774188596502.jpg?ixlib=js-3.8.0&auto=format&s=406d56770426bb9e484da81d2613d0a5 not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F13525953%252Fexterior_front_passenger-1774697732410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_front_passenger-1774697732410.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1680%252F16571680%252Fexterior_front_passenger-1774702736867.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_front_passenger-1774702736867.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F13525953%252Fexterior_rear_passenger-1774697719765.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_rear_passenger-1774697719765.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1680%252F16571680%252Fexterior_rear_passenger-1774702723760.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_rear_passenger-1774702723760.jpg not downloaded yet
2026-03-29 20:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 729d3255-71d9-5910-81db-06bd30acd761 with identifier: 19580249
2026-03-29 20:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 729d3255-71d9-5910-81db-06bd30acd761 with scrape type 1
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 729d3255-71d9-5910-81db-06bd30acd761
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0249%252F19580249%252Fexterior_front_driver-1774603963389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_front_driver-1774603963389.jpg not downloaded yet
2026-03-29 20:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024 with identifier: 19943403
2026-03-29 20:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024 with scrape type 1
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3403%252F19943403%252Fexterior_front_driver-1774189275498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3403/19943403/exterior_front_driver-1774189275498.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5953%252F13525953%252Finterior_front_seats-1774698050819.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5953/13525953/interior_front_seats-1774698050819.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1680%252F16571680%252Finterior_front_seats-1774703919509.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1680/16571680/interior_front_seats-1774703919509.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0249%252F19580249%252Fexterior_rear_driver-1774603977242.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_rear_driver-1774603977242.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3403%252F19943403%252Fexterior_rear_driver-1774189307592.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3403/19943403/exterior_rear_driver-1774189307592.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5953%252F13525953%252Finterior_rear_seats-1774698062199.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5953/13525953/interior_rear_seats-1774698062199.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1680%252F16571680%252Finterior_rear_seats-1774703945120.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1680/16571680/interior_rear_seats-1774703945120.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0249%252F19580249%252Fexterior_front_passenger-1774604001174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_front_passenger-1774604001174.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3403%252F19943403%252Fexterior_front_passenger-1774625889915.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3403/19943403/exterior_front_passenger-1774625889915.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F13525953%252Finterior_dashboard-1774698166764.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/13525953/interior_dashboard-1774698166764.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1680%252F16571680%252Finterior_dashboard-1774703994752.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1680/16571680/interior_dashboard-1774703994752.jpg not downloaded yet
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5216/5025216/interior_dashboard-1774788498895.jpg> (referer: None)
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0249%252F19580249%252Fexterior_rear_passenger-1774603990682.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_rear_passenger-1774603990682.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3403%252F19943403%252Fexterior_rear_passenger-1774189326583.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3403/19943403/exterior_rear_passenger-1774189326583.jpg not downloaded yet
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_rear_passenger-1774788018511.jpg> (referer: None)
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F13525953%252Finstrument_cluster-1774698165277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/13525953/instrument_cluster-1774698165277.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1680%252F16571680%252Finstrument_cluster-1774704027666.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1680/16571680/instrument_cluster-1774704027666.jpg not downloaded yet
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_front_driver-1774193147316.jpg> (referer: None)
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0249%252F19580249%252Finterior_front_seats-1774604722282.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0249/19580249/interior_front_seats-1774604722282.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3403%252F19943403%252Finterior_front_seats-1774352156001.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3403/19943403/interior_front_seats-1774352156001.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5953%252F13525953%252Finterior_boot-1774698111430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5953/13525953/interior_boot-1774698111430.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1680%252F16571680%252Finterior_boot-1774703996488.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1680/16571680/interior_boot-1774703996488.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0249%252F19580249%252Finterior_rear_seats-1774604283352.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0249/19580249/interior_rear_seats-1774604283352.jpg not downloaded yet
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3403%252F19943403%252Finterior_rear_seats-1774351993063.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3403/19943403/interior_rear_seats-1774351993063.jpg not downloaded yet
2026-03-29 20:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15848839.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5953%252F13525953%252Fdocs_service_history-1774699380252.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D10863bff2823f1391dcf1619b9c6acbf%27 HTTP/1.1" 200 None
2026-03-29 20:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5953/13525953/docs_service_history-1774699380252.jpg?ixlib=js-3.8.0&auto=format&s=10863bff2823f1391dcf1619b9c6acbf not downloaded yet
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1680%252F16571680%252Fdocs_service_history-1774706822420.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De313df7084349f2898daadb3f8708e9f%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1680/16571680/docs_service_history-1774706822420.jpg?ixlib=js-3.8.0&auto=format&s=e313df7084349f2898daadb3f8708e9f not downloaded yet
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9455fd0>
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5216%252F5025216%252Finterior_dashboard-1774788498895.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5216/5025216/interior_dashboard-1774788498895.jpg saved to cache
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1014eb9b-c103-5686-ac51-3846fe06778d
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0249%252F19580249%252Finterior_dashboard-1774604311171.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0249/19580249/interior_dashboard-1774604311171.jpg not downloaded yet
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3403%252F19943403%252Finterior_dashboard-1774352001117.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3403/19943403/interior_dashboard-1774352001117.jpg not downloaded yet
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf02010>
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5216%252F5025216%252Fexterior_rear_passenger-1774788018511.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_rear_passenger-1774788018511.jpg saved to cache
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1014eb9b-c103-5686-ac51-3846fe06778d
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf02090>
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1441%252F20391441%252Fexterior_front_driver-1774193147316.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_front_driver-1774193147316.jpg saved to cache
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d52d825d-0b86-51a3-bf94-dc369e652fdb
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_rear_driver-1774193173600.jpg> (referer: None)
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0249%252F19580249%252Finstrument_cluster-1774604382192.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0249/19580249/instrument_cluster-1774604382192.jpg not downloaded yet
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3403%252F19943403%252Finstrument_cluster-1774351768858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3403/19943403/instrument_cluster-1774351768858.jpg not downloaded yet
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5216/5025216/interior_rear_seats-1774788433842.jpg> (referer: None)
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_front_passenger-1774788054146.jpg> (referer: None)
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0249%252F19580249%252Finterior_boot-1774604352048.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0249/19580249/interior_boot-1774604352048.jpg not downloaded yet
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3403%252F19943403%252Finterior_boot-1774352006888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3403/19943403/interior_boot-1774352006888.jpg not downloaded yet
2026-03-29 20:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 865718c0-1530-5c4f-954e-a0896ab6d099 with identifier: 15848839
2026-03-29 20:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 865718c0-1530-5c4f-954e-a0896ab6d099 with scrape type 1
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 865718c0-1530-5c4f-954e-a0896ab6d099
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8839%252F15848839%252Fexterior_front_driver-1774702986750.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_front_driver-1774702986750.jpeg not downloaded yet
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0249%252F19580249%252Fdamage_scratches-1774773037486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0249/19580249/damage_scratches-1774773037486.jpg not downloaded yet
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3403%252F19943403%252Fdocs_service_history-1774625425788.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7d65587e1da7fea8638faf8cf51106ef%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3403/19943403/docs_service_history-1774625425788.jpg?ixlib=js-3.8.0&auto=format&s=7d65587e1da7fea8638faf8cf51106ef not downloaded yet
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8839%252F15848839%252Fexterior_rear_driver-1774703019380.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_rear_driver-1774703019380.jpeg not downloaded yet
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8839%252F15848839%252Fexterior_front_passenger-1774703001636.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_front_passenger-1774703001636.jpeg not downloaded yet
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f9cb50>
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1441%252F20391441%252Fexterior_rear_driver-1774193173600.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_rear_driver-1774193173600.jpg saved to cache
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d52d825d-0b86-51a3-bf94-dc369e652fdb
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_rear_driver-1774702716084.jpg> (referer: None)
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8839%252F15848839%252Fexterior_rear_passenger-1774702414340.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_rear_passenger-1774702414340.jpeg not downloaded yet
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9619bd0>
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5216%252F5025216%252Finterior_rear_seats-1774788433842.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5216/5025216/interior_rear_seats-1774788433842.jpg saved to cache
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1014eb9b-c103-5686-ac51-3846fe06778d
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e40390>
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5216%252F5025216%252Fexterior_front_passenger-1774788054146.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_front_passenger-1774788054146.jpg saved to cache
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1014eb9b-c103-5686-ac51-3846fe06778d
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8839%252F15848839%252Finterior_front_seats-1774702935619.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8839/15848839/interior_front_seats-1774702935619.jpeg not downloaded yet
2026-03-29 20:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5216/5025216/instrument_cluster-1774788531641.jpg> (referer: None)
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89e7650>
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1680%252F16571680%252Fexterior_rear_driver-1774702716084.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_rear_driver-1774702716084.jpg saved to cache
2026-03-29 20:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1
2026-03-29 20:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5216/5025216/interior_boot-1774788508990.jpg> (referer: None)
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8839%252F15848839%252Finterior_rear_seats-1774702869037.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8839/15848839/interior_rear_seats-1774702869037.jpeg not downloaded yet
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8839%252F15848839%252Finterior_dashboard-1774702908221.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8839/15848839/interior_dashboard-1774702908221.jpeg not downloaded yet
2026-03-29 20:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_rear_passenger-1774187978792.jpg> (referer: None)
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8839%252F15848839%252Finstrument_cluster-1774702968026.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8839/15848839/instrument_cluster-1774702968026.jpeg not downloaded yet
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad0e050>
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5216%252F5025216%252Finstrument_cluster-1774788531641.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5216/5025216/instrument_cluster-1774788531641.jpg saved to cache
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1014eb9b-c103-5686-ac51-3846fe06778d
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8839%252F15848839%252Finterior_boot-1774702918030.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8839/15848839/interior_boot-1774702918030.jpeg not downloaded yet
2026-03-29 20:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_rear_driver-1774697700900.jpg> (referer: None)
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8839%252F15848839%252Fdocs_service_history-1774704011620.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D802fc385ee1fb1277c14efea0b519c0d%27 HTTP/1.1" 200 None
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8839/15848839/docs_service_history-1774704011620.jpeg?ixlib=js-3.8.0&auto=format&s=802fc385ee1fb1277c14efea0b519c0d not downloaded yet
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f893f390>
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5216%252F5025216%252Finterior_boot-1774788508990.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5216/5025216/interior_boot-1774788508990.jpg saved to cache
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1014eb9b-c103-5686-ac51-3846fe06778d
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8683050>
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9533%252F20329533%252Fexterior_rear_passenger-1774187978792.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_rear_passenger-1774187978792.jpg saved to cache
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab0870f9-cf68-55f5-9d85-de9bafaee685
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ac0b10>
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F13525953%252Fexterior_rear_driver-1774697700900.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_rear_driver-1774697700900.jpg saved to cache
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5
2026-03-29 20:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5216/5025216/interior_front_seats-1774788428746.jpg> (referer: None)
2026-03-29 20:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1441/20391441/interior_rear_seats-1774193810668.jpg> (referer: None)
2026-03-29 20:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3044789.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3403/19943403/interior_boot-1774352006888.jpg> (referer: None)
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8251350>
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5216%252F5025216%252Finterior_front_seats-1774788428746.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5216/5025216/interior_front_seats-1774788428746.jpg saved to cache
2026-03-29 20:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1014eb9b-c103-5686-ac51-3846fe06778d
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadeb810>
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1441%252F20391441%252Finterior_rear_seats-1774193810668.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1441/20391441/interior_rear_seats-1774193810668.jpg saved to cache
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d52d825d-0b86-51a3-bf94-dc369e652fdb
2026-03-29 20:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fba5003-b78d-5aed-a130-8ae607e44b6e with identifier: 3044789
2026-03-29 20:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fba5003-b78d-5aed-a130-8ae607e44b6e with scrape type 1
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4fba5003-b78d-5aed-a130-8ae607e44b6e
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4789%252F3044789%252Fexterior_front_driver-1774695276806.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_front_driver-1774695276806.jpeg not downloaded yet
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8452250>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3403%252F19943403%252Finterior_boot-1774352006888.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3403/19943403/interior_boot-1774352006888.jpg saved to cache
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024
2026-03-29 20:09:09 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (15719621) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8839/15848839/interior_front_seats-1774702935619.jpeg>.
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4789%252F3044789%252Fexterior_rear_driver-1774695363552.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_rear_driver-1774695363552.jpeg not downloaded yet
2026-03-29 20:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485034.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:09 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (18860781) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8839/15848839/interior_rear_seats-1774702869037.jpeg>.
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4789%252F3044789%252Fexterior_front_passenger-1774695303910.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_front_passenger-1774695303910.jpeg not downloaded yet
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4789%252F3044789%252Fexterior_rear_passenger-1774695342116.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_rear_passenger-1774695342116.jpeg not downloaded yet
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4789%252F3044789%252Finterior_front_seats-1774695484091.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4789/3044789/interior_front_seats-1774695484091.jpeg not downloaded yet
2026-03-29 20:09:09 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (14955878) larger than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/8839/15848839/interior_dashboard-1774702908221.jpeg>.
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4789%252F3044789%252Finterior_rear_seats-1774696030612.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4789/3044789/interior_rear_seats-1774696030612.jpeg not downloaded yet
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4789%252F3044789%252Finterior_dashboard-1774696069653.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4789/3044789/interior_dashboard-1774696069653.jpeg not downloaded yet
2026-03-29 20:09:09 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (17490684) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8839/15848839/interior_boot-1774702918030.jpeg>.
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4789%252F3044789%252Finstrument_cluster-1774695609397.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4789/3044789/instrument_cluster-1774695609397.jpeg not downloaded yet
2026-03-29 20:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 857c07fe-ad4d-547f-96be-c6e6f56c82a9 with identifier: 20485034
2026-03-29 20:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9 with scrape type 1
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5034%252F20485034%252Fexterior_front_driver-1774705257234.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5034/20485034/exterior_front_driver-1774705257234.jpg not downloaded yet
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4789%252F3044789%252Finterior_boot-1774695631512.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4789/3044789/interior_boot-1774695631512.jpeg not downloaded yet
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5034%252F20485034%252Fexterior_rear_driver-1774705452506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5034/20485034/exterior_rear_driver-1774705452506.jpg not downloaded yet
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4789%252F3044789%252F3044789-docs_service_history-modified-1650967246104.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db1e2d537a2a3183d232521f54f8ad255%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4789/3044789/3044789-docs_service_history-modified-1650967246104.jpeg?ixlib=js-3.8.0&auto=format&s=b1e2d537a2a3183d232521f54f8ad255 not downloaded yet
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5034%252F20485034%252Fexterior_front_passenger-1774702730571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5034/20485034/exterior_front_passenger-1774702730571.jpg not downloaded yet
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5034%252F20485034%252Fexterior_rear_passenger-1774702727733.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5034/20485034/exterior_rear_passenger-1774702727733.jpg not downloaded yet
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5034%252F20485034%252Finterior_front_seats-1774703497967.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5034/20485034/interior_front_seats-1774703497967.jpg not downloaded yet
2026-03-29 20:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8839/15848839/docs_service_history-1774704011620.jpeg?ixlib=js-3.8.0&auto=format&s=802fc385ee1fb1277c14efea0b519c0d> (referer: None)
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5034%252F20485034%252Finterior_rear_seats-1774703499676.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5034/20485034/interior_rear_seats-1774703499676.jpg not downloaded yet
2026-03-29 20:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3403/19943403/instrument_cluster-1774351768858.jpg> (referer: None)
2026-03-29 20:09:09 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12763328) larger than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/8839/15848839/instrument_cluster-1774702968026.jpeg>.
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5034%252F20485034%252Finterior_dashboard-1774705438430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5034/20485034/interior_dashboard-1774705438430.jpg not downloaded yet
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5034%252F20485034%252Finterior_boot-1774703496603.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5034/20485034/interior_boot-1774703496603.jpg not downloaded yet
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5034%252F20485034%252Fdocs_service_history-1774704292411.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5df58ae37ec6534bc99069836cefa158%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5034/20485034/docs_service_history-1774704292411.jpg?ixlib=js-3.8.0&auto=format&s=5df58ae37ec6534bc99069836cefa158 not downloaded yet
2026-03-29 20:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0249/19580249/damage_scratches-1774773037486.jpg> (referer: None)
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5034%252F20485034%252Fdocs_service_history-1774704443496.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd19977a0a1f0b51dc5c247414cc45385%27 HTTP/1.1" 200 None
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5034/20485034/docs_service_history-1774704443496.jpg?ixlib=js-3.8.0&auto=format&s=d19977a0a1f0b51dc5c247414cc45385 not downloaded yet
2026-03-29 20:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_rear_driver-1774695363552.jpeg> (referer: None)
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8828fd0>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8839%252F15848839%252Fdocs_service_history-1774704011620.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D802fc385ee1fb1277c14efea0b519c0d') HTTP/1.1" 204 0
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8839/15848839/docs_service_history-1774704011620.jpeg?ixlib=js-3.8.0&auto=format&s=802fc385ee1fb1277c14efea0b519c0d saved to cache
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 865718c0-1530-5c4f-954e-a0896ab6d099
2026-03-29 20:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_front_driver-1774702986750.jpeg> (referer: None)
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fe9ed0>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3403%252F19943403%252Finstrument_cluster-1774351768858.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3403/19943403/instrument_cluster-1774351768858.jpg saved to cache
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8700e52650>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0249%252F19580249%252Fdamage_scratches-1774773037486.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0249/19580249/damage_scratches-1774773037486.jpg saved to cache
2026-03-29 20:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 729d3255-71d9-5910-81db-06bd30acd761
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d80610>
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4789%252F3044789%252Fexterior_rear_driver-1774695363552.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_rear_driver-1774695363552.jpeg saved to cache
2026-03-29 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4fba5003-b78d-5aed-a130-8ae607e44b6e
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad80650>
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8839%252F15848839%252Fexterior_front_driver-1774702986750.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_front_driver-1774702986750.jpeg saved to cache
2026-03-29 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 865718c0-1530-5c4f-954e-a0896ab6d099
2026-03-29 20:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_rear_passenger-1774702414340.jpeg> (referer: None)
2026-03-29 20:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5034/20485034/docs_service_history-1774704292411.jpg?ixlib=js-3.8.0&auto=format&s=5df58ae37ec6534bc99069836cefa158> (referer: None)
2026-03-29 20:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0249/19580249/instrument_cluster-1774604382192.jpg> (referer: None)
2026-03-29 20:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_rear_driver-1774703019380.jpeg> (referer: None)
2026-03-29 20:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_front_passenger-1774703001636.jpeg> (referer: None)
2026-03-29 20:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0249/19580249/interior_boot-1774604352048.jpg> (referer: None)
2026-03-29 20:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5034/20485034/interior_front_seats-1774703497967.jpg> (referer: None)
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab9da50>
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8839%252F15848839%252Fexterior_rear_passenger-1774702414340.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_rear_passenger-1774702414340.jpeg saved to cache
2026-03-29 20:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 865718c0-1530-5c4f-954e-a0896ab6d099
2026-03-29 20:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5034/20485034/interior_rear_seats-1774703499676.jpg> (referer: None)
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85c4690>
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5034%252F20485034%252Fdocs_service_history-1774704292411.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5df58ae37ec6534bc99069836cefa158') HTTP/1.1" 204 0
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5034/20485034/docs_service_history-1774704292411.jpg?ixlib=js-3.8.0&auto=format&s=5df58ae37ec6534bc99069836cefa158 saved to cache
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa1ea10>
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0249%252F19580249%252Finstrument_cluster-1774604382192.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0249/19580249/instrument_cluster-1774604382192.jpg saved to cache
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 729d3255-71d9-5910-81db-06bd30acd761
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf174d0>
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8839%252F15848839%252Fexterior_rear_driver-1774703019380.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_rear_driver-1774703019380.jpeg saved to cache
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 865718c0-1530-5c4f-954e-a0896ab6d099
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8133550>
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8839%252F15848839%252Fexterior_front_passenger-1774703001636.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_front_passenger-1774703001636.jpeg saved to cache
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 865718c0-1530-5c4f-954e-a0896ab6d099
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf56190>
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0249%252F19580249%252Finterior_boot-1774604352048.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0249/19580249/interior_boot-1774604352048.jpg saved to cache
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 729d3255-71d9-5910-81db-06bd30acd761
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f20d50>
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5034%252F20485034%252Finterior_front_seats-1774703497967.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5034/20485034/interior_front_seats-1774703497967.jpg saved to cache
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9
2026-03-29 20:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3403/19943403/docs_service_history-1774625425788.jpg?ixlib=js-3.8.0&auto=format&s=7d65587e1da7fea8638faf8cf51106ef> (referer: None)
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebeb8190>
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5034%252F20485034%252Finterior_rear_seats-1774703499676.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5034/20485034/interior_rear_seats-1774703499676.jpg saved to cache
2026-03-29 20:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f892d5d0>
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3403%252F19943403%252Fdocs_service_history-1774625425788.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7d65587e1da7fea8638faf8cf51106ef') HTTP/1.1" 204 0
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3403/19943403/docs_service_history-1774625425788.jpg?ixlib=js-3.8.0&auto=format&s=7d65587e1da7fea8638faf8cf51106ef saved to cache
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024
2026-03-29 20:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5034/20485034/docs_service_history-1774704443496.jpg?ixlib=js-3.8.0&auto=format&s=d19977a0a1f0b51dc5c247414cc45385> (referer: None)
2026-03-29 20:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5034/20485034/exterior_rear_passenger-1774702727733.jpg> (referer: None)
2026-03-29 20:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5034/20485034/interior_boot-1774703496603.jpg> (referer: None)
2026-03-29 20:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5034/20485034/interior_dashboard-1774705438430.jpg> (referer: None)
2026-03-29 20:09:12 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8839/15848839/interior_front_seats-1774702935619.jpeg>.
2026-03-29 20:09:12 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8839/15848839/interior_rear_seats-1774702869037.jpeg>.
2026-03-29 20:09:12 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/8839/15848839/interior_dashboard-1774702908221.jpeg>.
2026-03-29 20:09:12 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/8839/15848839/interior_boot-1774702918030.jpeg>.
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f851ffd0>
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5034%252F20485034%252Fdocs_service_history-1774704443496.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd19977a0a1f0b51dc5c247414cc45385') HTTP/1.1" 204 0
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5034/20485034/docs_service_history-1774704443496.jpg?ixlib=js-3.8.0&auto=format&s=d19977a0a1f0b51dc5c247414cc45385 saved to cache
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae67a10>
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5034%252F20485034%252Fexterior_rear_passenger-1774702727733.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5034/20485034/exterior_rear_passenger-1774702727733.jpg saved to cache
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e49910>
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5034%252F20485034%252Finterior_boot-1774703496603.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5034/20485034/interior_boot-1774703496603.jpg saved to cache
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f892d910>
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5034%252F20485034%252Finterior_dashboard-1774705438430.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5034/20485034/interior_dashboard-1774705438430.jpg saved to cache
2026-03-29 20:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9
2026-03-29 20:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4789/3044789/3044789-docs_service_history-modified-1650967246104.jpeg?ixlib=js-3.8.0&auto=format&s=b1e2d537a2a3183d232521f54f8ad255> (referer: None)
2026-03-29 20:09:12 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos-redacted.imgix.net/8839/15848839/instrument_cluster-1774702968026.jpeg>.
2026-03-29 20:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_rear_passenger-1774695342116.jpeg> (referer: None)
2026-03-29 20:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5034/20485034/exterior_front_passenger-1774702730571.jpg> (referer: None)
2026-03-29 20:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4789/3044789/instrument_cluster-1774695609397.jpeg> (referer: None)
2026-03-29 20:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4789/3044789/interior_dashboard-1774696069653.jpeg> (referer: None)
2026-03-29 20:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8839/15848839/instrument_cluster-1774702968026.jpeg> (referer: None)
2026-03-29 20:09:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8bfde50>
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4789%252F3044789%252F3044789-docs_service_history-modified-1650967246104.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db1e2d537a2a3183d232521f54f8ad255') HTTP/1.1" 204 0
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4789/3044789/3044789-docs_service_history-modified-1650967246104.jpeg?ixlib=js-3.8.0&auto=format&s=b1e2d537a2a3183d232521f54f8ad255 saved to cache
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4fba5003-b78d-5aed-a130-8ae607e44b6e
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010f0290>
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4789%252F3044789%252Fexterior_rear_passenger-1774695342116.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_rear_passenger-1774695342116.jpeg saved to cache
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4fba5003-b78d-5aed-a130-8ae607e44b6e
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae1a410>
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5034%252F20485034%252Fexterior_front_passenger-1774702730571.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5034/20485034/exterior_front_passenger-1774702730571.jpg saved to cache
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5034/20485034/exterior_rear_driver-1774705452506.jpg> (referer: None)
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4789/3044789/interior_boot-1774695631512.jpeg> (referer: None)
2026-03-29 20:09:13 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:13 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:13 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00&\x83\x97\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xe3f\x00&y\xa5\x00\x00\x00\x00'
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cce350>
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4789%252F3044789%252Finstrument_cluster-1774695609397.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4789/3044789/instrument_cluster-1774695609397.jpeg saved to cache
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4fba5003-b78d-5aed-a130-8ae607e44b6e
2026-03-29 20:09:13 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:13 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:13 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003\xd8\xe9\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xfb\xb0\x003\xce\xf7\x00\x00\x00\x00'
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebeb8090>
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4789%252F3044789%252Finterior_dashboard-1774696069653.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4789/3044789/interior_dashboard-1774696069653.jpeg saved to cache
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4fba5003-b78d-5aed-a130-8ae607e44b6e
2026-03-29 20:09:13 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:13 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:13 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xbb\xc5\xd3\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06\xfa\xed\x00\xbb\xbb\xcf\x00\x00\x00\x00'
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa124c90>
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8839%252F15848839%252Finstrument_cluster-1774702968026.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8839/15848839/instrument_cluster-1774702968026.jpeg saved to cache
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 865718c0-1530-5c4f-954e-a0896ab6d099
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ccea50>
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5034%252F20485034%252Fexterior_rear_driver-1774705452506.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5034/20485034/exterior_rear_driver-1774705452506.jpg saved to cache
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9
2026-03-29 20:09:13 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:13 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:13 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00-\xd4\x04\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02}>\x00-\xca\x12\x00\x00\x00\x00'
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88b5350>
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4789%252F3044789%252Finterior_boot-1774695631512.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4789/3044789/interior_boot-1774695631512.jpeg saved to cache
2026-03-29 20:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4fba5003-b78d-5aed-a130-8ae607e44b6e
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4789/3044789/interior_front_seats-1774695484091.jpeg> (referer: None)
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5034/20485034/exterior_front_driver-1774705257234.jpg> (referer: None)
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4789/3044789/interior_rear_seats-1774696030612.jpeg> (referer: None)
2026-03-29 20:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8839/15848839/interior_dashboard-1774702908221.jpeg> (referer: None)
2026-03-29 20:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8839/15848839/interior_front_seats-1774702935619.jpeg> (referer: None)
2026-03-29 20:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_front_passenger-1774695303910.jpeg> (referer: None)
2026-03-29 20:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_front_driver-1774695276806.jpeg> (referer: None)
2026-03-29 20:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3403/19943403/interior_dashboard-1774352001117.jpg> (referer: None)
2026-03-29 20:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8839/15848839/interior_boot-1774702918030.jpeg> (referer: None)
2026-03-29 20:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8839/15848839/interior_rear_seats-1774702869037.jpeg> (referer: None)
2026-03-29 20:09:14 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:14 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:14 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003\x0c\xb1\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x82\xc7\x003\x02\xbf\x00\x00\x00\x00'
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f854e150>
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4789%252F3044789%252Finterior_front_seats-1774695484091.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4789/3044789/interior_front_seats-1774695484091.jpeg saved to cache
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4fba5003-b78d-5aed-a130-8ae607e44b6e
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe447d0>
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5034%252F20485034%252Fexterior_front_driver-1774705257234.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5034/20485034/exterior_front_driver-1774705257234.jpg saved to cache
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9
2026-03-29 20:09:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 857c07fe-ad4d-547f-96be-c6e6f56c82a9, skipping ID generation
2026-03-29 20:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9 with scrape type 1
2026-03-29 20:09:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 857c07fe-ad4d-547f-96be-c6e6f56c82a9 sending to next pipeline
2026-03-29 20:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 857c07fe-ad4d-547f-96be-c6e6f56c82a9, identifier: 20485034
2026-03-29 20:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 857c07fe-ad4d-547f-96be-c6e6f56c82a9 with identifier: 20485034
2026-03-29 20:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 857c07fe-ad4d-547f-96be-c6e6f56c82a9 with identifier: 20485034
2026-03-29 20:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 857c07fe-ad4d-547f-96be-c6e6f56c82a9 with identifier: 20485034 to the API
2026-03-29 20:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/5034/20485034/exterior_front_driver-1774705257234.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '857c07fe-ad4d-547f-96be-c6e6f56c82a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BF18 DHZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20485034',
'listing': 'auction',
'location': 'Lancashire Nelson',
'make': 'Vauxhall',
'model': 'Insignia',
'odometer': 28550,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3625287,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5034/20485034/exterior_front_driver-1774705257234.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2273658,
'Height': 2759,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5034/20485034/exterior_rear_driver-1774705452506.jpg',
'Width': 3679},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1970136,
'Height': 2859,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5034/20485034/exterior_front_passenger-1774702730571.jpg',
'Width': 3812},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1207635,
'Height': 2343,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5034/20485034/exterior_rear_passenger-1774702727733.jpg',
'Width': 3124},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2884938,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5034/20485034/interior_front_seats-1774703497967.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3081954,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5034/20485034/interior_rear_seats-1774703499676.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2545418,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5034/20485034/interior_dashboard-1774705438430.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2210101,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5034/20485034/interior_boot-1774703496603.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1156546,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5034/20485034/docs_service_history-1774704292411.jpg?ixlib=js-3.8.0&auto=format&s=5df58ae37ec6534bc99069836cefa158',
'Width': 2880},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_857c07fe-ad4d-547f-96be-c6e6f56c82a9/857c07fe-ad4d-547f-96be-c6e6f56c82a9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1243034,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5034/20485034/docs_service_history-1774704443496.jpg?ixlib=js-3.8.0&auto=format&s=d19977a0a1f0b51dc5c247414cc45385',
'Width': 2880}],
'price': 10586,
'price_includes_vat': False,
'registration_date': '2018-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Insignia SRI VX-LINE NAV Turbo',
'transmission': 'manual',
'trim': 'SRI VX-LINE NAV Turbo',
'vin': 'W0VZS8EB2J1169061',
'year': 2018}
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485034%27 HTTP/1.1" 200 None
2026-03-29 20:09:15 [motorway.uk] INFO: Saving data for 20485034: {'created_time': 1774814955.192762, 'last_price_update_time': 1774814955.192773, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20485034') HTTP/1.1" 204 0
2026-03-29 20:09:15 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:15 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:15 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x006\xb7\xa0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\n\x1f\x006\xad\xae\x00\x00\x00\x00'
2026-03-29 20:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf143d0>
2026-03-29 20:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4789%252F3044789%252Finterior_rear_seats-1774696030612.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4789/3044789/interior_rear_seats-1774696030612.jpeg saved to cache
2026-03-29 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4fba5003-b78d-5aed-a130-8ae607e44b6e
2026-03-29 20:09:15 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:15 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:15 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xda-\x08\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\n\x08^\x00\xda#\x04\x00\x00\x00\x00'
2026-03-29 20:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9369510>
2026-03-29 20:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8839%252F15848839%252Finterior_dashboard-1774702908221.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8839/15848839/interior_dashboard-1774702908221.jpeg saved to cache
2026-03-29 20:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 865718c0-1530-5c4f-954e-a0896ab6d099
2026-03-29 20:09:15 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:15 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:15 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xe6\xf5\xf4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xe6\xd1\x00\xe6\xeb\xf0\x00\x00\x00\x00'
2026-03-29 20:09:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9368e10>
2026-03-29 20:09:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8839%252F15848839%252Finterior_front_seats-1774702935619.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8839/15848839/interior_front_seats-1774702935619.jpeg saved to cache
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 865718c0-1530-5c4f-954e-a0896ab6d099
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f947a950>
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4789%252F3044789%252Fexterior_front_passenger-1774695303910.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_front_passenger-1774695303910.jpeg saved to cache
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4fba5003-b78d-5aed-a130-8ae607e44b6e
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9368690>
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4789%252F3044789%252Fexterior_front_driver-1774695276806.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_front_driver-1774695276806.jpeg saved to cache
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fba5003-b78d-5aed-a130-8ae607e44b6e
2026-03-29 20:09:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fba5003-b78d-5aed-a130-8ae607e44b6e, skipping ID generation
2026-03-29 20:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fba5003-b78d-5aed-a130-8ae607e44b6e with scrape type 1
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fba5003-b78d-5aed-a130-8ae607e44b6e sending to next pipeline
2026-03-29 20:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4fba5003-b78d-5aed-a130-8ae607e44b6e, identifier: 3044789
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa6ee50>
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3403%252F19943403%252Finterior_dashboard-1774352001117.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3403/19943403/interior_dashboard-1774352001117.jpg saved to cache
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024
2026-03-29 20:09:16 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:16 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:16 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x01\x02]\xde\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\x85\x1e\x01\x02S\xda\x00\x00\x00\x00'
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9297ad0>
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8839%252F15848839%252Finterior_boot-1774702918030.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8839/15848839/interior_boot-1774702918030.jpeg saved to cache
2026-03-29 20:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 865718c0-1530-5c4f-954e-a0896ab6d099
2026-03-29 20:09:16 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:16 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:16 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x01\x17U\xa1\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08uL\x01\x17K\x9d\x00\x00\x00\x00'
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f84c8f50>
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8839%252F15848839%252Finterior_rear_seats-1774702869037.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8839/15848839/interior_rear_seats-1774702869037.jpeg saved to cache
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 865718c0-1530-5c4f-954e-a0896ab6d099
2026-03-29 20:09:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 865718c0-1530-5c4f-954e-a0896ab6d099, skipping ID generation
2026-03-29 20:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 865718c0-1530-5c4f-954e-a0896ab6d099 with scrape type 1
2026-03-29 20:09:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 865718c0-1530-5c4f-954e-a0896ab6d099 sending to next pipeline
2026-03-29 20:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 865718c0-1530-5c4f-954e-a0896ab6d099, identifier: 15848839
2026-03-29 20:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4fba5003-b78d-5aed-a130-8ae607e44b6e with identifier: 3044789
2026-03-29 20:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4fba5003-b78d-5aed-a130-8ae607e44b6e with identifier: 3044789
2026-03-29 20:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4fba5003-b78d-5aed-a130-8ae607e44b6e with identifier: 3044789 to the API
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_front_driver-1774695276806.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '4fba5003-b78d-5aed-a130-8ae607e44b6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YA16 YDD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3044789',
'listing': 'auction',
'location': 'West Yorkshire Leeds',
'make': 'Fiat',
'model': '500',
'odometer': 24547,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1521604,
'Height': 2546,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_front_driver-1774695276806.jpeg',
'Width': 3394},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1426447,
'Height': 2525,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_rear_driver-1774695363552.jpeg',
'Width': 3366},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1827844,
'Height': 2656,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_front_passenger-1774695303910.jpeg',
'Width': 3541},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1593180,
'Height': 2539,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4789/3044789/exterior_rear_passenger-1774695342116.jpeg',
'Width': 3385},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3510136,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4789/3044789/interior_front_seats-1774695484091.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3719615,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4789/3044789/interior_rear_seats-1774696030612.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3593369,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4789/3044789/interior_dashboard-1774696069653.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2647805,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4789/3044789/instrument_cluster-1774695609397.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3166530,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4789/3044789/interior_boot-1774695631512.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fba5003-b78d-5aed-a130-8ae607e44b6e/4fba5003-b78d-5aed-a130-8ae607e44b6e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620381,
'Height': 1572,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4789/3044789/3044789-docs_service_history-modified-1650967246104.jpeg?ixlib=js-3.8.0&auto=format&s=b1e2d537a2a3183d232521f54f8ad255',
'Width': 2096}],
'price': 5211,
'price_includes_vat': False,
'registration_date': '2016-05-31',
'seats_number': None,
'seller_name': None,
'title': 'Fiat 500 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'vin': 'ZFA3120000J512319',
'year': 2016}
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273044789%27 HTTP/1.1" 200 None
2026-03-29 20:09:17 [motorway.uk] INFO: Saving data for 3044789: {'created_time': 1774814957.866959, 'last_price_update_time': 1774814957.86697, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3044789') HTTP/1.1" 204 0
2026-03-29 20:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 865718c0-1530-5c4f-954e-a0896ab6d099 with identifier: 15848839
2026-03-29 20:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 865718c0-1530-5c4f-954e-a0896ab6d099 with identifier: 15848839
2026-03-29 20:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 865718c0-1530-5c4f-954e-a0896ab6d099 with identifier: 15848839 to the API
2026-03-29 20:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8839/15848839/interior_rear_seats-1774702869037.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '865718c0-1530-5c4f-954e-a0896ab6d099',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'Y444 DPM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15848839',
'listing': 'auction',
'location': 'West Yorkshire Barnsley',
'make': 'Vauxhall',
'model': 'Corsa',
'odometer': 53333,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3004256,
'Height': 4390,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_front_driver-1774702986750.jpeg',
'Width': 5853},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4518062,
'Height': 5490,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_rear_driver-1774703019380.jpeg',
'Width': 7320},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4829645,
'Height': 5164,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_front_passenger-1774703001636.jpeg',
'Width': 6885},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3342854,
'Height': 4940,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8839/15848839/exterior_rear_passenger-1774702414340.jpeg',
'Width': 6587},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 15719621,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8839/15848839/interior_front_seats-1774702935619.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 18860781,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8839/15848839/interior_rear_seats-1774702869037.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 14955878,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8839/15848839/interior_dashboard-1774702908221.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 12763328,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8839/15848839/instrument_cluster-1774702968026.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 17490684,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/8839/15848839/interior_boot-1774702918030.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_865718c0-1530-5c4f-954e-a0896ab6d099/865718c0-1530-5c4f-954e-a0896ab6d099_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1518608,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8839/15848839/docs_service_history-1774704011620.jpeg?ixlib=js-3.8.0&auto=format&s=802fc385ee1fb1277c14efea0b519c0d',
'Width': 4032}],
'price': 4329,
'price_includes_vat': False,
'registration_date': '2016-03-18',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Corsa Limited Edition S/S',
'transmission': 'manual',
'trim': 'Limited Edition S/S',
'vin': 'W0L0XEP08F6092497',
'year': 2016}
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715848839%27 HTTP/1.1" 200 None
2026-03-29 20:09:18 [motorway.uk] INFO: Saving data for 15848839: {'created_time': 1774814958.859877, 'last_price_update_time': 1774814958.859889, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15848839') HTTP/1.1" 204 0
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3403/19943403/interior_rear_seats-1774351993063.jpg> (referer: None)
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3403/19943403/interior_front_seats-1774352156001.jpg> (referer: None)
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1680/16571680/docs_service_history-1774706822420.jpg?ixlib=js-3.8.0&auto=format&s=e313df7084349f2898daadb3f8708e9f> (referer: None)
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3403/19943403/exterior_front_passenger-1774625889915.jpg> (referer: None)
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85c4d10>
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3403%252F19943403%252Finterior_rear_seats-1774351993063.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3403/19943403/interior_rear_seats-1774351993063.jpg saved to cache
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3403/19943403/exterior_rear_passenger-1774189326583.jpg> (referer: None)
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5953/13525953/docs_service_history-1774699380252.jpg?ixlib=js-3.8.0&auto=format&s=10863bff2823f1391dcf1619b9c6acbf> (referer: None)
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8dd1910>
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3403%252F19943403%252Finterior_front_seats-1774352156001.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3403/19943403/interior_front_seats-1774352156001.jpg saved to cache
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024
2026-03-29 20:09:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa113910>
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1680%252F16571680%252Fdocs_service_history-1774706822420.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De313df7084349f2898daadb3f8708e9f') HTTP/1.1" 204 0
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1680/16571680/docs_service_history-1774706822420.jpg?ixlib=js-3.8.0&auto=format&s=e313df7084349f2898daadb3f8708e9f saved to cache
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f91844d0>
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3403%252F19943403%252Fexterior_front_passenger-1774625889915.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3403/19943403/exterior_front_passenger-1774625889915.jpg saved to cache
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9184b50>
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3403%252F19943403%252Fexterior_rear_passenger-1774189326583.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3403/19943403/exterior_rear_passenger-1774189326583.jpg saved to cache
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8dc0350>
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5953%252F13525953%252Fdocs_service_history-1774699380252.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D10863bff2823f1391dcf1619b9c6acbf') HTTP/1.1" 204 0
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5953/13525953/docs_service_history-1774699380252.jpg?ixlib=js-3.8.0&auto=format&s=10863bff2823f1391dcf1619b9c6acbf saved to cache
2026-03-29 20:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_rear_passenger-1774603990682.jpg> (referer: None)
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_front_passenger-1774604001174.jpg> (referer: None)
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1680/16571680/instrument_cluster-1774704027666.jpg> (referer: None)
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1680/16571680/interior_dashboard-1774703994752.jpg> (referer: None)
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0249/19580249/interior_dashboard-1774604311171.jpg> (referer: None)
2026-03-29 20:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5953/13525953/instrument_cluster-1774698165277.jpg> (referer: None)
2026-03-29 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0249/19580249/interior_rear_seats-1774604283352.jpg> (referer: None)
2026-03-29 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5953/13525953/interior_dashboard-1774698166764.jpg> (referer: None)
2026-03-29 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5953/13525953/interior_rear_seats-1774698062199.jpg> (referer: None)
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9247490>
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0249%252F19580249%252Fexterior_rear_passenger-1774603990682.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_rear_passenger-1774603990682.jpg saved to cache
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 729d3255-71d9-5910-81db-06bd30acd761
2026-03-29 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1680/16571680/interior_rear_seats-1774703945120.jpg> (referer: None)
2026-03-29 20:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0249/19580249/interior_front_seats-1774604722282.jpg> (referer: None)
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9186d90>
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0249%252F19580249%252Fexterior_front_passenger-1774604001174.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_front_passenger-1774604001174.jpg saved to cache
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 729d3255-71d9-5910-81db-06bd30acd761
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9febb90>
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1680%252F16571680%252Finstrument_cluster-1774704027666.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1680/16571680/instrument_cluster-1774704027666.jpg saved to cache
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88b48d0>
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1680%252F16571680%252Finterior_dashboard-1774703994752.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1680/16571680/interior_dashboard-1774703994752.jpg saved to cache
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe47f10>
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0249%252F19580249%252Finterior_dashboard-1774604311171.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0249/19580249/interior_dashboard-1774604311171.jpg saved to cache
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 729d3255-71d9-5910-81db-06bd30acd761
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9254f90>
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F13525953%252Finstrument_cluster-1774698165277.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/13525953/instrument_cluster-1774698165277.jpg saved to cache
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f930a010>
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0249%252F19580249%252Finterior_rear_seats-1774604283352.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0249/19580249/interior_rear_seats-1774604283352.jpg saved to cache
2026-03-29 20:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 729d3255-71d9-5910-81db-06bd30acd761
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9186410>
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F13525953%252Finterior_dashboard-1774698166764.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/13525953/interior_dashboard-1774698166764.jpg saved to cache
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f871bed0>
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5953%252F13525953%252Finterior_rear_seats-1774698062199.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5953/13525953/interior_rear_seats-1774698062199.jpg saved to cache
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5
2026-03-29 20:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5953/13525953/interior_boot-1774698111430.jpg> (referer: None)
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebffdb10>
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1680%252F16571680%252Finterior_rear_seats-1774703945120.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1680/16571680/interior_rear_seats-1774703945120.jpg saved to cache
2026-03-29 20:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa006750>
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0249%252F19580249%252Finterior_front_seats-1774604722282.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0249/19580249/interior_front_seats-1774604722282.jpg saved to cache
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 729d3255-71d9-5910-81db-06bd30acd761
2026-03-29 20:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f81ecb10>
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5953%252F13525953%252Finterior_boot-1774698111430.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5953/13525953/interior_boot-1774698111430.jpg saved to cache
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5
2026-03-29 20:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1680/16571680/interior_boot-1774703996488.jpg> (referer: None)
2026-03-29 20:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3403/19943403/exterior_front_driver-1774189275498.jpg> (referer: None)
2026-03-29 20:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3403/19943403/exterior_rear_driver-1774189307592.jpg> (referer: None)
2026-03-29 20:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_rear_driver-1774603977242.jpg> (referer: None)
2026-03-29 20:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1680/16571680/interior_front_seats-1774703919509.jpg> (referer: None)
2026-03-29 20:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5953/13525953/interior_front_seats-1774698050819.jpg> (referer: None)
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a80350>
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1680%252F16571680%252Finterior_boot-1774703996488.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1680/16571680/interior_boot-1774703996488.jpg saved to cache
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a6da90>
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3403%252F19943403%252Fexterior_front_driver-1774189275498.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3403/19943403/exterior_front_driver-1774189275498.jpg saved to cache
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1b8b10>
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3403%252F19943403%252Fexterior_rear_driver-1774189307592.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3403/19943403/exterior_rear_driver-1774189307592.jpg saved to cache
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024
2026-03-29 20:09:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024, skipping ID generation
2026-03-29 20:09:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024 with scrape type 1
2026-03-29 20:09:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024 sending to next pipeline
2026-03-29 20:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024, identifier: 19943403
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cc8f50>
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0249%252F19580249%252Fexterior_rear_driver-1774603977242.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_rear_driver-1774603977242.jpg saved to cache
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 729d3255-71d9-5910-81db-06bd30acd761
2026-03-29 20:09:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f924e310>
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1680%252F16571680%252Finterior_front_seats-1774703919509.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1680/16571680/interior_front_seats-1774703919509.jpg saved to cache
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1
2026-03-29 20:09:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f871b8d0>
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5953%252F13525953%252Finterior_front_seats-1774698050819.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5953/13525953/interior_front_seats-1774698050819.jpg saved to cache
2026-03-29 20:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5
2026-03-29 20:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024 with identifier: 19943403
2026-03-29 20:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024 with identifier: 19943403
2026-03-29 20:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7f6e40d5-ebb8-55cb-8d71-7fa5318f8024 with identifier: 19943403 to the API
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3403/19943403/exterior_rear_driver-1774189307592.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '7f6e40d5-ebb8-55cb-8d71-7fa5318f8024',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP13 OYD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19943403',
'listing': 'auction',
'location': 'North Down Bangor',
'make': 'BMW',
'model': '6 Series',
'odometer': 52000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1578096,
'Height': 2594,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3403/19943403/exterior_front_driver-1774189275498.jpg',
'Width': 3459},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1695789,
'Height': 2728,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3403/19943403/exterior_rear_driver-1774189307592.jpg',
'Width': 3637},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2560556,
'Height': 2585,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3403/19943403/exterior_front_passenger-1774625889915.jpg',
'Width': 3447},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1672882,
'Height': 2462,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3403/19943403/exterior_rear_passenger-1774189326583.jpg',
'Width': 3283},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 965434,
'Height': 1667,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3403/19943403/interior_front_seats-1774352156001.jpg',
'Width': 2223},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1849433,
'Height': 2148,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3403/19943403/interior_rear_seats-1774351993063.jpg',
'Width': 2864},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1765274,
'Height': 2627,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3403/19943403/interior_dashboard-1774352001117.jpg',
'Width': 3502},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639175,
'Height': 1670,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3403/19943403/instrument_cluster-1774351768858.jpg',
'Width': 2227},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489230,
'Height': 1702,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3403/19943403/interior_boot-1774352006888.jpg',
'Width': 2269},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f6e40d5-ebb8-55cb-8d71-7fa5318f8024/7f6e40d5-ebb8-55cb-8d71-7fa5318f8024_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5961423,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3403/19943403/docs_service_history-1774625425788.jpg?ixlib=js-3.8.0&auto=format&s=7d65587e1da7fea8638faf8cf51106ef',
'Width': 4032}],
'price': 14000,
'price_includes_vat': False,
'registration_date': '2016-08-24',
'seats_number': None,
'seller_name': None,
'title': 'BMW 640D M Sport Auto',
'transmission': 'automatic',
'trim': '640D M Sport Auto',
'vin': 'WBA6J120X0G240641',
'year': 2016}
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719943403%27 HTTP/1.1" 200 None
2026-03-29 20:09:23 [motorway.uk] INFO: Saving data for 19943403: {'created_time': 1774814963.770821, 'last_price_update_time': 1774814963.770831, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19943403') HTTP/1.1" 204 0
2026-03-29 20:09:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_rear_passenger-1774702723760.jpg> (referer: None)
2026-03-29 20:09:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_front_driver-1774702701597.jpg> (referer: None)
2026-03-29 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_front_passenger-1774697732410.jpg> (referer: None)
2026-03-29 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_front_passenger-1774702736867.jpg> (referer: None)
2026-03-29 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_front_driver-1774697713128.jpg> (referer: None)
2026-03-29 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_front_driver-1774603963389.jpg> (referer: None)
2026-03-29 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_rear_passenger-1774697719765.jpg> (referer: None)
2026-03-29 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9533/20329533/docs_service_history-1774188596502.jpg?ixlib=js-3.8.0&auto=format&s=406d56770426bb9e484da81d2613d0a5> (referer: None)
2026-03-29 20:09:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9533/20329533/interior_boot-1774188372259.jpg> (referer: None)
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f854e950>
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1680%252F16571680%252Fexterior_rear_passenger-1774702723760.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_rear_passenger-1774702723760.jpg saved to cache
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94c8c10>
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1680%252F16571680%252Fexterior_front_driver-1774702701597.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_front_driver-1774702701597.jpg saved to cache
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac90dd0>
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F13525953%252Fexterior_front_passenger-1774697732410.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_front_passenger-1774697732410.jpg saved to cache
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94ca610>
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1680%252F16571680%252Fexterior_front_passenger-1774702736867.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_front_passenger-1774702736867.jpg saved to cache
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1
2026-03-29 20:09:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72d4a6a6-656e-5ede-802c-ae3ec726e5b1, skipping ID generation
2026-03-29 20:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1 with scrape type 1
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72d4a6a6-656e-5ede-802c-ae3ec726e5b1 sending to next pipeline
2026-03-29 20:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 72d4a6a6-656e-5ede-802c-ae3ec726e5b1, identifier: 16571680
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f892e110>
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F13525953%252Fexterior_front_driver-1774697713128.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_front_driver-1774697713128.jpg saved to cache
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9187110>
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0249%252F19580249%252Fexterior_front_driver-1774603963389.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_front_driver-1774603963389.jpg saved to cache
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 729d3255-71d9-5910-81db-06bd30acd761
2026-03-29 20:09:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 729d3255-71d9-5910-81db-06bd30acd761, skipping ID generation
2026-03-29 20:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 729d3255-71d9-5910-81db-06bd30acd761 with scrape type 1
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 729d3255-71d9-5910-81db-06bd30acd761 sending to next pipeline
2026-03-29 20:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 729d3255-71d9-5910-81db-06bd30acd761, identifier: 19580249
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f96283d0>
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5953%252F13525953%252Fexterior_rear_passenger-1774697719765.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_rear_passenger-1774697719765.jpg saved to cache
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5
2026-03-29 20:09:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5, skipping ID generation
2026-03-29 20:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5 with scrape type 1
2026-03-29 20:09:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5 sending to next pipeline
2026-03-29 20:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5, identifier: 13525953
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9184250>
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9533%252F20329533%252Fdocs_service_history-1774188596502.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D406d56770426bb9e484da81d2613d0a5') HTTP/1.1" 204 0
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9533/20329533/docs_service_history-1774188596502.jpg?ixlib=js-3.8.0&auto=format&s=406d56770426bb9e484da81d2613d0a5 saved to cache
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab0870f9-cf68-55f5-9d85-de9bafaee685
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9185f50>
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9533%252F20329533%252Finterior_boot-1774188372259.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9533/20329533/interior_boot-1774188372259.jpg saved to cache
2026-03-29 20:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab0870f9-cf68-55f5-9d85-de9bafaee685
2026-03-29 20:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 72d4a6a6-656e-5ede-802c-ae3ec726e5b1 with identifier: 16571680
2026-03-29 20:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 72d4a6a6-656e-5ede-802c-ae3ec726e5b1 with identifier: 16571680
2026-03-29 20:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 72d4a6a6-656e-5ede-802c-ae3ec726e5b1 with identifier: 16571680 to the API
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_front_passenger-1774702736867.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '72d4a6a6-656e-5ede-802c-ae3ec726e5b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MJ21 JSX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16571680',
'listing': 'auction',
'location': 'Merseyside Birkenhead',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 31050,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1449169,
'Height': 2327,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_front_driver-1774702701597.jpg',
'Width': 3103},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1190415,
'Height': 2151,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_rear_driver-1774702716084.jpg',
'Width': 2868},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1468736,
'Height': 2438,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_front_passenger-1774702736867.jpg',
'Width': 3251},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1255314,
'Height': 2282,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1680/16571680/exterior_rear_passenger-1774702723760.jpg',
'Width': 3042},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2754856,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1680/16571680/interior_front_seats-1774703919509.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3446929,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1680/16571680/interior_rear_seats-1774703945120.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1629164,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1680/16571680/interior_dashboard-1774703994752.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2389977,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1680/16571680/instrument_cluster-1774704027666.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4302700,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1680/16571680/interior_boot-1774703996488.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72d4a6a6-656e-5ede-802c-ae3ec726e5b1/72d4a6a6-656e-5ede-802c-ae3ec726e5b1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98473,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1680/16571680/docs_service_history-1774706822420.jpg?ixlib=js-3.8.0&auto=format&s=e313df7084349f2898daadb3f8708e9f',
'Width': 596}],
'price': 10166,
'price_includes_vat': False,
'registration_date': '2021-03-26',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta ST-LINE Edition T MHEV',
'transmission': 'manual',
'trim': 'ST-LINE Edition T MHEV',
'vin': 'WF0JXXGAHJLS89233',
'year': 2021}
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716571680%27 HTTP/1.1" 200 None
2026-03-29 20:09:25 [motorway.uk] INFO: Saving data for 16571680: {'created_time': 1774814965.670533, 'last_price_update_time': 1774814965.670543, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16571680') HTTP/1.1" 204 0
2026-03-29 20:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 729d3255-71d9-5910-81db-06bd30acd761 with identifier: 19580249
2026-03-29 20:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 729d3255-71d9-5910-81db-06bd30acd761 with identifier: 19580249
2026-03-29 20:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 729d3255-71d9-5910-81db-06bd30acd761 with identifier: 19580249 to the API
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_front_driver-1774603963389.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '729d3255-71d9-5910-81db-06bd30acd761',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY66 HYX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19580249',
'listing': 'auction',
'location': 'None None',
'make': 'Nissan',
'model': 'Juke',
'odometer': 37785,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2295095,
'Height': 2923,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_front_driver-1774603963389.jpg',
'Width': 3897},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1954885,
'Height': 2664,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_rear_driver-1774603977242.jpg',
'Width': 3552},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1261602,
'Height': 2393,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_front_passenger-1774604001174.jpg',
'Width': 3190},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1271002,
'Height': 2246,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0249/19580249/exterior_rear_passenger-1774603990682.jpg',
'Width': 2994},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3804605,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0249/19580249/interior_front_seats-1774604722282.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3285763,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0249/19580249/interior_rear_seats-1774604283352.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2477903,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0249/19580249/interior_dashboard-1774604311171.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2804332,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0249/19580249/instrument_cluster-1774604382192.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3838436,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0249/19580249/interior_boot-1774604352048.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_729d3255-71d9-5910-81db-06bd30acd761/729d3255-71d9-5910-81db-06bd30acd761_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2028933,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0249/19580249/damage_scratches-1774773037486.jpg',
'Width': 4032}],
'price': 5522,
'price_includes_vat': False,
'registration_date': '2016-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke Tekna DiG-T',
'transmission': 'manual',
'trim': 'Tekna DiG-T',
'vin': 'SJNFEAF15U7277974',
'year': 2016}
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719580249%27 HTTP/1.1" 200 None
2026-03-29 20:09:26 [motorway.uk] INFO: Saving data for 19580249: {'created_time': 1774814966.091679, 'last_price_update_time': 1774814966.091689, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19580249') HTTP/1.1" 204 0
2026-03-29 20:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5 with identifier: 13525953
2026-03-29 20:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5 with identifier: 13525953
2026-03-29 20:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5 with identifier: 13525953 to the API
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_rear_passenger-1774697719765.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AJ18 YLC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13525953',
'listing': 'auction',
'location': 'Plymouth Plymouth',
'make': 'Mercedes',
'model': 'CLA Class',
'odometer': 66408,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2063861,
'Height': 2700,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_front_driver-1774697713128.jpg',
'Width': 3600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1376468,
'Height': 2034,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_rear_driver-1774697700900.jpg',
'Width': 2712},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1432901,
'Height': 2017,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_front_passenger-1774697732410.jpg',
'Width': 2689},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2273752,
'Height': 2618,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5953/13525953/exterior_rear_passenger-1774697719765.jpg',
'Width': 3491},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3125489,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5953/13525953/interior_front_seats-1774698050819.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3212453,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5953/13525953/interior_rear_seats-1774698062199.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3993538,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5953/13525953/interior_dashboard-1774698166764.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2672024,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5953/13525953/instrument_cluster-1774698165277.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4360360,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5953/13525953/interior_boot-1774698111430.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5/f130c0e1-cc1f-5b7b-8669-e15a2e61a9b5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1081482,
'Height': 5289,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5953/13525953/docs_service_history-1774699380252.jpg?ixlib=js-3.8.0&auto=format&s=10863bff2823f1391dcf1619b9c6acbf',
'Width': 3048}],
'price': 9318,
'price_includes_vat': False,
'registration_date': '2018-05-14',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes CLA 180 AMG Line',
'transmission': 'manual',
'trim': 'CLA 180 AMG Line',
'vin': 'WDD1173422N681449',
'year': 2018}
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713525953%27 HTTP/1.1" 200 None
2026-03-29 20:09:26 [motorway.uk] INFO: Saving data for 13525953: {'created_time': 1774814966.490861, 'last_price_update_time': 1774814966.490872, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13525953') HTTP/1.1" 204 0
2026-03-29 20:09:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1441/20391441/docs_service_history-1774194212928.jpg?ixlib=js-3.8.0&auto=format&s=f1c85da3744787b5a0b32e1302b1d0f4> (referer: None)
2026-03-29 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9533/20329533/instrument_cluster-1774188604412.jpg> (referer: None)
2026-03-29 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9533/20329533/interior_dashboard-1774710562887.jpg> (referer: None)
2026-03-29 20:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1441/20391441/interior_boot-1774193919327.jpg> (referer: None)
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8e4a510>
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1441%252F20391441%252Fdocs_service_history-1774194212928.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df1c85da3744787b5a0b32e1302b1d0f4') HTTP/1.1" 204 0
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1441/20391441/docs_service_history-1774194212928.jpg?ixlib=js-3.8.0&auto=format&s=f1c85da3744787b5a0b32e1302b1d0f4 saved to cache
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d52d825d-0b86-51a3-bf94-dc369e652fdb
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fac1d190>
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9533%252F20329533%252Finstrument_cluster-1774188604412.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9533/20329533/instrument_cluster-1774188604412.jpg saved to cache
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab0870f9-cf68-55f5-9d85-de9bafaee685
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa125890>
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9533%252F20329533%252Finterior_dashboard-1774710562887.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9533/20329533/interior_dashboard-1774710562887.jpg saved to cache
2026-03-29 20:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab0870f9-cf68-55f5-9d85-de9bafaee685
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f901d950>
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1441%252F20391441%252Finterior_boot-1774193919327.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1441/20391441/interior_boot-1774193919327.jpg saved to cache
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d52d825d-0b86-51a3-bf94-dc369e652fdb
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16616720.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20418338.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1620&page=45&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1441/20391441/interior_dashboard-1774193847183.jpg> (referer: None)
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_front_passenger-1774187956608.jpg> (referer: None)
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_rear_driver-1774187996818.jpg> (referer: None)
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1441/20391441/instrument_cluster-1774193819679.jpg> (referer: None)
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9533/20329533/interior_rear_seats-1774188439802.jpg> (referer: None)
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1441/20391441/interior_front_seats-1774193728522.jpg> (referer: None)
2026-03-29 20:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e32d1160-c125-53af-9e96-0d1bae2d11bd with identifier: 16616720
2026-03-29 20:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e32d1160-c125-53af-9e96-0d1bae2d11bd with scrape type 1
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e32d1160-c125-53af-9e96-0d1bae2d11bd
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6720%252F16616720%252Fexterior_front_driver-1774703392928.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6720/16616720/exterior_front_driver-1774703392928.jpeg not downloaded yet
2026-03-29 20:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14b73f24-d26f-5c05-b06b-6b1d5a27f5a1 with identifier: 20418338
2026-03-29 20:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14b73f24-d26f-5c05-b06b-6b1d5a27f5a1 with scrape type 1
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14b73f24-d26f-5c05-b06b-6b1d5a27f5a1
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8338%252F20418338%252Fexterior_front_driver-1774714785609.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8338/20418338/exterior_front_driver-1774714785609.jpg not downloaded yet
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6720%252F16616720%252Fexterior_rear_driver-1774703395287.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6720/16616720/exterior_rear_driver-1774703395287.jpeg not downloaded yet
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8338%252F20418338%252Fexterior_rear_driver-1774714788144.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8338/20418338/exterior_rear_driver-1774714788144.jpg not downloaded yet
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6720%252F16616720%252Fexterior_front_passenger-1774703355330.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6720/16616720/exterior_front_passenger-1774703355330.jpeg not downloaded yet
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8338%252F20418338%252Fexterior_front_passenger-1774714777107.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8338/20418338/exterior_front_passenger-1774714777107.jpg not downloaded yet
2026-03-29 20:09:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9533/20329533/interior_front_seats-1774188461144.jpg> (referer: None)
2026-03-29 20:09:27 [motorway.uk] INFO: Found listing with ID: 20392033
2026-03-29 20:09:27 [motorway.uk] INFO: Found listing with ID: 6855795
2026-03-29 20:09:27 [motorway.uk] INFO: Found listing with ID: 6221793
2026-03-29 20:09:27 [motorway.uk] INFO: Found listing with ID: 16311303
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716311303%27 HTTP/1.1" 200 None
2026-03-29 20:09:27 [motorway.uk] INFO: Scrape type for 16311303: 1
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa126d90>
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1441%252F20391441%252Finterior_dashboard-1774193847183.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1441/20391441/interior_dashboard-1774193847183.jpg saved to cache
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d52d825d-0b86-51a3-bf94-dc369e652fdb
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebbd8590>
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9533%252F20329533%252Fexterior_front_passenger-1774187956608.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_front_passenger-1774187956608.jpg saved to cache
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab0870f9-cf68-55f5-9d85-de9bafaee685
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa154c90>
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9533%252F20329533%252Fexterior_rear_driver-1774187996818.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_rear_driver-1774187996818.jpg saved to cache
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab0870f9-cf68-55f5-9d85-de9bafaee685
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa157b10>
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1441%252F20391441%252Finstrument_cluster-1774193819679.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1441/20391441/instrument_cluster-1774193819679.jpg saved to cache
2026-03-29 20:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d52d825d-0b86-51a3-bf94-dc369e652fdb
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8ef80d0>
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9533%252F20329533%252Finterior_rear_seats-1774188439802.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9533/20329533/interior_rear_seats-1774188439802.jpg saved to cache
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab0870f9-cf68-55f5-9d85-de9bafaee685
2026-03-29 20:09:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89cdf10>
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1441%252F20391441%252Finterior_front_seats-1774193728522.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1441/20391441/interior_front_seats-1774193728522.jpg saved to cache
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d52d825d-0b86-51a3-bf94-dc369e652fdb
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6720%252F16616720%252Fexterior_rear_passenger-1774703358829.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6720/16616720/exterior_rear_passenger-1774703358829.jpeg not downloaded yet
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8338%252F20418338%252Fexterior_rear_passenger-1774714706077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8338/20418338/exterior_rear_passenger-1774714706077.jpg not downloaded yet
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 20477312
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 20286694
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720286694%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [motorway.uk] INFO: Scrape type for 20286694: 1
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6720%252F16616720%252Finterior_front_seats-1774703407644.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6720/16616720/interior_front_seats-1774703407644.jpeg not downloaded yet
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8338%252F20418338%252Finterior_front_seats-1774715301399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8338/20418338/interior_front_seats-1774715301399.jpg not downloaded yet
2026-03-29 20:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 20439535
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 19648962
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 20475889
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475889%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [motorway.uk] INFO: Scrape type for 20475889: 1
2026-03-29 20:09:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebea9b10>
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9533%252F20329533%252Finterior_front_seats-1774188461144.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9533/20329533/interior_front_seats-1774188461144.jpg saved to cache
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab0870f9-cf68-55f5-9d85-de9bafaee685
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6720%252F16616720%252Finterior_rear_seats-1774703480082.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6720/16616720/interior_rear_seats-1774703480082.jpeg not downloaded yet
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8338%252F20418338%252Finterior_rear_seats-1774715314243.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8338/20418338/interior_rear_seats-1774715314243.jpg not downloaded yet
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 19395541
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 20377618
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 13609049
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713609049%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [motorway.uk] INFO: Scrape type for 13609049: 1
2026-03-29 20:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_front_driver-1774787979295.jpg> (referer: None)
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6720%252F16616720%252Finterior_dashboard-1774703502080.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6720/16616720/interior_dashboard-1774703502080.jpeg not downloaded yet
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8338%252F20418338%252Finterior_dashboard-1774715342656.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8338/20418338/interior_dashboard-1774715342656.jpg not downloaded yet
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 20111098
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 20158063
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720158063%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [motorway.uk] INFO: Scrape type for 20158063: 1
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6720%252F16616720%252Finterior_boot-1774703503670.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6720/16616720/interior_boot-1774703503670.jpeg not downloaded yet
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8338%252F20418338%252Finstrument_cluster-1774715376258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8338/20418338/instrument_cluster-1774715376258.jpg not downloaded yet
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 20461954
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720461954%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [motorway.uk] INFO: Scrape type for 20461954: 1
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6720%252F16616720%252Fdocs_service_history-1774709047913.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db1e77c1b6abaec0908fc45cce6142118%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6720/16616720/docs_service_history-1774709047913.jpeg?ixlib=js-3.8.0&auto=format&s=b1e77c1b6abaec0908fc45cce6142118 not downloaded yet
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8338%252F20418338%252Finterior_boot-1774715362259.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8338/20418338/interior_boot-1774715362259.jpg not downloaded yet
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 20411240
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 20485932
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 20080126
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 10041890
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 19794671
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719794671%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [motorway.uk] INFO: Scrape type for 19794671: 1
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6720%252F16616720%252Fdocs_service_history-1774709065660.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6cd2d338e9a62a309cd6fecc76a73d7b%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6720/16616720/docs_service_history-1774709065660.jpeg?ixlib=js-3.8.0&auto=format&s=6cd2d338e9a62a309cd6fecc76a73d7b not downloaded yet
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8338%252F20418338%252Fdocs_service_history-1774716072790.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcdc95c228f4b322fcf9f80943d470fe2%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8338/20418338/docs_service_history-1774716072790.jpg?ixlib=js-3.8.0&auto=format&s=cdc95c228f4b322fcf9f80943d470fe2 not downloaded yet
2026-03-29 20:09:28 [motorway.uk] INFO: Found listing with ID: 20498723
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720498723%27 HTTP/1.1" 200 None
2026-03-29 20:09:28 [motorway.uk] INFO: Scrape type for 20498723: 1
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfb4690>
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5216%252F5025216%252Fexterior_front_driver-1774787979295.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_front_driver-1774787979295.jpg saved to cache
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1014eb9b-c103-5686-ac51-3846fe06778d
2026-03-29 20:09:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1014eb9b-c103-5686-ac51-3846fe06778d, skipping ID generation
2026-03-29 20:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1014eb9b-c103-5686-ac51-3846fe06778d with scrape type 1
2026-03-29 20:09:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1014eb9b-c103-5686-ac51-3846fe06778d sending to next pipeline
2026-03-29 20:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1014eb9b-c103-5686-ac51-3846fe06778d, identifier: 5025216
2026-03-29 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_front_driver-1774188039113.jpg> (referer: None)
2026-03-29 20:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1014eb9b-c103-5686-ac51-3846fe06778d with identifier: 5025216
2026-03-29 20:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1014eb9b-c103-5686-ac51-3846fe06778d with identifier: 5025216
2026-03-29 20:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1014eb9b-c103-5686-ac51-3846fe06778d with identifier: 5025216 to the API
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_front_driver-1774787979295.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '1014eb9b-c103-5686-ac51-3846fe06778d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NXZ 232',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/5025216',
'listing': 'auction',
'location': 'Armagh City, Banbridge and Craigavon Armagh',
'make': 'BMW',
'model': 'M4',
'odometer': 53345,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1223495,
'Height': 2225,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_front_driver-1774787979295.jpg',
'Width': 2966},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1776878,
'Height': 2579,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_rear_driver-1774787994414.jpg',
'Width': 3439},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2121701,
'Height': 2993,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_front_passenger-1774788054146.jpg',
'Width': 3990},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1818296,
'Height': 2579,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5216/5025216/exterior_rear_passenger-1774788018511.jpg',
'Width': 3438},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3997092,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5216/5025216/interior_front_seats-1774788428746.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2114376,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5216/5025216/interior_rear_seats-1774788433842.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1724509,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5216/5025216/interior_dashboard-1774788498895.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2970519,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5216/5025216/instrument_cluster-1774788531641.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4124774,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5216/5025216/interior_boot-1774788508990.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1014eb9b-c103-5686-ac51-3846fe06778d/1014eb9b-c103-5686-ac51-3846fe06778d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485436,
'Height': 2236,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5216/5025216/docs_service_history-1774789182687.jpg?ixlib=js-3.8.0&auto=format&s=bcd109eaef2a6a244c7ceb15d4e65248',
'Width': 1670}],
'price': 20218,
'price_includes_vat': False,
'registration_date': '2015-09-02',
'seats_number': None,
'seller_name': None,
'title': 'BMW M4 S-A',
'transmission': 'automatic',
'trim': 'S-A',
'vin': 'WBS3R92080K342331',
'year': 2015}
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275025216%27 HTTP/1.1" 200 None
2026-03-29 20:09:29 [motorway.uk] INFO: Saving data for 5025216: {'created_time': 1774814969.48804, 'last_price_update_time': 1774814969.488051, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='5025216') HTTP/1.1" 204 0
2026-03-29 20:09:29 [motorway.uk] INFO: Found listing with ID: 19811025
2026-03-29 20:09:29 [motorway.uk] INFO: Found listing with ID: 7025386
2026-03-29 20:09:29 [motorway.uk] INFO: Found listing with ID: 20277132
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720277132%27 HTTP/1.1" 200 None
2026-03-29 20:09:29 [motorway.uk] INFO: Scrape type for 20277132: 1
2026-03-29 20:09:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19217492.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:29 [motorway.uk] INFO: Found listing with ID: 17822067
2026-03-29 20:09:29 [motorway.uk] INFO: Found listing with ID: 2720964
2026-03-29 20:09:29 [motorway.uk] INFO: Found listing with ID: 20457137
2026-03-29 20:09:29 [motorway.uk] INFO: Found listing with ID: 19525497
2026-03-29 20:09:29 [motorway.uk] INFO: Found listing with ID: 20490195
2026-03-29 20:09:29 [motorway.uk] INFO: Found listing with ID: 20487725
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487725%27 HTTP/1.1" 200 None
2026-03-29 20:09:29 [motorway.uk] INFO: Scrape type for 20487725: 1
2026-03-29 20:09:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f83f3f10>
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9533%252F20329533%252Fexterior_front_driver-1774188039113.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_front_driver-1774188039113.jpg saved to cache
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab0870f9-cf68-55f5-9d85-de9bafaee685
2026-03-29 20:09:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab0870f9-cf68-55f5-9d85-de9bafaee685, skipping ID generation
2026-03-29 20:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab0870f9-cf68-55f5-9d85-de9bafaee685 with scrape type 1
2026-03-29 20:09:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab0870f9-cf68-55f5-9d85-de9bafaee685 sending to next pipeline
2026-03-29 20:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ab0870f9-cf68-55f5-9d85-de9bafaee685, identifier: 20329533
2026-03-29 20:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ab0870f9-cf68-55f5-9d85-de9bafaee685 with identifier: 20329533
2026-03-29 20:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ab0870f9-cf68-55f5-9d85-de9bafaee685 with identifier: 20329533
2026-03-29 20:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ab0870f9-cf68-55f5-9d85-de9bafaee685 with identifier: 20329533 to the API
2026-03-29 20:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_front_driver-1774188039113.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ab0870f9-cf68-55f5-9d85-de9bafaee685',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KW66 NXJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20329533',
'listing': 'auction',
'location': 'Peterborough Peterborough',
'make': 'BMW',
'model': 'X4',
'odometer': 93000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1438579,
'Height': 2858,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_front_driver-1774188039113.jpg',
'Width': 3810},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2190145,
'Height': 2961,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_rear_driver-1774187996818.jpg',
'Width': 3948},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1835846,
'Height': 2825,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_front_passenger-1774187956608.jpg',
'Width': 3767},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2291938,
'Height': 2993,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9533/20329533/exterior_rear_passenger-1774187978792.jpg',
'Width': 3990},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3400327,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9533/20329533/interior_front_seats-1774188461144.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2534823,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9533/20329533/interior_rear_seats-1774188439802.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2818229,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9533/20329533/interior_dashboard-1774710562887.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2464538,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9533/20329533/instrument_cluster-1774188604412.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4039777,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9533/20329533/interior_boot-1774188372259.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab0870f9-cf68-55f5-9d85-de9bafaee685/ab0870f9-cf68-55f5-9d85-de9bafaee685_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2677366,
'Height': 1391,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9533/20329533/docs_service_history-1774188596502.jpg?ixlib=js-3.8.0&auto=format&s=406d56770426bb9e484da81d2613d0a5',
'Width': 2503}],
'price': 9606,
'price_includes_vat': False,
'registration_date': '2016-12-17',
'seats_number': None,
'seller_name': None,
'title': 'BMW X4 xDrive 20d M Sport Auto',
'transmission': 'automatic',
'trim': 'xDrive 20d M Sport Auto',
'vin': 'WBAXX120700U99762',
'year': 2016}
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720329533%27 HTTP/1.1" 200 None
2026-03-29 20:09:30 [motorway.uk] INFO: Saving data for 20329533: {'created_time': 1774814970.237482, 'last_price_update_time': 1774814970.237492, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20329533') HTTP/1.1" 204 0
2026-03-29 20:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9994/20489994/exterior_front_driver-1774714077947.jpg> (referer: None)
2026-03-29 20:09:30 [motorway.uk] INFO: Found listing with ID: 20076469
2026-03-29 20:09:30 [motorway.uk] INFO: Found listing with ID: 18151907
2026-03-29 20:09:30 [motorway.uk] INFO: Found listing with ID: 20441173
2026-03-29 20:09:30 [motorway.uk] INFO: Found listing with ID: 20363657
2026-03-29 20:09:30 [motorway.uk] INFO: Found listing with ID: 20411608
2026-03-29 20:09:30 [motorway.uk] INFO: Found listing with ID: 19896790
2026-03-29 20:09:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a42a46-856c-5c9f-ad54-087e6c6d0814 with identifier: 19217492
2026-03-29 20:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a42a46-856c-5c9f-ad54-087e6c6d0814 with scrape type 1
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2a42a46-856c-5c9f-ad54-087e6c6d0814
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7492%252F19217492%252Fexterior_front_driver-1774622212207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_front_driver-1774622212207.jpg not downloaded yet
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7492%252F19217492%252Fexterior_rear_driver-1774622168389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_rear_driver-1774622168389.jpg not downloaded yet
2026-03-29 20:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9994/20489994/exterior_front_passenger-1774713675597.jpg> (referer: None)
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7492%252F19217492%252Fexterior_front_passenger-1774622285100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_front_passenger-1774622285100.jpg not downloaded yet
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7492%252F19217492%252Fexterior_rear_passenger-1774622248447.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_rear_passenger-1774622248447.jpg not downloaded yet
2026-03-29 20:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9994/20489994/exterior_rear_driver-1774713658495.jpg> (referer: None)
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7492%252F19217492%252Finterior_front_seats-1774787055822.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7492/19217492/interior_front_seats-1774787055822.jpg not downloaded yet
2026-03-29 20:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_rear_passenger-1774193190323.jpg> (referer: None)
2026-03-29 20:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_front_passenger-1774193207001.jpg> (referer: None)
2026-03-29 20:09:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8338/20418338/exterior_rear_passenger-1774714706077.jpg> (referer: None)
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7492%252F19217492%252Finterior_rear_seats-1774547455119.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7492/19217492/interior_rear_seats-1774547455119.jpg not downloaded yet
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebfad6d0>
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9994%252F20489994%252Fexterior_front_driver-1774714077947.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9994/20489994/exterior_front_driver-1774714077947.jpg saved to cache
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7492%252F19217492%252Finterior_dashboard-1774787043749.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7492/19217492/interior_dashboard-1774787043749.jpg not downloaded yet
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7492%252F19217492%252Finstrument_cluster-1774547846176.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7492/19217492/instrument_cluster-1774547846176.jpg not downloaded yet
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa43590>
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9994%252F20489994%252Fexterior_front_passenger-1774713675597.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9994/20489994/exterior_front_passenger-1774713675597.jpg saved to cache
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8681890>
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9994%252F20489994%252Fexterior_rear_driver-1774713658495.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9994/20489994/exterior_rear_driver-1774713658495.jpg saved to cache
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a
2026-03-29 20:09:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a, skipping ID generation
2026-03-29 20:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a with scrape type 1
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a sending to next pipeline
2026-03-29 20:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a, identifier: 20489994
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9668c90>
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1441%252F20391441%252Fexterior_rear_passenger-1774193190323.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_rear_passenger-1774193190323.jpg saved to cache
2026-03-29 20:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d52d825d-0b86-51a3-bf94-dc369e652fdb
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9355910>
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1441%252F20391441%252Fexterior_front_passenger-1774193207001.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_front_passenger-1774193207001.jpg saved to cache
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d52d825d-0b86-51a3-bf94-dc369e652fdb
2026-03-29 20:09:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d52d825d-0b86-51a3-bf94-dc369e652fdb, skipping ID generation
2026-03-29 20:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d52d825d-0b86-51a3-bf94-dc369e652fdb with scrape type 1
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d52d825d-0b86-51a3-bf94-dc369e652fdb sending to next pipeline
2026-03-29 20:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d52d825d-0b86-51a3-bf94-dc369e652fdb, identifier: 20391441
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9545750>
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b73f24-d26f-5c05-b06b-6b1d5a27f5a1/14b73f24-d26f-5c05-b06b-6b1d5a27f5a1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8338%252F20418338%252Fexterior_rear_passenger-1774714706077.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8338/20418338/exterior_rear_passenger-1774714706077.jpg saved to cache
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14b73f24-d26f-5c05-b06b-6b1d5a27f5a1
2026-03-29 20:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6720/16616720/exterior_front_passenger-1774703355330.jpeg> (referer: None)
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7492%252F19217492%252Finterior_boot-1774547434608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7492/19217492/interior_boot-1774547434608.jpg not downloaded yet
2026-03-29 20:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a with identifier: 20489994
2026-03-29 20:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a with identifier: 20489994
2026-03-29 20:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a with identifier: 20489994 to the API
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/9994/20489994/exterior_rear_driver-1774713658495.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG12 BBV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20489994',
'listing': 'auction',
'location': 'Northamptonshire Northampton',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 45327,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1605302,
'Height': 2204,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9994/20489994/exterior_front_driver-1774714077947.jpg',
'Width': 2939},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1903518,
'Height': 2393,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9994/20489994/exterior_rear_driver-1774713658495.jpg',
'Width': 3191},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1526725,
'Height': 2276,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9994/20489994/exterior_front_passenger-1774713675597.jpg',
'Width': 3035},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1570779,
'Height': 2270,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9994/20489994/exterior_rear_passenger-1774713687443.jpg',
'Width': 3027},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3187047,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9994/20489994/interior_front_seats-1774711536431.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3361117,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9994/20489994/interior_rear_seats-1774711544886.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2185652,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9994/20489994/interior_dashboard-1774713701007.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3338421,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9994/20489994/instrument_cluster-1774711760460.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3269823,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9994/20489994/interior_boot-1774711584178.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a/c3f1bb65-fb0a-5bb3-bb15-a0d8ce49c33a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2409720,
'Height': 2985,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9994/20489994/docs_service_history-1774711806196.jpg?ixlib=js-3.8.0&auto=format&s=65be2d77e6e2863a322ea36e5e7725da',
'Width': 1999}],
'price': 3315,
'price_includes_vat': False,
'registration_date': '2012-04-13',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Zetec',
'transmission': 'manual',
'trim': 'Zetec',
'vin': 'WF0JXXGAJJCR67842',
'year': 2012}
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489994%27 HTTP/1.1" 200 None
2026-03-29 20:09:31 [motorway.uk] INFO: Saving data for 20489994: {'created_time': 1774814971.914181, 'last_price_update_time': 1774814971.914191, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20489994') HTTP/1.1" 204 0
2026-03-29 20:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d52d825d-0b86-51a3-bf94-dc369e652fdb with identifier: 20391441
2026-03-29 20:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d52d825d-0b86-51a3-bf94-dc369e652fdb with identifier: 20391441
2026-03-29 20:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d52d825d-0b86-51a3-bf94-dc369e652fdb with identifier: 20391441 to the API
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_front_passenger-1774193207001.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd52d825d-0b86-51a3-bf94-dc369e652fdb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN66 NFO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20391441',
'listing': 'auction',
'location': 'Stockton-on-Tees Stockton-on-Tees',
'make': 'Mercedes',
'model': 'E Class',
'odometer': 64600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1527045,
'Height': 2506,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_front_driver-1774193147316.jpg',
'Width': 3341},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1940251,
'Height': 2773,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_rear_driver-1774193173600.jpg',
'Width': 3697},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1904757,
'Height': 2797,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_front_passenger-1774193207001.jpg',
'Width': 3729},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1989757,
'Height': 2713,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1441/20391441/exterior_rear_passenger-1774193190323.jpg',
'Width': 3617},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3915151,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1441/20391441/interior_front_seats-1774193728522.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3607690,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1441/20391441/interior_rear_seats-1774193810668.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1677889,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1441/20391441/interior_dashboard-1774193847183.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2340805,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1441/20391441/instrument_cluster-1774193819679.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3867795,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1441/20391441/interior_boot-1774193919327.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52d825d-0b86-51a3-bf94-dc369e652fdb/d52d825d-0b86-51a3-bf94-dc369e652fdb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609591,
'Height': 3267,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1441/20391441/docs_service_history-1774194212928.jpg?ixlib=js-3.8.0&auto=format&s=f1c85da3744787b5a0b32e1302b1d0f4',
'Width': 2215}],
'price': 14497,
'price_includes_vat': False,
'registration_date': '2016-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes E 220 D AMG Line PREMIUM+ Auto',
'transmission': 'automatic',
'trim': 'E 220 D AMG Line PREMIUM+ Auto',
'vin': 'WDD2130042A049907',
'year': 2016}
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720391441%27 HTTP/1.1" 200 None
2026-03-29 20:09:32 [motorway.uk] INFO: Saving data for 20391441: {'created_time': 1774814972.39166, 'last_price_update_time': 1774814972.391671, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20391441') HTTP/1.1" 204 0
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7492%252F19217492%252Fdocs_service_history-1774547780948.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcdc0007a7cbc832fa198de7f2459c5d0%27 HTTP/1.1" 200 None
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7492/19217492/docs_service_history-1774547780948.jpg?ixlib=js-3.8.0&auto=format&s=cdc0007a7cbc832fa198de7f2459c5d0 not downloaded yet
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadf6210>
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e32d1160-c125-53af-9e96-0d1bae2d11bd/e32d1160-c125-53af-9e96-0d1bae2d11bd_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6720%252F16616720%252Fexterior_front_passenger-1774703355330.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6720/16616720/exterior_front_passenger-1774703355330.jpeg saved to cache
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e32d1160-c125-53af-9e96-0d1bae2d11bd
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8338/20418338/exterior_front_passenger-1774714777107.jpg> (referer: None)
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6720/16616720/exterior_rear_passenger-1774703358829.jpeg> (referer: None)
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8338/20418338/interior_rear_seats-1774715314243.jpg> (referer: None)
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_rear_driver-1774622168389.jpg> (referer: None)
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadf48d0>
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b73f24-d26f-5c05-b06b-6b1d5a27f5a1/14b73f24-d26f-5c05-b06b-6b1d5a27f5a1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8338%252F20418338%252Fexterior_front_passenger-1774714777107.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8338/20418338/exterior_front_passenger-1774714777107.jpg saved to cache
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14b73f24-d26f-5c05-b06b-6b1d5a27f5a1
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16311303.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20357385.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19778290.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf93750>
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e32d1160-c125-53af-9e96-0d1bae2d11bd/e32d1160-c125-53af-9e96-0d1bae2d11bd_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6720%252F16616720%252Fexterior_rear_passenger-1774703358829.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6720/16616720/exterior_rear_passenger-1774703358829.jpeg saved to cache
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e32d1160-c125-53af-9e96-0d1bae2d11bd
2026-03-29 20:09:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9054cd0>
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b73f24-d26f-5c05-b06b-6b1d5a27f5a1/14b73f24-d26f-5c05-b06b-6b1d5a27f5a1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8338%252F20418338%252Finterior_rear_seats-1774715314243.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8338/20418338/interior_rear_seats-1774715314243.jpg saved to cache
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14b73f24-d26f-5c05-b06b-6b1d5a27f5a1
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9672750>
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7492%252F19217492%252Fexterior_rear_driver-1774622168389.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_rear_driver-1774622168389.jpg saved to cache
2026-03-29 20:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2a42a46-856c-5c9f-ad54-087e6c6d0814
2026-03-29 20:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56d01a02-eff8-5806-aa97-3efc7b8377c0 with identifier: 16311303
2026-03-29 20:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56d01a02-eff8-5806-aa97-3efc7b8377c0 with scrape type 1
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56d01a02-eff8-5806-aa97-3efc7b8377c0
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1303%252F16311303%252Fexterior_front_driver-1772902750667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1303/16311303/exterior_front_driver-1772902750667.jpg already downloaded
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1303%252F16311303%252Fexterior_rear_driver-1772902768387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1303/16311303/exterior_rear_driver-1772902768387.jpg already downloaded
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1303%252F16311303%252Fexterior_front_passenger-1772902820671.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1303/16311303/exterior_front_passenger-1772902820671.jpg already downloaded
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1303%252F16311303%252Fexterior_rear_passenger-1772902800111.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1303/16311303/exterior_rear_passenger-1772902800111.jpg already downloaded
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1303%252F16311303%252Finterior_front_seats-1772903620187.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1303/16311303/interior_front_seats-1772903620187.jpg already downloaded
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1303%252F16311303%252Finterior_rear_seats-1772903590913.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1303/16311303/interior_rear_seats-1772903590913.jpg already downloaded
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1303%252F16311303%252Finterior_dashboard-1773759213813.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1303/16311303/interior_dashboard-1773759213813.jpg already downloaded
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1303%252F16311303%252Finstrument_cluster-1772903777351.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1303/16311303/instrument_cluster-1772903777351.jpg already downloaded
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1303%252F16311303%252Finterior_boot-1772903468240.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1303/16311303/interior_boot-1772903468240.jpg already downloaded
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1303%252F16311303%252Fdocs_service_history-1773562261253.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0609765b48fea69395526d0a8bafa960%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1303/16311303/docs_service_history-1773562261253.jpg?ixlib=js-3.8.0&auto=format&s=0609765b48fea69395526d0a8bafa960 already downloaded
2026-03-29 20:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 56d01a02-eff8-5806-aa97-3efc7b8377c0, identifier: 16311303
2026-03-29 20:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1af316de-ec65-5aa1-998e-7ea29802d902 with identifier: 20357385
2026-03-29 20:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1af316de-ec65-5aa1-998e-7ea29802d902 with scrape type 2
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1af316de-ec65-5aa1-998e-7ea29802d902 with scrape type 2
2026-03-29 20:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1af316de-ec65-5aa1-998e-7ea29802d902, identifier: 20357385
2026-03-29 20:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44bf0429-3747-5f95-8433-ad2f21c304cd with identifier: 19778290
2026-03-29 20:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44bf0429-3747-5f95-8433-ad2f21c304cd with scrape type 1
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44bf0429-3747-5f95-8433-ad2f21c304cd
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8290%252F19778290%252Fexterior_front_driver-1774632092702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8290/19778290/exterior_front_driver-1774632092702.jpg not downloaded yet
2026-03-29 20:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 56d01a02-eff8-5806-aa97-3efc7b8377c0 with identifier: 16311303
2026-03-29 20:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 56d01a02-eff8-5806-aa97-3efc7b8377c0 with identifier: 16311303
2026-03-29 20:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 56d01a02-eff8-5806-aa97-3efc7b8377c0 with identifier: 16311303 to the API
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16311303.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '56d01a02-eff8-5806-aa97-3efc7b8377c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LC54 RPX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16311303',
'listing': 'auction',
'location': 'West Yorkshire Wakefield',
'make': 'BMW',
'model': 'X5',
'odometer': 67486,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 43,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/1303/16311303/exterior_front_driver-1772902750667.jpg',
'https://motorway-photos-redacted.imgix.net/1303/16311303/exterior_rear_driver-1772902768387.jpg',
'https://motorway-photos-redacted.imgix.net/1303/16311303/exterior_front_passenger-1772902820671.jpg',
'https://motorway-photos-redacted.imgix.net/1303/16311303/exterior_rear_passenger-1772902800111.jpg',
'https://motorway-photos.imgix.net/1303/16311303/interior_front_seats-1772903620187.jpg',
'https://motorway-photos.imgix.net/1303/16311303/interior_rear_seats-1772903590913.jpg',
'https://motorway-photos-modified.imgix.net/1303/16311303/interior_dashboard-1773759213813.jpg',
'https://motorway-photos-redacted.imgix.net/1303/16311303/instrument_cluster-1772903777351.jpg',
'https://motorway-photos.imgix.net/1303/16311303/interior_boot-1772903468240.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/1303/16311303/docs_service_history-1773562261253.jpg?ixlib=js-3.8.0&auto=format&s=0609765b48fea69395526d0a8bafa960'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d01a02-eff8-5806-aa97-3efc7b8377c0/56d01a02-eff8-5806-aa97-3efc7b8377c0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2056235,
'Height': 2744,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1303/16311303/exterior_front_driver-1772902750667.jpg',
'Width': 3659},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d01a02-eff8-5806-aa97-3efc7b8377c0/56d01a02-eff8-5806-aa97-3efc7b8377c0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1736483,
'Height': 2598,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1303/16311303/exterior_rear_driver-1772902768387.jpg',
'Width': 3464},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d01a02-eff8-5806-aa97-3efc7b8377c0/56d01a02-eff8-5806-aa97-3efc7b8377c0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1921283,
'Height': 2803,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1303/16311303/exterior_front_passenger-1772902820671.jpg',
'Width': 3737},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d01a02-eff8-5806-aa97-3efc7b8377c0/56d01a02-eff8-5806-aa97-3efc7b8377c0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1919991,
'Height': 2655,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1303/16311303/exterior_rear_passenger-1772902800111.jpg',
'Width': 3540},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d01a02-eff8-5806-aa97-3efc7b8377c0/56d01a02-eff8-5806-aa97-3efc7b8377c0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3849618,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1303/16311303/interior_front_seats-1772903620187.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d01a02-eff8-5806-aa97-3efc7b8377c0/56d01a02-eff8-5806-aa97-3efc7b8377c0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3724881,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1303/16311303/interior_rear_seats-1772903590913.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d01a02-eff8-5806-aa97-3efc7b8377c0/56d01a02-eff8-5806-aa97-3efc7b8377c0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2367150,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1303/16311303/interior_dashboard-1773759213813.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d01a02-eff8-5806-aa97-3efc7b8377c0/56d01a02-eff8-5806-aa97-3efc7b8377c0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2879077,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1303/16311303/instrument_cluster-1772903777351.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d01a02-eff8-5806-aa97-3efc7b8377c0/56d01a02-eff8-5806-aa97-3efc7b8377c0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3497225,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1303/16311303/interior_boot-1772903468240.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56d01a02-eff8-5806-aa97-3efc7b8377c0/56d01a02-eff8-5806-aa97-3efc7b8377c0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 793956,
'Height': 2986,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1303/16311303/docs_service_history-1773562261253.jpg?ixlib=js-3.8.0&auto=format&s=0609765b48fea69395526d0a8bafa960',
'Width': 2015}],
'price': 2062,
'price_includes_vat': False,
'registration_date': '2004-11-19',
'seats_number': None,
'seller_name': None,
'title': 'BMW X5 Sport D Auto',
'transmission': 'automatic',
'trim': 'Sport D Auto',
'vin': 'WBAFB72040LD38462',
'year': 2004}
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716311303%27 HTTP/1.1" 200 None
2026-03-29 20:09:33 [motorway.uk] INFO: Saving data for 16311303: {'created_time': 1774814973.981247, 'last_price_update_time': 1774814973.981259, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16311303') HTTP/1.1" 204 0
2026-03-29 20:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1af316de-ec65-5aa1-998e-7ea29802d902 with identifier: 20357385
2026-03-29 20:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1af316de-ec65-5aa1-998e-7ea29802d902 with identifier: 20357385
2026-03-29 20:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1af316de-ec65-5aa1-998e-7ea29802d902 with identifier: 20357385 to the API
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20357385.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '1af316de-ec65-5aa1-998e-7ea29802d902',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AJ09 XAF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20357385',
'listing': 'auction',
'location': 'None None',
'make': 'Volvo',
'model': 'XC70',
'odometer': 50182,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 9000,
'price_includes_vat': False,
'registration_date': '2009-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC70 SE Sport D5 A',
'transmission': 'automatic',
'trim': 'SE Sport D5 A',
'vin': 'YV1BZ714691065363',
'year': 2009}
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720357385%27 HTTP/1.1" 200 None
2026-03-29 20:09:34 [motorway.uk] INFO: Saving data for 20357385: {'auction_closing_time': 1774884600.0, 'created_time': 1774469158.687864, 'last_price_update_time': 1774814974.333319}
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20357385') HTTP/1.1" 204 0
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8290%252F19778290%252Fexterior_rear_driver-1774632114771.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8290/19778290/exterior_rear_driver-1774632114771.jpg not downloaded yet
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8290%252F19778290%252Fexterior_front_passenger-1774632126783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8290/19778290/exterior_front_passenger-1774632126783.jpg not downloaded yet
2026-03-29 20:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7492/19217492/docs_service_history-1774547780948.jpg?ixlib=js-3.8.0&auto=format&s=cdc0007a7cbc832fa198de7f2459c5d0> (referer: None)
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8290%252F19778290%252Fexterior_rear_passenger-1774632127895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8290/19778290/exterior_rear_passenger-1774632127895.jpg not downloaded yet
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8290%252F19778290%252Finterior_front_seats-1774632456379.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8290/19778290/interior_front_seats-1774632456379.jpg not downloaded yet
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8290%252F19778290%252Finterior_rear_seats-1774632470022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8290/19778290/interior_rear_seats-1774632470022.jpg not downloaded yet
2026-03-29 20:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8338/20418338/docs_service_history-1774716072790.jpg?ixlib=js-3.8.0&auto=format&s=cdc95c228f4b322fcf9f80943d470fe2> (referer: None)
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8290%252F19778290%252Finterior_dashboard-1774632520271.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8290/19778290/interior_dashboard-1774632520271.jpg not downloaded yet
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8290%252F19778290%252Finstrument_cluster-1774791180860.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8290/19778290/instrument_cluster-1774791180860.jpg not downloaded yet
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8290%252F19778290%252Finterior_boot-1774632542873.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8290/19778290/interior_boot-1774632542873.jpg not downloaded yet
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8290%252F19778290%252Fdocs_service_history-1774463685015.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D36a719dca45b241eddc7ea40312cbc18%27 HTTP/1.1" 200 None
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8290/19778290/docs_service_history-1774463685015.jpeg?ixlib=js-3.8.0&auto=format&s=36a719dca45b241eddc7ea40312cbc18 not downloaded yet
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab1b8d0>
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7492%252F19217492%252Fdocs_service_history-1774547780948.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcdc0007a7cbc832fa198de7f2459c5d0') HTTP/1.1" 204 0
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7492/19217492/docs_service_history-1774547780948.jpg?ixlib=js-3.8.0&auto=format&s=cdc0007a7cbc832fa198de7f2459c5d0 saved to cache
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2a42a46-856c-5c9f-ad54-087e6c6d0814
2026-03-29 20:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_rear_passenger-1774622248447.jpg> (referer: None)
2026-03-29 20:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7492/19217492/instrument_cluster-1774547846176.jpg> (referer: None)
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f904a790>
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b73f24-d26f-5c05-b06b-6b1d5a27f5a1/14b73f24-d26f-5c05-b06b-6b1d5a27f5a1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8338%252F20418338%252Fdocs_service_history-1774716072790.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcdc95c228f4b322fcf9f80943d470fe2') HTTP/1.1" 204 0
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8338/20418338/docs_service_history-1774716072790.jpg?ixlib=js-3.8.0&auto=format&s=cdc95c228f4b322fcf9f80943d470fe2 saved to cache
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14b73f24-d26f-5c05-b06b-6b1d5a27f5a1
2026-03-29 20:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_front_passenger-1774622285100.jpg> (referer: None)
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fd4790>
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7492%252F19217492%252Fexterior_rear_passenger-1774622248447.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_rear_passenger-1774622248447.jpg saved to cache
2026-03-29 20:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2a42a46-856c-5c9f-ad54-087e6c6d0814
2026-03-29 20:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20277132.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8275710>
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7492%252F19217492%252Finstrument_cluster-1774547846176.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7492/19217492/instrument_cluster-1774547846176.jpg saved to cache
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2a42a46-856c-5c9f-ad54-087e6c6d0814
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f953ef90>
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7492%252F19217492%252Fexterior_front_passenger-1774622285100.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_front_passenger-1774622285100.jpg saved to cache
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2a42a46-856c-5c9f-ad54-087e6c6d0814
2026-03-29 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487725.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7492/19217492/interior_dashboard-1774787043749.jpg> (referer: None)
2026-03-29 20:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6e881a2-9e76-5c67-a881-395fdb92732c with identifier: 20277132
2026-03-29 20:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6e881a2-9e76-5c67-a881-395fdb92732c with scrape type 1
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6e881a2-9e76-5c67-a881-395fdb92732c
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7132%252F20277132%252Fexterior_front_driver-1773569150080.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7132/20277132/exterior_front_driver-1773569150080.jpg already downloaded
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7132%252F20277132%252Fexterior_rear_driver-1773569178901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7132/20277132/exterior_rear_driver-1773569178901.jpg already downloaded
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7132%252F20277132%252Fexterior_front_passenger-1773569199957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7132/20277132/exterior_front_passenger-1773569199957.jpg not downloaded yet
2026-03-29 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20498723.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7132%252F20277132%252Fexterior_rear_passenger-1773569189898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7132/20277132/exterior_rear_passenger-1773569189898.jpg not downloaded yet
2026-03-29 20:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5508690-c365-59f4-88ec-b0bb2d84948a with identifier: 20487725
2026-03-29 20:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5508690-c365-59f4-88ec-b0bb2d84948a with scrape type 1
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5508690-c365-59f4-88ec-b0bb2d84948a
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7725%252F20487725%252Fexterior_front_driver-1774702022000.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7725/20487725/exterior_front_driver-1774702022000.jpg not downloaded yet
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9fd7290>
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7492%252F19217492%252Finterior_dashboard-1774787043749.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7492/19217492/interior_dashboard-1774787043749.jpg saved to cache
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2a42a46-856c-5c9f-ad54-087e6c6d0814
2026-03-29 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8290/19778290/instrument_cluster-1774791180860.jpg> (referer: None)
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7132%252F20277132%252Finterior_front_seats-1773571287623.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7132/20277132/interior_front_seats-1773571287623.jpg not downloaded yet
2026-03-29 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_front_driver-1774622212207.jpg> (referer: None)
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7725%252F20487725%252Fexterior_rear_driver-1774702023179.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7725/20487725/exterior_rear_driver-1774702023179.jpg not downloaded yet
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7132%252F20277132%252Finterior_rear_seats-1773571309795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7132/20277132/interior_rear_seats-1773571309795.jpg not downloaded yet
2026-03-29 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488759.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2efb518f-2218-5efc-9649-81ff82f6c94b with identifier: 20498723
2026-03-29 20:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2efb518f-2218-5efc-9649-81ff82f6c94b with scrape type 1
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2efb518f-2218-5efc-9649-81ff82f6c94b
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F20498723%252Fexterior_front_driver-1774772700750.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/20498723/exterior_front_driver-1774772700750.jpg not downloaded yet
2026-03-29 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7492/19217492/interior_boot-1774547434608.jpg> (referer: None)
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7725%252F20487725%252Fexterior_front_passenger-1774702059340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7725/20487725/exterior_front_passenger-1774702059340.jpg not downloaded yet
2026-03-29 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7492/19217492/interior_front_seats-1774787055822.jpg> (referer: None)
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7132%252F20277132%252Finterior_dashboard-1773571419972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7132/20277132/interior_dashboard-1773571419972.jpg already downloaded
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7132%252F20277132%252Finstrument_cluster-1773571381846.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7132/20277132/instrument_cluster-1773571381846.jpg already downloaded
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7132%252F20277132%252Finterior_boot-1773665271191.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7132/20277132/interior_boot-1773665271191.jpg already downloaded
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7132%252F20277132%252Fdocs_service_history-1773665481716.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Defebdad544e42d6ea3c56f865a9f040e%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7132/20277132/docs_service_history-1773665481716.jpg?ixlib=js-3.8.0&auto=format&s=efebdad544e42d6ea3c56f865a9f040e not downloaded yet
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F20498723%252Fexterior_rear_driver-1774772737475.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/20498723/exterior_rear_driver-1774772737475.jpg not downloaded yet
2026-03-29 20:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7492/19217492/interior_rear_seats-1774547455119.jpg> (referer: None)
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7725%252F20487725%252Fexterior_rear_passenger-1774702033283.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7725/20487725/exterior_rear_passenger-1774702033283.jpg not downloaded yet
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86facab750>
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44bf0429-3747-5f95-8433-ad2f21c304cd/44bf0429-3747-5f95-8433-ad2f21c304cd_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8290%252F19778290%252Finstrument_cluster-1774791180860.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8290/19778290/instrument_cluster-1774791180860.jpg saved to cache
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44bf0429-3747-5f95-8433-ad2f21c304cd
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F20498723%252Fexterior_front_passenger-1774772774505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/20498723/exterior_front_passenger-1774772774505.jpg not downloaded yet
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7725%252F20487725%252Finterior_front_seats-1774702988931.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7725/20487725/interior_front_seats-1774702988931.jpg not downloaded yet
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa164b50>
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7492%252F19217492%252Fexterior_front_driver-1774622212207.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_front_driver-1774622212207.jpg saved to cache
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2a42a46-856c-5c9f-ad54-087e6c6d0814
2026-03-29 20:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c5a7ab6-f715-5ad4-8020-4e21a9362d26 with identifier: 20488759
2026-03-29 20:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c5a7ab6-f715-5ad4-8020-4e21a9362d26 with scrape type 1
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c5a7ab6-f715-5ad4-8020-4e21a9362d26
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8759%252F20488759%252Fexterior_front_driver-1774707791043.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8759/20488759/exterior_front_driver-1774707791043.jpg not downloaded yet
2026-03-29 20:09:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94969d0>
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7492%252F19217492%252Finterior_boot-1774547434608.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7492/19217492/interior_boot-1774547434608.jpg saved to cache
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2a42a46-856c-5c9f-ad54-087e6c6d0814
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F20498723%252Fexterior_rear_passenger-1774772768203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/20498723/exterior_rear_passenger-1774772768203.jpg not downloaded yet
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8290/19778290/exterior_rear_driver-1774632114771.jpg> (referer: None)
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7725%252F20487725%252Finterior_rear_seats-1774702483953.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7725/20487725/interior_rear_seats-1774702483953.jpg not downloaded yet
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8759%252F20488759%252Fexterior_rear_driver-1774705111523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8759/20488759/exterior_rear_driver-1774705111523.jpg not downloaded yet
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f93b4f50>
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7492%252F19217492%252Finterior_front_seats-1774787055822.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7492/19217492/interior_front_seats-1774787055822.jpg saved to cache
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2a42a46-856c-5c9f-ad54-087e6c6d0814
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6720/16616720/docs_service_history-1774709065660.jpeg?ixlib=js-3.8.0&auto=format&s=6cd2d338e9a62a309cd6fecc76a73d7b> (referer: None)
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F20498723%252Finterior_front_seats-1774773080090.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/20498723/interior_front_seats-1774773080090.jpg not downloaded yet
2026-03-29 20:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1656&page=46&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae61610>
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7492%252F19217492%252Finterior_rear_seats-1774547455119.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7492/19217492/interior_rear_seats-1774547455119.jpg saved to cache
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2a42a46-856c-5c9f-ad54-087e6c6d0814
2026-03-29 20:09:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2a42a46-856c-5c9f-ad54-087e6c6d0814, skipping ID generation
2026-03-29 20:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a42a46-856c-5c9f-ad54-087e6c6d0814 with scrape type 1
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2a42a46-856c-5c9f-ad54-087e6c6d0814 sending to next pipeline
2026-03-29 20:09:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d2a42a46-856c-5c9f-ad54-087e6c6d0814, identifier: 19217492
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7725%252F20487725%252Finterior_dashboard-1774702463085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7725/20487725/interior_dashboard-1774702463085.jpg not downloaded yet
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8759%252F20488759%252Fexterior_front_passenger-1774705974827.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8759/20488759/exterior_front_passenger-1774705974827.jpg not downloaded yet
2026-03-29 20:09:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d2a42a46-856c-5c9f-ad54-087e6c6d0814 with identifier: 19217492
2026-03-29 20:09:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d2a42a46-856c-5c9f-ad54-087e6c6d0814 with identifier: 19217492
2026-03-29 20:09:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d2a42a46-856c-5c9f-ad54-087e6c6d0814 with identifier: 19217492 to the API
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7492/19217492/interior_rear_seats-1774547455119.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'd2a42a46-856c-5c9f-ad54-087e6c6d0814',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'PN23 URL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19217492',
'listing': 'auction',
'location': 'Merseyside Liverpool',
'make': 'Nissan',
'model': 'Juke',
'odometer': 15000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2250248,
'Height': 2961,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_front_driver-1774622212207.jpg',
'Width': 3948},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1937532,
'Height': 2765,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_rear_driver-1774622168389.jpg',
'Width': 3687},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1472983,
'Height': 2519,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_front_passenger-1774622285100.jpg',
'Width': 3358},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1601593,
'Height': 2678,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7492/19217492/exterior_rear_passenger-1774622248447.jpg',
'Width': 3571},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2782165,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7492/19217492/interior_front_seats-1774787055822.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2812340,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7492/19217492/interior_rear_seats-1774547455119.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2262849,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7492/19217492/interior_dashboard-1774787043749.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1683107,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7492/19217492/instrument_cluster-1774547846176.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2736407,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7492/19217492/interior_boot-1774547434608.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a42a46-856c-5c9f-ad54-087e6c6d0814/d2a42a46-856c-5c9f-ad54-087e6c6d0814_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 473266,
'Height': 2041,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7492/19217492/docs_service_history-1774547780948.jpg?ixlib=js-3.8.0&auto=format&s=cdc0007a7cbc832fa198de7f2459c5d0',
'Width': 2924}],
'price': 14050,
'price_includes_vat': False,
'registration_date': '2023-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke N-Connecta HEV CVT',
'transmission': 'automatic',
'trim': 'N-Connecta HEV CVT',
'vin': 'SJNFCAF16U1227581',
'year': 2023}
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719217492%27 HTTP/1.1" 200 None
2026-03-29 20:09:36 [motorway.uk] INFO: Saving data for 19217492: {'created_time': 1774814976.990539, 'last_price_update_time': 1774814976.99055, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19217492') HTTP/1.1" 204 0
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F20498723%252Finterior_rear_seats-1774773215470.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/20498723/interior_rear_seats-1774773215470.jpg not downloaded yet
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faf91b10>
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44bf0429-3747-5f95-8433-ad2f21c304cd/44bf0429-3747-5f95-8433-ad2f21c304cd_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8290%252F19778290%252Fexterior_rear_driver-1774632114771.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8290/19778290/exterior_rear_driver-1774632114771.jpg saved to cache
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44bf0429-3747-5f95-8433-ad2f21c304cd
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7725%252F20487725%252Finterior_boot-1774702484677.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7725/20487725/interior_boot-1774702484677.jpg not downloaded yet
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8759%252F20488759%252Fexterior_rear_passenger-1774705148285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8759/20488759/exterior_rear_passenger-1774705148285.jpg not downloaded yet
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F20498723%252Finterior_dashboard-1774773304993.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/20498723/interior_dashboard-1774773304993.jpg not downloaded yet
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7725%252F20487725%252Fdocs_service_history-1774711282753.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc1d5717e597ddbc507f54d4f40271f3d%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7725/20487725/docs_service_history-1774711282753.jpg?ixlib=js-3.8.0&auto=format&s=c1d5717e597ddbc507f54d4f40271f3d not downloaded yet
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8759%252F20488759%252Finterior_front_seats-1774705698529.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8759/20488759/interior_front_seats-1774705698529.jpg not downloaded yet
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9f3ac90>
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e32d1160-c125-53af-9e96-0d1bae2d11bd/e32d1160-c125-53af-9e96-0d1bae2d11bd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6720%252F16616720%252Fdocs_service_history-1774709065660.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6cd2d338e9a62a309cd6fecc76a73d7b') HTTP/1.1" 204 0
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6720/16616720/docs_service_history-1774709065660.jpeg?ixlib=js-3.8.0&auto=format&s=6cd2d338e9a62a309cd6fecc76a73d7b saved to cache
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e32d1160-c125-53af-9e96-0d1bae2d11bd
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20100929
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720100929%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [motorway.uk] INFO: Scrape type for 20100929: 1
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F20498723%252Finstrument_cluster-1774773467110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/20498723/instrument_cluster-1774773467110.jpg not downloaded yet
2026-03-29 20:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8290/19778290/docs_service_history-1774463685015.jpeg?ixlib=js-3.8.0&auto=format&s=36a719dca45b241eddc7ea40312cbc18> (referer: None)
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7725%252F20487725%252Fdamage_scratches-1774702115603.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7725/20487725/damage_scratches-1774702115603.jpg not downloaded yet
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8759%252F20488759%252Finterior_rear_seats-1774705797250.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8759/20488759/interior_rear_seats-1774705797250.jpg not downloaded yet
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20485662
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485662%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [motorway.uk] INFO: Scrape type for 20485662: 1
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F20498723%252Finterior_boot-1774773126146.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/20498723/interior_boot-1774773126146.jpg not downloaded yet
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8759%252F20488759%252Finterior_dashboard-1774707197828.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8759/20488759/interior_dashboard-1774707197828.jpg not downloaded yet
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20194967
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20381297
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20386223
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20286698
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20489245
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20392027
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 3873152
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 11096285
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20482960
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 19678576
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 18548941
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20491894
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 19241262
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 19752609
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719752609%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [motorway.uk] INFO: Scrape type for 19752609: 1
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8723%252F20498723%252Fdocs_service_history-1774774007622.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7a5f747ae81a44c60387c0db255fcc11%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8723/20498723/docs_service_history-1774774007622.jpg?ixlib=js-3.8.0&auto=format&s=7a5f747ae81a44c60387c0db255fcc11 not downloaded yet
2026-03-29 20:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7132/20277132/exterior_rear_passenger-1773569189898.jpg> (referer: None)
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8759%252F20488759%252Finstrument_cluster-1774705780277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8759/20488759/instrument_cluster-1774705780277.jpg not downloaded yet
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 8334948
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20386964
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20411705
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720411705%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [motorway.uk] INFO: Scrape type for 20411705: 1
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebed6310>
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44bf0429-3747-5f95-8433-ad2f21c304cd/44bf0429-3747-5f95-8433-ad2f21c304cd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8290%252F19778290%252Fdocs_service_history-1774463685015.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D36a719dca45b241eddc7ea40312cbc18') HTTP/1.1" 204 0
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8290/19778290/docs_service_history-1774463685015.jpeg?ixlib=js-3.8.0&auto=format&s=36a719dca45b241eddc7ea40312cbc18 saved to cache
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44bf0429-3747-5f95-8433-ad2f21c304cd
2026-03-29 20:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7132/20277132/exterior_front_passenger-1773569199957.jpg> (referer: None)
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8759%252F20488759%252Finterior_boot-1774705694920.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8759/20488759/interior_boot-1774705694920.jpg not downloaded yet
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 19182939
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719182939%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [motorway.uk] INFO: Scrape type for 19182939: 1
2026-03-29 20:09:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8290/19778290/interior_dashboard-1774632520271.jpg> (referer: None)
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8759%252F20488759%252Fdamage_scratches-1774705175151.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8759/20488759/damage_scratches-1774705175151.jpg not downloaded yet
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20488347
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20484773
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484773%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [motorway.uk] INFO: Scrape type for 20484773: 1
2026-03-29 20:09:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad28b10>
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e881a2-9e76-5c67-a881-395fdb92732c/d6e881a2-9e76-5c67-a881-395fdb92732c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7132%252F20277132%252Fexterior_rear_passenger-1773569189898.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7132/20277132/exterior_rear_passenger-1773569189898.jpg saved to cache
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6e881a2-9e76-5c67-a881-395fdb92732c
2026-03-29 20:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8290/19778290/interior_rear_seats-1774632470022.jpg> (referer: None)
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 17552063
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20486399
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 19793554
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20162768
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20100434
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 8441343
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20452585
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720452585%27 HTTP/1.1" 200 None
2026-03-29 20:09:37 [motorway.uk] INFO: Scrape type for 20452585: 1
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20478128
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 10468400
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20020455
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 14838177
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20494569
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 20436489
2026-03-29 20:09:37 [motorway.uk] INFO: Found listing with ID: 8662679
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9308a90>
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e881a2-9e76-5c67-a881-395fdb92732c/d6e881a2-9e76-5c67-a881-395fdb92732c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7132%252F20277132%252Fexterior_front_passenger-1773569199957.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7132/20277132/exterior_front_passenger-1773569199957.jpg saved to cache
2026-03-29 20:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6e881a2-9e76-5c67-a881-395fdb92732c
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad35890>
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44bf0429-3747-5f95-8433-ad2f21c304cd/44bf0429-3747-5f95-8433-ad2f21c304cd_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8290%252F19778290%252Finterior_dashboard-1774632520271.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8290/19778290/interior_dashboard-1774632520271.jpg saved to cache
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44bf0429-3747-5f95-8433-ad2f21c304cd
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8290/19778290/exterior_rear_passenger-1774632127895.jpg> (referer: None)
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8723/20498723/docs_service_history-1774774007622.jpg?ixlib=js-3.8.0&auto=format&s=7a5f747ae81a44c60387c0db255fcc11> (referer: None)
2026-03-29 20:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9115910>
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44bf0429-3747-5f95-8433-ad2f21c304cd/44bf0429-3747-5f95-8433-ad2f21c304cd_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8290%252F19778290%252Finterior_rear_seats-1774632470022.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8290/19778290/interior_rear_seats-1774632470022.jpg saved to cache
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44bf0429-3747-5f95-8433-ad2f21c304cd
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9604cd0>
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44bf0429-3747-5f95-8433-ad2f21c304cd/44bf0429-3747-5f95-8433-ad2f21c304cd_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8290%252F19778290%252Fexterior_rear_passenger-1774632127895.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8290/19778290/exterior_rear_passenger-1774632127895.jpg saved to cache
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44bf0429-3747-5f95-8433-ad2f21c304cd
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1f7990>
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2efb518f-2218-5efc-9649-81ff82f6c94b/2efb518f-2218-5efc-9649-81ff82f6c94b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8723%252F20498723%252Fdocs_service_history-1774774007622.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7a5f747ae81a44c60387c0db255fcc11') HTTP/1.1" 204 0
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8723/20498723/docs_service_history-1774774007622.jpg?ixlib=js-3.8.0&auto=format&s=7a5f747ae81a44c60387c0db255fcc11 saved to cache
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2efb518f-2218-5efc-9649-81ff82f6c94b
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8759/20488759/exterior_front_passenger-1774705974827.jpg> (referer: None)
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8759/20488759/exterior_rear_passenger-1774705148285.jpg> (referer: None)
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8290/19778290/interior_front_seats-1774632456379.jpg> (referer: None)
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8290/19778290/interior_boot-1774632542873.jpg> (referer: None)
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7725/20487725/interior_dashboard-1774702463085.jpg> (referer: None)
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7132/20277132/interior_front_seats-1773571287623.jpg> (referer: None)
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8723/20498723/interior_dashboard-1774773304993.jpg> (referer: None)
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8723/20498723/interior_front_seats-1774773080090.jpg> (referer: None)
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8723/20498723/interior_rear_seats-1774773215470.jpg> (referer: None)
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8723/20498723/instrument_cluster-1774773467110.jpg> (referer: None)
2026-03-29 20:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7725/20487725/interior_boot-1774702484677.jpg> (referer: None)
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadc0710>
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c5a7ab6-f715-5ad4-8020-4e21a9362d26/6c5a7ab6-f715-5ad4-8020-4e21a9362d26_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8759%252F20488759%252Fexterior_front_passenger-1774705974827.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8759/20488759/exterior_front_passenger-1774705974827.jpg saved to cache
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c5a7ab6-f715-5ad4-8020-4e21a9362d26
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9116d90>
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c5a7ab6-f715-5ad4-8020-4e21a9362d26/6c5a7ab6-f715-5ad4-8020-4e21a9362d26_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8759%252F20488759%252Fexterior_rear_passenger-1774705148285.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8759/20488759/exterior_rear_passenger-1774705148285.jpg saved to cache
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c5a7ab6-f715-5ad4-8020-4e21a9362d26
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010d57d0>
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44bf0429-3747-5f95-8433-ad2f21c304cd/44bf0429-3747-5f95-8433-ad2f21c304cd_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8290%252F19778290%252Finterior_front_seats-1774632456379.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8290/19778290/interior_front_seats-1774632456379.jpg saved to cache
2026-03-29 20:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44bf0429-3747-5f95-8433-ad2f21c304cd
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab7db50>
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44bf0429-3747-5f95-8433-ad2f21c304cd/44bf0429-3747-5f95-8433-ad2f21c304cd_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8290%252F19778290%252Finterior_boot-1774632542873.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8290/19778290/interior_boot-1774632542873.jpg saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44bf0429-3747-5f95-8433-ad2f21c304cd
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebbd9850>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5508690-c365-59f4-88ec-b0bb2d84948a/a5508690-c365-59f4-88ec-b0bb2d84948a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7725%252F20487725%252Finterior_dashboard-1774702463085.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7725/20487725/interior_dashboard-1774702463085.jpg saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5508690-c365-59f4-88ec-b0bb2d84948a
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a6cfd0>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6e881a2-9e76-5c67-a881-395fdb92732c/d6e881a2-9e76-5c67-a881-395fdb92732c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7132%252F20277132%252Finterior_front_seats-1773571287623.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7132/20277132/interior_front_seats-1773571287623.jpg saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6e881a2-9e76-5c67-a881-395fdb92732c
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9239610>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2efb518f-2218-5efc-9649-81ff82f6c94b/2efb518f-2218-5efc-9649-81ff82f6c94b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F20498723%252Finterior_dashboard-1774773304993.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/20498723/interior_dashboard-1774773304993.jpg saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2efb518f-2218-5efc-9649-81ff82f6c94b
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f937d810>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2efb518f-2218-5efc-9649-81ff82f6c94b/2efb518f-2218-5efc-9649-81ff82f6c94b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F20498723%252Finterior_front_seats-1774773080090.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/20498723/interior_front_seats-1774773080090.jpg saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2efb518f-2218-5efc-9649-81ff82f6c94b
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fade60d0>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2efb518f-2218-5efc-9649-81ff82f6c94b/2efb518f-2218-5efc-9649-81ff82f6c94b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F20498723%252Finterior_rear_seats-1774773215470.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/20498723/interior_rear_seats-1774773215470.jpg saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2efb518f-2218-5efc-9649-81ff82f6c94b
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa125f10>
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2efb518f-2218-5efc-9649-81ff82f6c94b/2efb518f-2218-5efc-9649-81ff82f6c94b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8723%252F20498723%252Finstrument_cluster-1774773467110.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8723/20498723/instrument_cluster-1774773467110.jpg saved to cache
2026-03-29 20:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2efb518f-2218-5efc-9649-81ff82f6c94b
2026-03-29 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1692&page=47&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0de3d0>
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5508690-c365-59f4-88ec-b0bb2d84948a/a5508690-c365-59f4-88ec-b0bb2d84948a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7725%252F20487725%252Finterior_boot-1774702484677.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7725/20487725/interior_boot-1774702484677.jpg saved to cache
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5508690-c365-59f4-88ec-b0bb2d84948a
2026-03-29 20:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20296573
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20262707
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20491857
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20392037
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720392037%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [motorway.uk] INFO: Scrape type for 20392037: 1
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 19849179
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 19605190
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20436357
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720436357%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [motorway.uk] INFO: Scrape type for 20436357: 1
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 10396132
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 4873494
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 10731175
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710731175%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [motorway.uk] INFO: Scrape type for 10731175: 1
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20465263
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20445236
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 16814678
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20440911
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 17351129
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717351129%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [motorway.uk] INFO: Scrape type for 17351129: 1
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20474259
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20448667
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720448667%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [motorway.uk] INFO: Scrape type for 20448667: 1
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 13582416
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713582416%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [motorway.uk] INFO: Scrape type for 13582416: 1
2026-03-29 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20411705.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 1049339
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20493132
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 19757080
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719757080%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [motorway.uk] INFO: Scrape type for 19757080: 1
2026-03-29 20:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20330269
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 13582420
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20379578
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720379578%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [motorway.uk] INFO: Scrape type for 20379578: 1
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 19988943
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 18468305
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20011671
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20303061
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720303061%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [motorway.uk] INFO: Scrape type for 20303061: 1
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20471692
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471692%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [motorway.uk] INFO: Scrape type for 20471692: 1
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 16982313
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20403202
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 10707418
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20499574
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 19862807
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20008184
2026-03-29 20:09:40 [motorway.uk] INFO: Found listing with ID: 20136887
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720136887%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [motorway.uk] INFO: Scrape type for 20136887: 1
2026-03-29 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8759/20488759/damage_scratches-1774705175151.jpg> (referer: None)
2026-03-29 20:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4ed130f-40a6-51bf-956b-7378a13a5047 with identifier: 20411705
2026-03-29 20:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4ed130f-40a6-51bf-956b-7378a13a5047 with scrape type 1
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4ed130f-40a6-51bf-956b-7378a13a5047
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1705%252F20411705%252Fexterior_front_driver-1774712882855.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1705/20411705/exterior_front_driver-1774712882855.jpg not downloaded yet
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1705%252F20411705%252Fexterior_rear_driver-1774709219693.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1705/20411705/exterior_rear_driver-1774709219693.jpg not downloaded yet
2026-03-29 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20452585.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1705%252F20411705%252Fexterior_front_passenger-1774709230176.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1705/20411705/exterior_front_passenger-1774709230176.jpg not downloaded yet
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1705%252F20411705%252Fexterior_rear_passenger-1774712548826.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1705/20411705/exterior_rear_passenger-1774712548826.jpg not downloaded yet
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1705%252F20411705%252Finterior_front_seats-1774711234044.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1705/20411705/interior_front_seats-1774711234044.jpg not downloaded yet
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1705%252F20411705%252Finterior_rear_seats-1774711168199.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1705/20411705/interior_rear_seats-1774711168199.jpg not downloaded yet
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82ad050>
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c5a7ab6-f715-5ad4-8020-4e21a9362d26/6c5a7ab6-f715-5ad4-8020-4e21a9362d26_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8759%252F20488759%252Fdamage_scratches-1774705175151.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8759/20488759/damage_scratches-1774705175151.jpg saved to cache
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c5a7ab6-f715-5ad4-8020-4e21a9362d26
2026-03-29 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7725/20487725/docs_service_history-1774711282753.jpg?ixlib=js-3.8.0&auto=format&s=c1d5717e597ddbc507f54d4f40271f3d> (referer: None)
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1705%252F20411705%252Finterior_dashboard-1774712505080.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1705/20411705/interior_dashboard-1774712505080.jpg not downloaded yet
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1705%252F20411705%252Finstrument_cluster-1774711174452.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1705/20411705/instrument_cluster-1774711174452.jpg not downloaded yet
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1705%252F20411705%252Finterior_boot-1774711171629.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1705/20411705/interior_boot-1774711171629.jpg not downloaded yet
2026-03-29 20:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e245170a-a437-50e6-b950-e2d5ea7111b4 with identifier: 20452585
2026-03-29 20:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e245170a-a437-50e6-b950-e2d5ea7111b4 with scrape type 1
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e245170a-a437-50e6-b950-e2d5ea7111b4
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2585%252F20452585%252Fexterior_front_driver-1774689532773.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2585/20452585/exterior_front_driver-1774689532773.jpg not downloaded yet
2026-03-29 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8759/20488759/instrument_cluster-1774705780277.jpg> (referer: None)
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1705%252F20411705%252Fdocs_service_history-1774711916151.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D613b86e9fbdcace109c1e73394b2043d%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1705/20411705/docs_service_history-1774711916151.jpg?ixlib=js-3.8.0&auto=format&s=613b86e9fbdcace109c1e73394b2043d not downloaded yet
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2585%252F20452585%252Fexterior_rear_driver-1774525546294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2585/20452585/exterior_rear_driver-1774525546294.jpg not downloaded yet
2026-03-29 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8759/20488759/interior_rear_seats-1774705797250.jpg> (referer: None)
2026-03-29 20:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8759/20488759/interior_front_seats-1774705698529.jpg> (referer: None)
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2585%252F20452585%252Fexterior_front_passenger-1774525549964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2585/20452585/exterior_front_passenger-1774525549964.jpg not downloaded yet
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb1cd0>
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5508690-c365-59f4-88ec-b0bb2d84948a/a5508690-c365-59f4-88ec-b0bb2d84948a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7725%252F20487725%252Fdocs_service_history-1774711282753.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc1d5717e597ddbc507f54d4f40271f3d') HTTP/1.1" 204 0
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7725/20487725/docs_service_history-1774711282753.jpg?ixlib=js-3.8.0&auto=format&s=c1d5717e597ddbc507f54d4f40271f3d saved to cache
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5508690-c365-59f4-88ec-b0bb2d84948a
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2585%252F20452585%252Fexterior_rear_passenger-1774630265284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2585/20452585/exterior_rear_passenger-1774630265284.jpg not downloaded yet
2026-03-29 20:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2585%252F20452585%252Finterior_front_seats-1774628915886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2585/20452585/interior_front_seats-1774628915886.jpg not downloaded yet
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95232d0>
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c5a7ab6-f715-5ad4-8020-4e21a9362d26/6c5a7ab6-f715-5ad4-8020-4e21a9362d26_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8759%252F20488759%252Finstrument_cluster-1774705780277.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8759/20488759/instrument_cluster-1774705780277.jpg saved to cache
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c5a7ab6-f715-5ad4-8020-4e21a9362d26
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a7c610>
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c5a7ab6-f715-5ad4-8020-4e21a9362d26/6c5a7ab6-f715-5ad4-8020-4e21a9362d26_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8759%252F20488759%252Finterior_rear_seats-1774705797250.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8759/20488759/interior_rear_seats-1774705797250.jpg saved to cache
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c5a7ab6-f715-5ad4-8020-4e21a9362d26
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87004dd050>
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c5a7ab6-f715-5ad4-8020-4e21a9362d26/6c5a7ab6-f715-5ad4-8020-4e21a9362d26_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8759%252F20488759%252Finterior_front_seats-1774705698529.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8759/20488759/interior_front_seats-1774705698529.jpg saved to cache
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c5a7ab6-f715-5ad4-8020-4e21a9362d26
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2585%252F20452585%252Finterior_rear_seats-1774526450635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2585/20452585/interior_rear_seats-1774526450635.jpg not downloaded yet
2026-03-29 20:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19182939.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2585%252F20452585%252Finterior_dashboard-1774630248970.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2585/20452585/interior_dashboard-1774630248970.jpg not downloaded yet
2026-03-29 20:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8759/20488759/interior_boot-1774705694920.jpg> (referer: None)
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2585%252F20452585%252Finstrument_cluster-1774526553224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2585/20452585/instrument_cluster-1774526553224.jpg not downloaded yet
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2585%252F20452585%252Finterior_boot-1774630222543.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2585/20452585/interior_boot-1774630222543.jpg not downloaded yet
2026-03-29 20:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8759/20488759/interior_dashboard-1774707197828.jpg> (referer: None)
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2585%252F20452585%252Fdocs_service_history-1774526606396.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da58da4e6ca14a31d18d510aed48a900a%27 HTTP/1.1" 200 None
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2585/20452585/docs_service_history-1774526606396.jpg?ixlib=js-3.8.0&auto=format&s=a58da4e6ca14a31d18d510aed48a900a not downloaded yet
2026-03-29 20:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1705/20411705/exterior_rear_driver-1774709219693.jpg> (referer: None)
2026-03-29 20:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2585/20452585/exterior_front_driver-1774689532773.jpg> (referer: None)
2026-03-29 20:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2585/20452585/exterior_front_passenger-1774525549964.jpg> (referer: None)
2026-03-29 20:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c2a43f2-994a-5124-88aa-9116d0db9f4c with identifier: 19182939
2026-03-29 20:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c with scrape type 1
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2939%252F19182939%252Fexterior_front_driver-1774783344027.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_front_driver-1774783344027.jpeg not downloaded yet
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2939%252F19182939%252Fexterior_rear_driver-1774783280769.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_rear_driver-1774783280769.jpeg not downloaded yet
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2939%252F19182939%252Fexterior_front_passenger-1774783422741.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_front_passenger-1774783422741.jpeg not downloaded yet
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a7d950>
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c5a7ab6-f715-5ad4-8020-4e21a9362d26/6c5a7ab6-f715-5ad4-8020-4e21a9362d26_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8759%252F20488759%252Finterior_boot-1774705694920.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8759/20488759/interior_boot-1774705694920.jpg saved to cache
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c5a7ab6-f715-5ad4-8020-4e21a9362d26
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2939%252F19182939%252Fexterior_rear_passenger-1774783458171.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_rear_passenger-1774783458171.jpeg not downloaded yet
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c5d450>
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c5a7ab6-f715-5ad4-8020-4e21a9362d26/6c5a7ab6-f715-5ad4-8020-4e21a9362d26_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8759%252F20488759%252Finterior_dashboard-1774707197828.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8759/20488759/interior_dashboard-1774707197828.jpg saved to cache
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c5a7ab6-f715-5ad4-8020-4e21a9362d26
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2939%252F19182939%252F19182939-interior_front_seats-modified-1774785905663.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2939/19182939/19182939-interior_front_seats-modified-1774785905663.jpeg not downloaded yet
2026-03-29 20:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1705/20411705/interior_rear_seats-1774711168199.jpg> (referer: None)
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2939%252F19182939%252Finterior_rear_seats-1774783594687.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2939/19182939/interior_rear_seats-1774783594687.jpeg not downloaded yet
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8c5eb90>
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ed130f-40a6-51bf-956b-7378a13a5047/f4ed130f-40a6-51bf-956b-7378a13a5047_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1705%252F20411705%252Fexterior_rear_driver-1774709219693.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1705/20411705/exterior_rear_driver-1774709219693.jpg saved to cache
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4ed130f-40a6-51bf-956b-7378a13a5047
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebe3cf50>
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e245170a-a437-50e6-b950-e2d5ea7111b4/e245170a-a437-50e6-b950-e2d5ea7111b4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2585%252F20452585%252Fexterior_front_driver-1774689532773.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2585/20452585/exterior_front_driver-1774689532773.jpg saved to cache
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e245170a-a437-50e6-b950-e2d5ea7111b4
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf60350>
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e245170a-a437-50e6-b950-e2d5ea7111b4/e245170a-a437-50e6-b950-e2d5ea7111b4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2585%252F20452585%252Fexterior_front_passenger-1774525549964.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2585/20452585/exterior_front_passenger-1774525549964.jpg saved to cache
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e245170a-a437-50e6-b950-e2d5ea7111b4
2026-03-29 20:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1705/20411705/interior_boot-1774711171629.jpg> (referer: None)
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2939%252F19182939%252Finterior_dashboard-1774783632887.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2939/19182939/interior_dashboard-1774783632887.jpeg not downloaded yet
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2939%252F19182939%252Finterior_boot-1774783645175.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2939/19182939/interior_boot-1774783645175.jpeg not downloaded yet
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d7ca90>
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ed130f-40a6-51bf-956b-7378a13a5047/f4ed130f-40a6-51bf-956b-7378a13a5047_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1705%252F20411705%252Finterior_rear_seats-1774711168199.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1705/20411705/interior_rear_seats-1774711168199.jpg saved to cache
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4ed130f-40a6-51bf-956b-7378a13a5047
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2939%252F19182939%252Fdocs_service_history-1774785097836.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1831449aca5f733c4e0574d5bd9d9a0e%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2939/19182939/docs_service_history-1774785097836.jpeg?ixlib=js-3.8.0&auto=format&s=1831449aca5f733c4e0574d5bd9d9a0e not downloaded yet
2026-03-29 20:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8723/20498723/interior_boot-1774773126146.jpg> (referer: None)
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2939%252F19182939%252Fdocs_service_history-1774785148617.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dae17a981af515f95c8f0cf44f1a503fd%27 HTTP/1.1" 200 None
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2939/19182939/docs_service_history-1774785148617.jpeg?ixlib=js-3.8.0&auto=format&s=ae17a981af515f95c8f0cf44f1a503fd not downloaded yet
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8d7e310>
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4ed130f-40a6-51bf-956b-7378a13a5047/f4ed130f-40a6-51bf-956b-7378a13a5047_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1705%252F20411705%252Finterior_boot-1774711171629.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1705/20411705/interior_boot-1774711171629.jpg saved to cache
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4ed130f-40a6-51bf-956b-7378a13a5047
2026-03-29 20:09:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa0a850>
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2efb518f-2218-5efc-9649-81ff82f6c94b/2efb518f-2218-5efc-9649-81ff82f6c94b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8723%252F20498723%252Finterior_boot-1774773126146.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8723/20498723/interior_boot-1774773126146.jpg saved to cache
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2efb518f-2218-5efc-9649-81ff82f6c94b
2026-03-29 20:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2585/20452585/interior_dashboard-1774630248970.jpg> (referer: None)
2026-03-29 20:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7725/20487725/damage_scratches-1774702115603.jpg> (referer: None)
2026-03-29 20:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2585/20452585/interior_rear_seats-1774526450635.jpg> (referer: None)
2026-03-29 20:09:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2585/20452585/interior_boot-1774630222543.jpg> (referer: None)
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88a6010>
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e245170a-a437-50e6-b950-e2d5ea7111b4/e245170a-a437-50e6-b950-e2d5ea7111b4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2585%252F20452585%252Finterior_dashboard-1774630248970.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2585/20452585/interior_dashboard-1774630248970.jpg saved to cache
2026-03-29 20:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e245170a-a437-50e6-b950-e2d5ea7111b4
2026-03-29 20:09:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0074d0>
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5508690-c365-59f4-88ec-b0bb2d84948a/a5508690-c365-59f4-88ec-b0bb2d84948a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7725%252F20487725%252Fdamage_scratches-1774702115603.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7725/20487725/damage_scratches-1774702115603.jpg saved to cache
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5508690-c365-59f4-88ec-b0bb2d84948a
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8f53750>
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e245170a-a437-50e6-b950-e2d5ea7111b4/e245170a-a437-50e6-b950-e2d5ea7111b4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2585%252F20452585%252Finterior_rear_seats-1774526450635.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2585/20452585/interior_rear_seats-1774526450635.jpg saved to cache
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e245170a-a437-50e6-b950-e2d5ea7111b4
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f916a650>
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e245170a-a437-50e6-b950-e2d5ea7111b4/e245170a-a437-50e6-b950-e2d5ea7111b4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2585%252F20452585%252Finterior_boot-1774630222543.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2585/20452585/interior_boot-1774630222543.jpg saved to cache
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e245170a-a437-50e6-b950-e2d5ea7111b4
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19752609.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20100929.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1728&page=48&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2939/19182939/19182939-interior_front_seats-modified-1774785905663.jpeg> (referer: None)
2026-03-29 20:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c23fb3d-8731-540e-8faf-d10af84f554a with identifier: 19752609
2026-03-29 20:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c23fb3d-8731-540e-8faf-d10af84f554a with scrape type 1
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c23fb3d-8731-540e-8faf-d10af84f554a
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2609%252F19752609%252Fexterior_front_driver-1774598176496.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2609/19752609/exterior_front_driver-1774598176496.jpg not downloaded yet
2026-03-29 20:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3e45473-729a-5da6-8af3-38b669b6016f with identifier: 20100929
2026-03-29 20:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3e45473-729a-5da6-8af3-38b669b6016f with scrape type 1
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3e45473-729a-5da6-8af3-38b669b6016f
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0929%252F20100929%252Fexterior_front_driver-1774703555110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0929/20100929/exterior_front_driver-1774703555110.jpg not downloaded yet
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2609%252F19752609%252Fexterior_rear_driver-1774598196722.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2609/19752609/exterior_rear_driver-1774598196722.jpg not downloaded yet
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0929%252F20100929%252Fexterior_rear_driver-1774705242571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0929/20100929/exterior_rear_driver-1774705242571.jpg not downloaded yet
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20457474
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 7788719
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277788719%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [motorway.uk] INFO: Scrape type for 7788719: 1
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2609%252F19752609%252Fexterior_front_passenger-1774598247303.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2609/19752609/exterior_front_passenger-1774598247303.jpg not downloaded yet
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0929%252F20100929%252Fexterior_front_passenger-1774711137606.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0929/20100929/exterior_front_passenger-1774711137606.jpg not downloaded yet
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20496394
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20492076
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 19211859
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 19957337
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20446457
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 18634070
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20245213
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720245213%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [motorway.uk] INFO: Scrape type for 20245213: 1
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9170950>
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2939%252F19182939%252F19182939-interior_front_seats-modified-1774785905663.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2939/19182939/19182939-interior_front_seats-modified-1774785905663.jpeg saved to cache
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_rear_passenger-1774783458171.jpeg> (referer: None)
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2939/19182939/docs_service_history-1774785097836.jpeg?ixlib=js-3.8.0&auto=format&s=1831449aca5f733c4e0574d5bd9d9a0e> (referer: None)
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2609%252F19752609%252Fexterior_rear_passenger-1774598214535.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2609/19752609/exterior_rear_passenger-1774598214535.jpg not downloaded yet
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0929%252F20100929%252Fexterior_rear_passenger-1774703666911.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0929/20100929/exterior_rear_passenger-1774703666911.jpg not downloaded yet
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 10528347
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20486592
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20469845
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469845%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [motorway.uk] INFO: Scrape type for 20469845: 1
2026-03-29 20:09:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2939/19182939/docs_service_history-1774785148617.jpeg?ixlib=js-3.8.0&auto=format&s=ae17a981af515f95c8f0cf44f1a503fd> (referer: None)
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2609%252F19752609%252Finterior_front_seats-1774598558773.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2609/19752609/interior_front_seats-1774598558773.jpg not downloaded yet
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0929%252F20100929%252Finterior_front_seats-1774704015782.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0929/20100929/interior_front_seats-1774704015782.jpg not downloaded yet
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 13914989
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713914989%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [motorway.uk] INFO: Scrape type for 13914989: 1
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2609%252F19752609%252Finterior_rear_seats-1774598583193.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2609/19752609/interior_rear_seats-1774598583193.jpg not downloaded yet
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0929%252F20100929%252Finterior_rear_seats-1774704025533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0929/20100929/interior_rear_seats-1774704025533.jpg not downloaded yet
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 19622244
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20450720
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 19849878
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20408794
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20238739
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 19824492
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20486445
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 19470954
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20407532
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20469143
2026-03-29 20:09:43 [motorway.uk] INFO: Found listing with ID: 20452615
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720452615%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [motorway.uk] INFO: Scrape type for 20452615: 1
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2609%252F19752609%252Finterior_dashboard-1774598606048.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2609/19752609/interior_dashboard-1774598606048.jpg not downloaded yet
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0929%252F20100929%252Finterior_dashboard-1774704058400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0929/20100929/interior_dashboard-1774704058400.jpg not downloaded yet
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf86a10>
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2939%252F19182939%252Fexterior_rear_passenger-1774783458171.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_rear_passenger-1774783458171.jpeg saved to cache
2026-03-29 20:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cfce50>
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2939%252F19182939%252Fdocs_service_history-1774785097836.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1831449aca5f733c4e0574d5bd9d9a0e') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2939/19182939/docs_service_history-1774785097836.jpeg?ixlib=js-3.8.0&auto=format&s=1831449aca5f733c4e0574d5bd9d9a0e saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c
2026-03-29 20:09:44 [motorway.uk] INFO: Found listing with ID: 15157797
2026-03-29 20:09:44 [motorway.uk] INFO: Found listing with ID: 10964475
2026-03-29 20:09:44 [motorway.uk] INFO: Found listing with ID: 20476933
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476933%27 HTTP/1.1" 200 None
2026-03-29 20:09:44 [motorway.uk] INFO: Scrape type for 20476933: 1
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2609%252F19752609%252Finstrument_cluster-1774598674963.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2609/19752609/instrument_cluster-1774598674963.jpg not downloaded yet
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0929%252F20100929%252Finstrument_cluster-1774704122252.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0929/20100929/instrument_cluster-1774704122252.jpg not downloaded yet
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cffb50>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2939%252F19182939%252Fdocs_service_history-1774785148617.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dae17a981af515f95c8f0cf44f1a503fd') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2939/19182939/docs_service_history-1774785148617.jpeg?ixlib=js-3.8.0&auto=format&s=ae17a981af515f95c8f0cf44f1a503fd saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c
2026-03-29 20:09:44 [motorway.uk] INFO: Found listing with ID: 20393132
2026-03-29 20:09:44 [motorway.uk] INFO: Found listing with ID: 20348231
2026-03-29 20:09:44 [motorway.uk] INFO: Found listing with ID: 20380472
2026-03-29 20:09:44 [motorway.uk] INFO: Found listing with ID: 17242412
2026-03-29 20:09:44 [motorway.uk] INFO: Found listing with ID: 10152059
2026-03-29 20:09:44 [motorway.uk] INFO: Found listing with ID: 20348457
2026-03-29 20:09:44 [motorway.uk] INFO: Found listing with ID: 20393265
2026-03-29 20:09:44 [motorway.uk] INFO: Found listing with ID: 19488823
2026-03-29 20:09:44 [motorway.uk] INFO: Found listing with ID: 19580167
2026-03-29 20:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2609%252F19752609%252Finterior_boot-1774598788818.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2609/19752609/interior_boot-1774598788818.jpg not downloaded yet
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0929%252F20100929%252Finterior_boot-1774704073172.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0929/20100929/interior_boot-1774704073172.jpg not downloaded yet
2026-03-29 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2585/20452585/docs_service_history-1774526606396.jpg?ixlib=js-3.8.0&auto=format&s=a58da4e6ca14a31d18d510aed48a900a> (referer: None)
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2609%252F19752609%252Fdocs_service_history-1774708736615.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1c344ada6b1aeef1447fd5f1bc9a578e%27 HTTP/1.1" 200 None
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2609/19752609/docs_service_history-1774708736615.jpg?ixlib=js-3.8.0&auto=format&s=1c344ada6b1aeef1447fd5f1bc9a578e not downloaded yet
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0929%252F20100929%252Fdocs_service_history-1774704417943.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D11300e9a3816557d44bb749ee6e10d5b%27 HTTP/1.1" 200 None
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0929/20100929/docs_service_history-1774704417943.jpg?ixlib=js-3.8.0&auto=format&s=11300e9a3816557d44bb749ee6e10d5b not downloaded yet
2026-03-29 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2939/19182939/interior_rear_seats-1774783594687.jpeg> (referer: None)
2026-03-29 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2939/19182939/interior_boot-1774783645175.jpeg> (referer: None)
2026-03-29 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_front_driver-1774783344027.jpeg> (referer: None)
2026-03-29 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_rear_driver-1774783280769.jpeg> (referer: None)
2026-03-29 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2585/20452585/exterior_rear_passenger-1774630265284.jpg> (referer: None)
2026-03-29 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2939/19182939/interior_dashboard-1774783632887.jpeg> (referer: None)
2026-03-29 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_front_passenger-1774783422741.jpeg> (referer: None)
2026-03-29 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2585/20452585/interior_front_seats-1774628915886.jpg> (referer: None)
2026-03-29 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2585/20452585/instrument_cluster-1774526553224.jpg> (referer: None)
2026-03-29 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0929/20100929/exterior_front_passenger-1774711137606.jpg> (referer: None)
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabea950>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e245170a-a437-50e6-b950-e2d5ea7111b4/e245170a-a437-50e6-b950-e2d5ea7111b4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2585%252F20452585%252Fdocs_service_history-1774526606396.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da58da4e6ca14a31d18d510aed48a900a') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2585/20452585/docs_service_history-1774526606396.jpg?ixlib=js-3.8.0&auto=format&s=a58da4e6ca14a31d18d510aed48a900a saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e245170a-a437-50e6-b950-e2d5ea7111b4
2026-03-29 20:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485662.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b"\x00\x03\x00\x00\x00'\x9f\x93\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x1e\x97\x00'\x95i\x00\x00\x00\x00"
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cfd410>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2939%252F19182939%252Finterior_rear_seats-1774783594687.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2939/19182939/interior_rear_seats-1774783594687.jpeg saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00)\xb0\x8f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02 \x0f\x00)\xa6e\x00\x00\x00\x00'
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8de96d0>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2939%252F19182939%252Finterior_boot-1774783645175.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2939/19182939/interior_boot-1774783645175.jpeg saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf03310>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2939%252F19182939%252Fexterior_front_driver-1774783344027.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_front_driver-1774783344027.jpeg saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f927ee90>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2939%252F19182939%252Fexterior_rear_driver-1774783280769.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_rear_driver-1774783280769.jpeg saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8dea590>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e245170a-a437-50e6-b950-e2d5ea7111b4/e245170a-a437-50e6-b950-e2d5ea7111b4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2585%252F20452585%252Fexterior_rear_passenger-1774630265284.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2585/20452585/exterior_rear_passenger-1774630265284.jpg saved to cache
2026-03-29 20:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e245170a-a437-50e6-b950-e2d5ea7111b4
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00-\xfb\x9d\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03d\xa7\x00-\xf1s\x00\x00\x00\x00'
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebec8d50>
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2939%252F19182939%252Finterior_dashboard-1774783632887.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2939/19182939/interior_dashboard-1774783632887.jpeg saved to cache
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fabe98d0>
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2939%252F19182939%252Fexterior_front_passenger-1774783422741.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_front_passenger-1774783422741.jpeg saved to cache
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c
2026-03-29 20:09:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c2a43f2-994a-5124-88aa-9116d0db9f4c, skipping ID generation
2026-03-29 20:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c with scrape type 1
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c2a43f2-994a-5124-88aa-9116d0db9f4c sending to next pipeline
2026-03-29 20:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7c2a43f2-994a-5124-88aa-9116d0db9f4c, identifier: 19182939
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9136e50>
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e245170a-a437-50e6-b950-e2d5ea7111b4/e245170a-a437-50e6-b950-e2d5ea7111b4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2585%252F20452585%252Finterior_front_seats-1774628915886.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2585/20452585/interior_front_seats-1774628915886.jpg saved to cache
2026-03-29 20:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e245170a-a437-50e6-b950-e2d5ea7111b4
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad37990>
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e245170a-a437-50e6-b950-e2d5ea7111b4/e245170a-a437-50e6-b950-e2d5ea7111b4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2585%252F20452585%252Finstrument_cluster-1774526553224.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2585/20452585/instrument_cluster-1774526553224.jpg saved to cache
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e245170a-a437-50e6-b950-e2d5ea7111b4
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fade4390>
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e45473-729a-5da6-8af3-38b669b6016f/f3e45473-729a-5da6-8af3-38b669b6016f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0929%252F20100929%252Fexterior_front_passenger-1774711137606.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0929/20100929/exterior_front_passenger-1774711137606.jpg saved to cache
2026-03-29 20:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3e45473-729a-5da6-8af3-38b669b6016f
2026-03-29 20:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7c2a43f2-994a-5124-88aa-9116d0db9f4c with identifier: 19182939
2026-03-29 20:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7c2a43f2-994a-5124-88aa-9116d0db9f4c with identifier: 19182939
2026-03-29 20:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7c2a43f2-994a-5124-88aa-9116d0db9f4c with identifier: 19182939 to the API
2026-03-29 20:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_front_passenger-1774783422741.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '7c2a43f2-994a-5124-88aa-9116d0db9f4c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MK62 YHM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19182939',
'listing': 'auction',
'location': 'Cambridgeshire Ely',
'make': 'Land Rover',
'model': 'Freelander',
'odometer': 110000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1758495,
'Height': 3007,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_front_driver-1774783344027.jpeg',
'Width': 4009},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1609644,
'Height': 3023,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_rear_driver-1774783280769.jpeg',
'Width': 4031},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1421480,
'Height': 2769,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_front_passenger-1774783422741.jpeg',
'Width': 3692},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1488528,
'Height': 2686,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2939/19182939/exterior_rear_passenger-1774783458171.jpeg',
'Width': 3581},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328067,
'Height': 1045,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2939/19182939/19182939-interior_front_seats-modified-1774785905663.jpeg',
'Width': 1394},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2735658,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2939/19182939/interior_rear_seats-1774783594687.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3235908,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2939/19182939/interior_dashboard-1774783632887.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2871454,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2939/19182939/interior_boot-1774783645175.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1418436,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2939/19182939/docs_service_history-1774785097836.jpeg?ixlib=js-3.8.0&auto=format&s=1831449aca5f733c4e0574d5bd9d9a0e',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2a43f2-994a-5124-88aa-9116d0db9f4c/7c2a43f2-994a-5124-88aa-9116d0db9f4c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1514489,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2939/19182939/docs_service_history-1774785148617.jpeg?ixlib=js-3.8.0&auto=format&s=ae17a981af515f95c8f0cf44f1a503fd',
'Width': 4032}],
'price': 3524,
'price_includes_vat': False,
'registration_date': '2012-09-04',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Freelander GS TD4',
'transmission': 'manual',
'trim': 'GS TD4',
'vin': 'SALFA2CC3CH295165',
'year': 2012}
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719182939%27 HTTP/1.1" 200 None
2026-03-29 20:09:47 [motorway.uk] INFO: Saving data for 19182939: {'created_time': 1774814987.59467, 'last_price_update_time': 1774814987.594679, 'auction_closing_time': 1774884600.0}
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19182939') HTTP/1.1" 204 0
2026-03-29 20:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13582416.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05baa477-55ee-5c83-9e90-fff30edbd6fd with identifier: 20485662
2026-03-29 20:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05baa477-55ee-5c83-9e90-fff30edbd6fd with scrape type 1
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05baa477-55ee-5c83-9e90-fff30edbd6fd
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5662%252F20485662%252Fexterior_front_driver-1774695403569.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5662/20485662/exterior_front_driver-1774695403569.jpg not downloaded yet
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5662%252F20485662%252Fexterior_rear_driver-1774695426141.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5662/20485662/exterior_rear_driver-1774695426141.jpg not downloaded yet
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5662%252F20485662%252Fexterior_front_passenger-1774695443577.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5662/20485662/exterior_front_passenger-1774695443577.jpg not downloaded yet
2026-03-29 20:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0929/20100929/docs_service_history-1774704417943.jpg?ixlib=js-3.8.0&auto=format&s=11300e9a3816557d44bb749ee6e10d5b> (referer: None)
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5662%252F20485662%252Fexterior_rear_passenger-1774695433236.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5662/20485662/exterior_rear_passenger-1774695433236.jpg not downloaded yet
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5662%252F20485662%252Finterior_front_seats-1774695692655.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5662/20485662/interior_front_seats-1774695692655.jpg not downloaded yet
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5662%252F20485662%252Finterior_rear_seats-1774695706503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5662/20485662/interior_rear_seats-1774695706503.jpg not downloaded yet
2026-03-29 20:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1630edb4-71a2-5845-9277-3241531c9e60 with identifier: 13582416
2026-03-29 20:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1630edb4-71a2-5845-9277-3241531c9e60 with scrape type 1
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1630edb4-71a2-5845-9277-3241531c9e60
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2416%252F13582416%252Fexterior_front_driver-1774633664706.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2416/13582416/exterior_front_driver-1774633664706.jpeg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5662%252F20485662%252Finterior_dashboard-1774696503688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5662/20485662/interior_dashboard-1774696503688.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2416%252F13582416%252Fexterior_rear_driver-1774633707195.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2416/13582416/exterior_rear_driver-1774633707195.jpeg not downloaded yet
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20245213.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20476933.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5662%252F20485662%252Finterior_boot-1774695757753.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5662/20485662/interior_boot-1774695757753.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2416%252F13582416%252Fexterior_front_passenger-1774633679870.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2416/13582416/exterior_front_passenger-1774633679870.jpeg not downloaded yet
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f926a590>
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e45473-729a-5da6-8af3-38b669b6016f/f3e45473-729a-5da6-8af3-38b669b6016f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0929%252F20100929%252Fdocs_service_history-1774704417943.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D11300e9a3816557d44bb749ee6e10d5b') HTTP/1.1" 204 0
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0929/20100929/docs_service_history-1774704417943.jpg?ixlib=js-3.8.0&auto=format&s=11300e9a3816557d44bb749ee6e10d5b saved to cache
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3e45473-729a-5da6-8af3-38b669b6016f
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5662%252F20485662%252Fdocs_service_history-1774695920666.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbea4c91e4b8c08d2ab251e1273d7fe21%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5662/20485662/docs_service_history-1774695920666.jpg?ixlib=js-3.8.0&auto=format&s=bea4c91e4b8c08d2ab251e1273d7fe21 not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2416%252F13582416%252Fexterior_rear_passenger-1774633690799.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2416/13582416/exterior_rear_passenger-1774633690799.jpeg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5662%252F20485662%252Fdocs_service_history-1774695920724.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4f51ef66a4af60a53f40e1f4a6bd3dc7%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5662/20485662/docs_service_history-1774695920724.jpg?ixlib=js-3.8.0&auto=format&s=4f51ef66a4af60a53f40e1f4a6bd3dc7 not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2416%252F13582416%252Finterior_front_seats-1774633892391.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2416/13582416/interior_front_seats-1774633892391.jpeg not downloaded yet
2026-03-29 20:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c552c188-0746-58bd-9f27-56d333e57e7f with identifier: 20245213
2026-03-29 20:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c552c188-0746-58bd-9f27-56d333e57e7f with scrape type 1
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c552c188-0746-58bd-9f27-56d333e57e7f
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5213%252F20245213%252Fexterior_front_driver-1774775821514.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5213/20245213/exterior_front_driver-1774775821514.jpg not downloaded yet
2026-03-29 20:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81ff9fb9-0a50-5799-85d3-48b2e1de778a with identifier: 20476933
2026-03-29 20:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81ff9fb9-0a50-5799-85d3-48b2e1de778a with scrape type 1
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81ff9fb9-0a50-5799-85d3-48b2e1de778a
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6933%252F20476933%252Fexterior_front_driver-1774698795941.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6933/20476933/exterior_front_driver-1774698795941.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2416%252F13582416%252Finterior_rear_seats-1774633933090.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2416/13582416/interior_rear_seats-1774633933090.jpeg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5213%252F20245213%252Fexterior_rear_driver-1774715364082.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5213/20245213/exterior_rear_driver-1774715364082.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6933%252F20476933%252Fexterior_rear_driver-1774699986801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6933/20476933/exterior_rear_driver-1774699986801.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2416%252F13582416%252Finterior_dashboard-1774633984934.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2416/13582416/interior_dashboard-1774633984934.jpeg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5213%252F20245213%252Fexterior_front_passenger-1774715645338.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5213/20245213/exterior_front_passenger-1774715645338.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6933%252F20476933%252Fexterior_front_passenger-1774705161550.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6933/20476933/exterior_front_passenger-1774705161550.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2416%252F13582416%252Finstrument_cluster-1774634050368.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2416/13582416/instrument_cluster-1774634050368.jpeg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5213%252F20245213%252Fexterior_rear_passenger-1774715602107.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5213/20245213/exterior_rear_passenger-1774715602107.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6933%252F20476933%252Fexterior_rear_passenger-1774705171926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6933/20476933/exterior_rear_passenger-1774705171926.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2416%252F13582416%252Finterior_boot-1774633971550.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2416/13582416/interior_boot-1774633971550.jpeg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5213%252F20245213%252Finterior_front_seats-1774716391309.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5213/20245213/interior_front_seats-1774716391309.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6933%252F20476933%252Finterior_front_seats-1774700233816.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6933/20476933/interior_front_seats-1774700233816.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2416%252F13582416%252F13582416-docs_service_history-default-1774633439980.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7eec0b2ba79492623dc00009dde32b81%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2416/13582416/13582416-docs_service_history-default-1774633439980.jpg?ixlib=js-3.8.0&auto=format&s=7eec0b2ba79492623dc00009dde32b81 not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5213%252F20245213%252Finterior_rear_seats-1774716455408.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5213/20245213/interior_rear_seats-1774716455408.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6933%252F20476933%252Finterior_rear_seats-1774706712528.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6933/20476933/interior_rear_seats-1774706712528.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5213%252F20245213%252Finterior_dashboard-1774775987866.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5213/20245213/interior_dashboard-1774775987866.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6933%252F20476933%252Finterior_dashboard-1774770768163.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6933/20476933/interior_dashboard-1774770768163.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5213%252F20245213%252Finstrument_cluster-1774716461824.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5213/20245213/instrument_cluster-1774716461824.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6933%252F20476933%252Finstrument_cluster-1774700131914.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6933/20476933/instrument_cluster-1774700131914.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5213%252F20245213%252Finterior_boot-1774716568080.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5213/20245213/interior_boot-1774716568080.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6933%252F20476933%252Finterior_boot-1774706771156.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6933/20476933/interior_boot-1774706771156.jpg not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5213%252F20245213%252Fdocs_service_history-1774717667345.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7847b528e2940616073f54c7c12886fd%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5213/20245213/docs_service_history-1774717667345.jpg?ixlib=js-3.8.0&auto=format&s=7847b528e2940616073f54c7c12886fd not downloaded yet
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6933%252F20476933%252Fdamage_scratches-1774698799718.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6933/20476933/damage_scratches-1774698799718.jpg not downloaded yet
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2609/19752609/docs_service_history-1774708736615.jpg?ixlib=js-3.8.0&auto=format&s=1c344ada6b1aeef1447fd5f1bc9a578e> (referer: None)
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5662/20485662/exterior_front_passenger-1774695443577.jpg> (referer: None)
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0929/20100929/interior_boot-1774704073172.jpg> (referer: None)
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0929/20100929/instrument_cluster-1774704122252.jpg> (referer: None)
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0929/20100929/interior_dashboard-1774704058400.jpg> (referer: None)
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0929/20100929/interior_rear_seats-1774704025533.jpg> (referer: None)
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2609/19752609/interior_boot-1774598788818.jpg> (referer: None)
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2609/19752609/interior_dashboard-1774598606048.jpg> (referer: None)
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2609/19752609/interior_rear_seats-1774598583193.jpg> (referer: None)
2026-03-29 20:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5662/20485662/interior_dashboard-1774696503688.jpg> (referer: None)
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae81c50>
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c23fb3d-8731-540e-8faf-d10af84f554a/7c23fb3d-8731-540e-8faf-d10af84f554a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2609%252F19752609%252Fdocs_service_history-1774708736615.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1c344ada6b1aeef1447fd5f1bc9a578e') HTTP/1.1" 204 0
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2609/19752609/docs_service_history-1774708736615.jpg?ixlib=js-3.8.0&auto=format&s=1c344ada6b1aeef1447fd5f1bc9a578e saved to cache
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c23fb3d-8731-540e-8faf-d10af84f554a
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95a9390>
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05baa477-55ee-5c83-9e90-fff30edbd6fd/05baa477-55ee-5c83-9e90-fff30edbd6fd_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5662%252F20485662%252Fexterior_front_passenger-1774695443577.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5662/20485662/exterior_front_passenger-1774695443577.jpg saved to cache
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05baa477-55ee-5c83-9e90-fff30edbd6fd
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb3d50>
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e45473-729a-5da6-8af3-38b669b6016f/f3e45473-729a-5da6-8af3-38b669b6016f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0929%252F20100929%252Finterior_boot-1774704073172.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0929/20100929/interior_boot-1774704073172.jpg saved to cache
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3e45473-729a-5da6-8af3-38b669b6016f
2026-03-29 20:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2416/13582416/exterior_rear_driver-1774633707195.jpeg> (referer: None)
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fafb03d0>
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e45473-729a-5da6-8af3-38b669b6016f/f3e45473-729a-5da6-8af3-38b669b6016f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0929%252F20100929%252Finstrument_cluster-1774704122252.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0929/20100929/instrument_cluster-1774704122252.jpg saved to cache
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3e45473-729a-5da6-8af3-38b669b6016f
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa013590>
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e45473-729a-5da6-8af3-38b669b6016f/f3e45473-729a-5da6-8af3-38b669b6016f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0929%252F20100929%252Finterior_dashboard-1774704058400.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0929/20100929/interior_dashboard-1774704058400.jpg saved to cache
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3e45473-729a-5da6-8af3-38b669b6016f
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf59450>
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3e45473-729a-5da6-8af3-38b669b6016f/f3e45473-729a-5da6-8af3-38b669b6016f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0929%252F20100929%252Finterior_rear_seats-1774704025533.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0929/20100929/interior_rear_seats-1774704025533.jpg saved to cache
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3e45473-729a-5da6-8af3-38b669b6016f
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85de290>
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c23fb3d-8731-540e-8faf-d10af84f554a/7c23fb3d-8731-540e-8faf-d10af84f554a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2609%252F19752609%252Finterior_boot-1774598788818.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2609/19752609/interior_boot-1774598788818.jpg saved to cache
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c23fb3d-8731-540e-8faf-d10af84f554a
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebbdcfd0>
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c23fb3d-8731-540e-8faf-d10af84f554a/7c23fb3d-8731-540e-8faf-d10af84f554a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2609%252F19752609%252Finterior_dashboard-1774598606048.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2609/19752609/interior_dashboard-1774598606048.jpg saved to cache
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c23fb3d-8731-540e-8faf-d10af84f554a
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85de9d0>
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c23fb3d-8731-540e-8faf-d10af84f554a/7c23fb3d-8731-540e-8faf-d10af84f554a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2609%252F19752609%252Finterior_rear_seats-1774598583193.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2609/19752609/interior_rear_seats-1774598583193.jpg saved to cache
2026-03-29 20:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c23fb3d-8731-540e-8faf-d10af84f554a
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f85df010>
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05baa477-55ee-5c83-9e90-fff30edbd6fd/05baa477-55ee-5c83-9e90-fff30edbd6fd_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5662%252F20485662%252Finterior_dashboard-1774696503688.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5662/20485662/interior_dashboard-1774696503688.jpg saved to cache
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05baa477-55ee-5c83-9e90-fff30edbd6fd
2026-03-29 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1764&page=49&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf5b010>
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1630edb4-71a2-5845-9277-3241531c9e60/1630edb4-71a2-5845-9277-3241531c9e60_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2416%252F13582416%252Fexterior_rear_driver-1774633707195.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2416/13582416/exterior_rear_driver-1774633707195.jpeg saved to cache
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1630edb4-71a2-5845-9277-3241531c9e60
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 8578317
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 19824079
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719824079%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [motorway.uk] INFO: Scrape type for 19824079: 2
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 19829498
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20487631
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20419362
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20488089
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 19636358
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20488455
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488455%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [motorway.uk] INFO: Scrape type for 20488455: 1
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20418259
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720418259%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [motorway.uk] INFO: Scrape type for 20418259: 1
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20381652
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720381652%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [motorway.uk] INFO: Scrape type for 20381652: 1
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 2896184
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20043341
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 19364610
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 17969883
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 18144645
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 18778922
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 19235717
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 19262827
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719262827%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [motorway.uk] INFO: Scrape type for 19262827: 1
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 19938992
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20450000
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20501873
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20412901
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20388002
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20143003
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20488215
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 17070613
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 19820283
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20452595
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 19130680
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719130680%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [motorway.uk] INFO: Scrape type for 19130680: 1
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20491315
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 18265722
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 18293404
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 5296288
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20200708
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20488052
2026-03-29 20:09:50 [motorway.uk] INFO: Found listing with ID: 20489099
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489099%27 HTTP/1.1" 200 None
2026-03-29 20:09:50 [motorway.uk] INFO: Scrape type for 20489099: 1
2026-03-29 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5213/20245213/docs_service_history-1774717667345.jpg?ixlib=js-3.8.0&auto=format&s=7847b528e2940616073f54c7c12886fd> (referer: None)
2026-03-29 20:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2416/13582416/13582416-docs_service_history-default-1774633439980.jpg?ixlib=js-3.8.0&auto=format&s=7eec0b2ba79492623dc00009dde32b81> (referer: None)
2026-03-29 20:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2609/19752609/instrument_cluster-1774598674963.jpg> (referer: None)
2026-03-29 20:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8cf9f10>
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c552c188-0746-58bd-9f27-56d333e57e7f/c552c188-0746-58bd-9f27-56d333e57e7f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5213%252F20245213%252Fdocs_service_history-1774717667345.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7847b528e2940616073f54c7c12886fd') HTTP/1.1" 204 0
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5213/20245213/docs_service_history-1774717667345.jpg?ixlib=js-3.8.0&auto=format&s=7847b528e2940616073f54c7c12886fd saved to cache
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c552c188-0746-58bd-9f27-56d333e57e7f
2026-03-29 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6933/20476933/interior_dashboard-1774770768163.jpg> (referer: None)
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa17550>
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1630edb4-71a2-5845-9277-3241531c9e60/1630edb4-71a2-5845-9277-3241531c9e60_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2416%252F13582416%252F13582416-docs_service_history-default-1774633439980.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7eec0b2ba79492623dc00009dde32b81') HTTP/1.1" 204 0
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2416/13582416/13582416-docs_service_history-default-1774633439980.jpg?ixlib=js-3.8.0&auto=format&s=7eec0b2ba79492623dc00009dde32b81 saved to cache
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1630edb4-71a2-5845-9277-3241531c9e60
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f938ef50>
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c23fb3d-8731-540e-8faf-d10af84f554a/7c23fb3d-8731-540e-8faf-d10af84f554a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2609%252F19752609%252Finstrument_cluster-1774598674963.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2609/19752609/instrument_cluster-1774598674963.jpg saved to cache
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c23fb3d-8731-540e-8faf-d10af84f554a
2026-03-29 20:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6933/20476933/interior_boot-1774706771156.jpg> (referer: None)
2026-03-29 20:09:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89db010>
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81ff9fb9-0a50-5799-85d3-48b2e1de778a/81ff9fb9-0a50-5799-85d3-48b2e1de778a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6933%252F20476933%252Finterior_dashboard-1774770768163.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6933/20476933/interior_dashboard-1774770768163.jpg saved to cache
2026-03-29 20:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81ff9fb9-0a50-5799-85d3-48b2e1de778a
2026-03-29 20:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6933/20476933/interior_rear_seats-1774706712528.jpg> (referer: None)
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x90\t\x00\x00'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 14:05:30\x00'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:09:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9446e10>
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81ff9fb9-0a50-5799-85d3-48b2e1de778a/81ff9fb9-0a50-5799-85d3-48b2e1de778a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6933%252F20476933%252Finterior_boot-1774706771156.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6933/20476933/interior_boot-1774706771156.jpg saved to cache
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81ff9fb9-0a50-5799-85d3-48b2e1de778a
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x90\t\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 14:04:51\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa010510>
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81ff9fb9-0a50-5799-85d3-48b2e1de778a/81ff9fb9-0a50-5799-85d3-48b2e1de778a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6933%252F20476933%252Finterior_rear_seats-1774706712528.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6933/20476933/interior_rear_seats-1774706712528.jpg saved to cache
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81ff9fb9-0a50-5799-85d3-48b2e1de778a
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20452615.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5213/20245213/interior_dashboard-1774775987866.jpg> (referer: None)
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5213/20245213/interior_boot-1774716568080.jpg> (referer: None)
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6933/20476933/instrument_cluster-1774700131914.jpg> (referer: None)
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6933/20476933/interior_front_seats-1774700233816.jpg> (referer: None)
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6933/20476933/damage_scratches-1774698799718.jpg> (referer: None)
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5213/20245213/interior_rear_seats-1774716455408.jpg> (referer: None)
2026-03-29 20:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5213/20245213/instrument_cluster-1774716461824.jpg> (referer: None)
2026-03-29 20:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4794874f-d70c-5698-a6a0-12ec2ee74cf8 with identifier: 20452615
2026-03-29 20:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4794874f-d70c-5698-a6a0-12ec2ee74cf8 with scrape type 1
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4794874f-d70c-5698-a6a0-12ec2ee74cf8
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2615%252F20452615%252Fexterior_front_driver-1774719809395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2615/20452615/exterior_front_driver-1774719809395.jpg not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2615%252F20452615%252Fexterior_rear_driver-1774719831076.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2615/20452615/exterior_rear_driver-1774719831076.jpg not downloaded yet
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2615%252F20452615%252Fexterior_front_passenger-1774719857727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2615/20452615/exterior_front_passenger-1774719857727.jpg not downloaded yet
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f89d91d0>
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c552c188-0746-58bd-9f27-56d333e57e7f/c552c188-0746-58bd-9f27-56d333e57e7f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5213%252F20245213%252Finterior_dashboard-1774775987866.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5213/20245213/interior_dashboard-1774775987866.jpg saved to cache
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c552c188-0746-58bd-9f27-56d333e57e7f
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8867e90>
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c552c188-0746-58bd-9f27-56d333e57e7f/c552c188-0746-58bd-9f27-56d333e57e7f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5213%252F20245213%252Finterior_boot-1774716568080.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5213/20245213/interior_boot-1774716568080.jpg saved to cache
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c552c188-0746-58bd-9f27-56d333e57e7f
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x90\t\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 12:11:35\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f924ec10>
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81ff9fb9-0a50-5799-85d3-48b2e1de778a/81ff9fb9-0a50-5799-85d3-48b2e1de778a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6933%252F20476933%252Finstrument_cluster-1774700131914.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6933/20476933/instrument_cluster-1774700131914.jpg saved to cache
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81ff9fb9-0a50-5799-85d3-48b2e1de778a
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x90\t\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 12:16:42\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fae8ef10>
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81ff9fb9-0a50-5799-85d3-48b2e1de778a/81ff9fb9-0a50-5799-85d3-48b2e1de778a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6933%252F20476933%252Finterior_front_seats-1774700233816.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6933/20476933/interior_front_seats-1774700233816.jpg saved to cache
2026-03-29 20:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81ff9fb9-0a50-5799-85d3-48b2e1de778a
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x90\t\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'motorola\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:28 11:52:49\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xc0\x0c\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:09:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fadeead0>
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81ff9fb9-0a50-5799-85d3-48b2e1de778a/81ff9fb9-0a50-5799-85d3-48b2e1de778a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6933%252F20476933%252Fdamage_scratches-1774698799718.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6933/20476933/damage_scratches-1774698799718.jpg saved to cache
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81ff9fb9-0a50-5799-85d3-48b2e1de778a
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8865890>
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c552c188-0746-58bd-9f27-56d333e57e7f/c552c188-0746-58bd-9f27-56d333e57e7f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5213%252F20245213%252Finterior_rear_seats-1774716455408.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5213/20245213/interior_rear_seats-1774716455408.jpg saved to cache
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c552c188-0746-58bd-9f27-56d333e57e7f
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2615%252F20452615%252Fexterior_rear_passenger-1774719842138.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2615/20452615/exterior_rear_passenger-1774719842138.jpg not downloaded yet
2026-03-29 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1800&page=50&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad98690>
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c552c188-0746-58bd-9f27-56d333e57e7f/c552c188-0746-58bd-9f27-56d333e57e7f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5213%252F20245213%252Finstrument_cluster-1774716461824.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5213/20245213/instrument_cluster-1774716461824.jpg saved to cache
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c552c188-0746-58bd-9f27-56d333e57e7f
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2615%252F20452615%252Finterior_front_seats-1774720317378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2615/20452615/interior_front_seats-1774720317378.jpg not downloaded yet
2026-03-29 20:09:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2615%252F20452615%252Finterior_rear_seats-1774720339758.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2615/20452615/interior_rear_seats-1774720339758.jpg not downloaded yet
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 19659206
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20486301
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486301%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [motorway.uk] INFO: Scrape type for 20486301: 1
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2615%252F20452615%252Finterior_dashboard-1774720383563.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2615/20452615/interior_dashboard-1774720383563.jpg not downloaded yet
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 13628188
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20499822
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20445729
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720445729%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [motorway.uk] INFO: Scrape type for 20445729: 1
2026-03-29 20:09:52 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (13186312) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/2416/13582416/interior_boot-1774633971550.jpeg>.
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2615%252F20452615%252Finterior_boot-1774720276429.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2615/20452615/interior_boot-1774720276429.jpg not downloaded yet
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 14604546
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20390558
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720390558%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [motorway.uk] INFO: Scrape type for 20390558: 1
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2615%252F20452615%252Fdocs_service_history-1774721627312.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8698a28b963b3418ba72cfa25d61c9a0%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2615/20452615/docs_service_history-1774721627312.jpg?ixlib=js-3.8.0&auto=format&s=8698a28b963b3418ba72cfa25d61c9a0 not downloaded yet
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 15355035
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20327715
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20153651
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 19271642
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719271642%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [motorway.uk] INFO: Scrape type for 19271642: 1
2026-03-29 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20484773.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2615%252F20452615%252Fdocs_service_history-1774721629858.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6ed2d843cdcaac53ad79ce1368f32804%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2615/20452615/docs_service_history-1774721629858.jpg?ixlib=js-3.8.0&auto=format&s=6ed2d843cdcaac53ad79ce1368f32804 not downloaded yet
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20411548
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 11207891
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20495052
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 9228073
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20303426
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20423847
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 8941905
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 13648789
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20482465
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20467456
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20495694
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 12555928
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 19119674
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20427329
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 18206476
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20489914
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20445502
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20454302
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 18721041
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 13280903
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 20417440
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 12910832
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 19849552
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 19683133
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719683133%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [motorway.uk] INFO: Scrape type for 19683133: 1
2026-03-29 20:09:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:52 [motorway.uk] INFO: Found listing with ID: 17791322
2026-03-29 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6933/20476933/exterior_rear_passenger-1774705171926.jpg> (referer: None)
2026-03-29 20:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 942511aa-5be8-572e-8b7b-7337d3e9e600 with identifier: 20484773
2026-03-29 20:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 942511aa-5be8-572e-8b7b-7337d3e9e600 with scrape type 1
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 942511aa-5be8-572e-8b7b-7337d3e9e600
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4773%252F20484773%252Fexterior_front_driver-1774692172375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4773/20484773/exterior_front_driver-1774692172375.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4773%252F20484773%252Fexterior_rear_driver-1774692226123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4773/20484773/exterior_rear_driver-1774692226123.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4773%252F20484773%252Fexterior_front_passenger-1774692279014.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4773/20484773/exterior_front_passenger-1774692279014.jpg not downloaded yet
2026-03-29 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2615/20452615/exterior_rear_passenger-1774719842138.jpg> (referer: None)
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4773%252F20484773%252Fexterior_rear_passenger-1774692246928.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4773/20484773/exterior_rear_passenger-1774692246928.jpg not downloaded yet
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad98d90>
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81ff9fb9-0a50-5799-85d3-48b2e1de778a/81ff9fb9-0a50-5799-85d3-48b2e1de778a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6933%252F20476933%252Fexterior_rear_passenger-1774705171926.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6933/20476933/exterior_rear_passenger-1774705171926.jpg saved to cache
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81ff9fb9-0a50-5799-85d3-48b2e1de778a
2026-03-29 20:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2615/20452615/exterior_front_driver-1774719809395.jpg> (referer: None)
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4773%252F20484773%252Finterior_front_seats-1774692912328.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4773/20484773/interior_front_seats-1774692912328.jpg not downloaded yet
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4773%252F20484773%252Finterior_rear_seats-1774692940527.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4773/20484773/interior_rear_seats-1774692940527.jpg not downloaded yet
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88a43d0>
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4794874f-d70c-5698-a6a0-12ec2ee74cf8/4794874f-d70c-5698-a6a0-12ec2ee74cf8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2615%252F20452615%252Fexterior_rear_passenger-1774719842138.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2615/20452615/exterior_rear_passenger-1774719842138.jpg saved to cache
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4794874f-d70c-5698-a6a0-12ec2ee74cf8
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4773%252F20484773%252Finterior_dashboard-1774692966498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4773/20484773/interior_dashboard-1774692966498.jpg not downloaded yet
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4773%252F20484773%252Finstrument_cluster-1774693011580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4773/20484773/instrument_cluster-1774693011580.jpg not downloaded yet
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f95a8450>
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4794874f-d70c-5698-a6a0-12ec2ee74cf8/4794874f-d70c-5698-a6a0-12ec2ee74cf8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2615%252F20452615%252Fexterior_front_driver-1774719809395.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2615/20452615/exterior_front_driver-1774719809395.jpg saved to cache
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4794874f-d70c-5698-a6a0-12ec2ee74cf8
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4773%252F20484773%252Finterior_boot-1774692964299.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4773/20484773/interior_boot-1774692964299.jpg not downloaded yet
2026-03-29 20:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2615/20452615/exterior_rear_driver-1774719831076.jpg> (referer: None)
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4773%252F20484773%252Fdocs_service_history-1774693150436.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D532067aa5c50952278fd645965edb63e%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4773/20484773/docs_service_history-1774693150436.jpg?ixlib=js-3.8.0&auto=format&s=532067aa5c50952278fd645965edb63e not downloaded yet
2026-03-29 20:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2615/20452615/exterior_front_passenger-1774719857727.jpg> (referer: None)
2026-03-29 20:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5213/20245213/interior_front_seats-1774716391309.jpg> (referer: None)
2026-03-29 20:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4773/20484773/exterior_front_passenger-1774692279014.jpg> (referer: None)
2026-03-29 20:09:53 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/2416/13582416/interior_boot-1774633971550.jpeg>.
2026-03-29 20:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4773/20484773/exterior_rear_passenger-1774692246928.jpg> (referer: None)
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f912cd90>
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4794874f-d70c-5698-a6a0-12ec2ee74cf8/4794874f-d70c-5698-a6a0-12ec2ee74cf8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2615%252F20452615%252Fexterior_rear_driver-1774719831076.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2615/20452615/exterior_rear_driver-1774719831076.jpg saved to cache
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4794874f-d70c-5698-a6a0-12ec2ee74cf8
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faa219d0>
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4794874f-d70c-5698-a6a0-12ec2ee74cf8/4794874f-d70c-5698-a6a0-12ec2ee74cf8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2615%252F20452615%252Fexterior_front_passenger-1774719857727.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2615/20452615/exterior_front_passenger-1774719857727.jpg saved to cache
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4794874f-d70c-5698-a6a0-12ec2ee74cf8
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86ebf07010>
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c552c188-0746-58bd-9f27-56d333e57e7f/c552c188-0746-58bd-9f27-56d333e57e7f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5213%252F20245213%252Finterior_front_seats-1774716391309.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5213/20245213/interior_front_seats-1774716391309.jpg saved to cache
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c552c188-0746-58bd-9f27-56d333e57e7f
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fab63850>
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942511aa-5be8-572e-8b7b-7337d3e9e600/942511aa-5be8-572e-8b7b-7337d3e9e600_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4773%252F20484773%252Fexterior_front_passenger-1774692279014.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4773/20484773/exterior_front_passenger-1774692279014.jpg saved to cache
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 942511aa-5be8-572e-8b7b-7337d3e9e600
2026-03-29 20:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489099.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f94c8150>
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942511aa-5be8-572e-8b7b-7337d3e9e600/942511aa-5be8-572e-8b7b-7337d3e9e600_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4773%252F20484773%252Fexterior_rear_passenger-1774692246928.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4773/20484773/exterior_rear_passenger-1774692246928.jpg saved to cache
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 942511aa-5be8-572e-8b7b-7337d3e9e600
2026-03-29 20:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d757c869-d95c-52db-b81a-901a8569b53e with identifier: 20489099
2026-03-29 20:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d757c869-d95c-52db-b81a-901a8569b53e with scrape type 1
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d757c869-d95c-52db-b81a-901a8569b53e
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9099%252F20489099%252Fexterior_front_driver-1774706125133.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9099/20489099/exterior_front_driver-1774706125133.jpg not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9099%252F20489099%252Fexterior_rear_driver-1774706156116.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9099/20489099/exterior_rear_driver-1774706156116.jpg not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9099%252F20489099%252Fexterior_front_passenger-1774706195801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9099/20489099/exterior_front_passenger-1774706195801.jpg not downloaded yet
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4773/20484773/docs_service_history-1774693150436.jpg?ixlib=js-3.8.0&auto=format&s=532067aa5c50952278fd645965edb63e> (referer: None)
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2416/13582416/interior_boot-1774633971550.jpeg> (referer: None)
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9099%252F20489099%252Fexterior_rear_passenger-1774706157589.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9099/20489099/exterior_rear_passenger-1774706157589.jpg not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9099%252F20489099%252Finterior_front_seats-1774706555864.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9099/20489099/interior_front_seats-1774706555864.jpg not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9099%252F20489099%252Finterior_rear_seats-1774706607177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9099/20489099/interior_rear_seats-1774706607177.jpg not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9099%252F20489099%252Finterior_dashboard-1774771746860.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9099/20489099/interior_dashboard-1774771746860.jpg not downloaded yet
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f88be2d0>
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942511aa-5be8-572e-8b7b-7337d3e9e600/942511aa-5be8-572e-8b7b-7337d3e9e600_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4773%252F20484773%252Fdocs_service_history-1774693150436.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D532067aa5c50952278fd645965edb63e') HTTP/1.1" 204 0
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4773/20484773/docs_service_history-1774693150436.jpg?ixlib=js-3.8.0&auto=format&s=532067aa5c50952278fd645965edb63e saved to cache
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 942511aa-5be8-572e-8b7b-7337d3e9e600
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9099%252F20489099%252Finstrument_cluster-1774706673181.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9099/20489099/instrument_cluster-1774706673181.jpg not downloaded yet
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xc1N\xdf\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07\xe6)\x00\xc1D_\x00\x00\x00\x00'
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f82d8bd0>
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1630edb4-71a2-5845-9277-3241531c9e60/1630edb4-71a2-5845-9277-3241531c9e60_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2416%252F13582416%252Finterior_boot-1774633971550.jpeg') HTTP/1.1" 204 0
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2416/13582416/interior_boot-1774633971550.jpeg saved to cache
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1630edb4-71a2-5845-9277-3241531c9e60
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9099%252F20489099%252Finterior_boot-1774706641762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9099/20489099/interior_boot-1774706641762.jpg not downloaded yet
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13914989.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9099%252F20489099%252Fdamage_paintwork-1774706237740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9099/20489099/damage_paintwork-1774706237740.jpg not downloaded yet
2026-03-29 20:09:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9099/20489099/exterior_rear_driver-1774706156116.jpg> (referer: None)
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4773/20484773/interior_boot-1774692964299.jpg> (referer: None)
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4773/20484773/instrument_cluster-1774693011580.jpg> (referer: None)
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4773/20484773/interior_front_seats-1774692912328.jpg> (referer: None)
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4773/20484773/interior_rear_seats-1774692940527.jpg> (referer: None)
2026-03-29 20:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad59e4fc-4afb-54c7-a849-32d5abae013b with identifier: 13914989
2026-03-29 20:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad59e4fc-4afb-54c7-a849-32d5abae013b with scrape type 1
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad59e4fc-4afb-54c7-a849-32d5abae013b
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4989%252F13914989%252Fexterior_front_driver-1774708385759.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4989/13914989/exterior_front_driver-1774708385759.jpg not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4989%252F13914989%252Fexterior_rear_driver-1774708380822.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4989/13914989/exterior_rear_driver-1774708380822.jpg not downloaded yet
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4989%252F13914989%252Fexterior_front_passenger-1774708382060.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4989/13914989/exterior_front_passenger-1774708382060.jpg not downloaded yet
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa1dce90>
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d757c869-d95c-52db-b81a-901a8569b53e/d757c869-d95c-52db-b81a-901a8569b53e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9099%252F20489099%252Fexterior_rear_driver-1774706156116.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9099/20489099/exterior_rear_driver-1774706156116.jpg saved to cache
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d757c869-d95c-52db-b81a-901a8569b53e
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4989%252F13914989%252Fexterior_rear_passenger-1774708383461.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4989/13914989/exterior_rear_passenger-1774708383461.jpg not downloaded yet
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20418259.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19262827.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad99a90>
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942511aa-5be8-572e-8b7b-7337d3e9e600/942511aa-5be8-572e-8b7b-7337d3e9e600_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4773%252F20484773%252Finterior_boot-1774692964299.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4773/20484773/interior_boot-1774692964299.jpg saved to cache
2026-03-29 20:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 942511aa-5be8-572e-8b7b-7337d3e9e600
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9026a10>
2026-03-29 20:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942511aa-5be8-572e-8b7b-7337d3e9e600/942511aa-5be8-572e-8b7b-7337d3e9e600_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4773%252F20484773%252Finstrument_cluster-1774693011580.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4773/20484773/instrument_cluster-1774693011580.jpg saved to cache
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 942511aa-5be8-572e-8b7b-7337d3e9e600
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faccdd50>
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942511aa-5be8-572e-8b7b-7337d3e9e600/942511aa-5be8-572e-8b7b-7337d3e9e600_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4773%252F20484773%252Finterior_front_seats-1774692912328.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4773/20484773/interior_front_seats-1774692912328.jpg saved to cache
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 942511aa-5be8-572e-8b7b-7337d3e9e600
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f9545a50>
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942511aa-5be8-572e-8b7b-7337d3e9e600/942511aa-5be8-572e-8b7b-7337d3e9e600_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4773%252F20484773%252Finterior_rear_seats-1774692940527.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4773/20484773/interior_rear_seats-1774692940527.jpg saved to cache
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 942511aa-5be8-572e-8b7b-7337d3e9e600
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4989%252F13914989%252Finterior_front_seats-1774709126152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4989/13914989/interior_front_seats-1774709126152.jpg not downloaded yet
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4989%252F13914989%252Finterior_rear_seats-1774709039737.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4989/13914989/interior_rear_seats-1774709039737.jpg not downloaded yet
2026-03-29 20:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19824079.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0394a524-9490-59e6-9744-db3451e2dc04 with identifier: 20418259
2026-03-29 20:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0394a524-9490-59e6-9744-db3451e2dc04 with scrape type 1
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0394a524-9490-59e6-9744-db3451e2dc04
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8259%252F20418259%252Fexterior_front_driver-1774609576431.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8259/20418259/exterior_front_driver-1774609576431.jpg not downloaded yet
2026-03-29 20:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2489e119-6a6c-5f5d-973a-fcf3fe8345d3 with identifier: 19262827
2026-03-29 20:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2489e119-6a6c-5f5d-973a-fcf3fe8345d3 with scrape type 1
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2489e119-6a6c-5f5d-973a-fcf3fe8345d3
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2827%252F19262827%252Fexterior_front_driver-1774779863476.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2827/19262827/exterior_front_driver-1774779863476.jpg not downloaded yet
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4989%252F13914989%252Finterior_dashboard-1774708861271.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4989/13914989/interior_dashboard-1774708861271.jpg not downloaded yet
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8259%252F20418259%252Fexterior_rear_driver-1774609616791.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8259/20418259/exterior_rear_driver-1774609616791.jpg not downloaded yet
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2827%252F19262827%252Fexterior_rear_driver-1774717634786.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2827/19262827/exterior_rear_driver-1774717634786.jpg not downloaded yet
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4989%252F13914989%252Finterior_boot-1774709041652.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4989/13914989/interior_boot-1774709041652.jpg not downloaded yet
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8259%252F20418259%252Fexterior_front_passenger-1774609569283.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8259/20418259/exterior_front_passenger-1774609569283.jpg not downloaded yet
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2827%252F19262827%252Fexterior_front_passenger-1774713202546.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2827/19262827/exterior_front_passenger-1774713202546.jpg not downloaded yet
2026-03-29 20:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19130680.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4773/20484773/interior_dashboard-1774692966498.jpg> (referer: None)
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4989%252F13914989%252Fwheels_front_driver-1774708518945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4989/13914989/wheels_front_driver-1774708518945.jpg not downloaded yet
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8259%252F20418259%252Fexterior_rear_passenger-1774609629999.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8259/20418259/exterior_rear_passenger-1774609629999.jpg not downloaded yet
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2827%252F19262827%252Fexterior_rear_passenger-1774713180917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2827/19262827/exterior_rear_passenger-1774713180917.jpg not downloaded yet
2026-03-29 20:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a9820fb-e1ba-5768-8a65-5f6ea5c43433 with identifier: 19824079
2026-03-29 20:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a9820fb-e1ba-5768-8a65-5f6ea5c43433 with scrape type 2
2026-03-29 20:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a9820fb-e1ba-5768-8a65-5f6ea5c43433 with scrape type 2
2026-03-29 20:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8a9820fb-e1ba-5768-8a65-5f6ea5c43433, identifier: 19824079
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4989%252F13914989%252Fwheels_rear_driver-1774708521403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4989/13914989/wheels_rear_driver-1774708521403.jpg not downloaded yet
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8259%252F20418259%252Finterior_front_seats-1774610490992.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8259/20418259/interior_front_seats-1774610490992.jpg not downloaded yet
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2827%252F19262827%252Finterior_front_seats-1774717784921.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2827/19262827/interior_front_seats-1774717784921.jpg not downloaded yet
2026-03-29 20:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8a9820fb-e1ba-5768-8a65-5f6ea5c43433 with identifier: 19824079
2026-03-29 20:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8a9820fb-e1ba-5768-8a65-5f6ea5c43433 with identifier: 19824079
2026-03-29 20:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8a9820fb-e1ba-5768-8a65-5f6ea5c43433 with identifier: 19824079 to the API
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19824079.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '8a9820fb-e1ba-5768-8a65-5f6ea5c43433',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV23 NBB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19824079',
'listing': 'auction',
'location': 'East Dunbartonshire Council Glasgow',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 16789,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 14325,
'price_includes_vat': False,
'registration_date': '2023-03-30',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai N-Connecta DiG-T MHEV',
'transmission': 'manual',
'trim': 'N-Connecta DiG-T MHEV',
'vin': 'SJNTAAJ12U1253595',
'year': 2023}
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719824079%27 HTTP/1.1" 200 None
2026-03-29 20:09:56 [motorway.uk] INFO: Saving data for 19824079: {'auction_closing_time': 1774884600.0, 'created_time': 1774383352.278643, 'last_price_update_time': 1774814996.627241}
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19824079') HTTP/1.1" 204 0
2026-03-29 20:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19271642.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8259%252F20418259%252Finterior_rear_seats-1774610493287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8259/20418259/interior_rear_seats-1774610493287.jpg not downloaded yet
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2827%252F19262827%252Finterior_rear_seats-1774717821526.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2827/19262827/interior_rear_seats-1774717821526.jpg not downloaded yet
2026-03-29 20:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65bae83d-a15c-5cc5-8a0b-e879c93b079c with identifier: 19130680
2026-03-29 20:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65bae83d-a15c-5cc5-8a0b-e879c93b079c with scrape type 1
2026-03-29 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65bae83d-a15c-5cc5-8a0b-e879c93b079c
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0680%252F19130680%252F19130680-exterior_front_driver-modified-1774775019127.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0680/19130680/19130680-exterior_front_driver-modified-1774775019127.jpeg not downloaded yet
2026-03-29 20:09:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86faccd150>
2026-03-29 20:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_942511aa-5be8-572e-8b7b-7337d3e9e600/942511aa-5be8-572e-8b7b-7337d3e9e600_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4773%252F20484773%252Finterior_dashboard-1774692966498.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4773/20484773/interior_dashboard-1774692966498.jpg saved to cache
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 942511aa-5be8-572e-8b7b-7337d3e9e600
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8259%252F20418259%252Finterior_dashboard-1774610520021.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8259/20418259/interior_dashboard-1774610520021.jpg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2827%252F19262827%252Finterior_dashboard-1774714047864.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2827/19262827/interior_dashboard-1774714047864.jpg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0680%252F19130680%252F19130680-exterior_rear_driver-modified-1774775041289.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0680/19130680/19130680-exterior_rear_driver-modified-1774775041289.jpeg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8259%252F20418259%252Finstrument_cluster-1774610532411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8259/20418259/instrument_cluster-1774610532411.jpg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2827%252F19262827%252Finstrument_cluster-1774714061721.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2827/19262827/instrument_cluster-1774714061721.jpg not downloaded yet
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488455.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20381652.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 442519b3-408c-5fab-9055-e07dad5ee1ce with identifier: 19271642
2026-03-29 20:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 442519b3-408c-5fab-9055-e07dad5ee1ce with scrape type 1
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 442519b3-408c-5fab-9055-e07dad5ee1ce
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1642%252F19271642%252Fexterior_front_driver-1768401344360.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1642/19271642/exterior_front_driver-1768401344360.jpg not downloaded yet
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4989/13914989/exterior_front_driver-1774708385759.jpg> (referer: None)
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0680%252F19130680%252Fexterior_front_passenger-1774716740502.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0680/19130680/exterior_front_passenger-1774716740502.jpeg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8259%252F20418259%252Finterior_boot-1774610488378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8259/20418259/interior_boot-1774610488378.jpg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2827%252F19262827%252Finterior_boot-1774714064894.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2827/19262827/interior_boot-1774714064894.jpg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1642%252F19271642%252Fexterior_rear_driver-1768401698638.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1642/19271642/exterior_rear_driver-1768401698638.jpg not downloaded yet
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4989/13914989/exterior_rear_passenger-1774708383461.jpg> (referer: None)
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0680%252F19130680%252Fexterior_rear_passenger-1774716760275.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0680/19130680/exterior_rear_passenger-1774716760275.jpeg not downloaded yet
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4989/13914989/exterior_front_passenger-1774708382060.jpg> (referer: None)
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8259%252F20418259%252Fdocs_service_history-1774610895917.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D965325180d108e6d181b34b6bbf97329%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8259/20418259/docs_service_history-1774610895917.jpg?ixlib=js-3.8.0&auto=format&s=965325180d108e6d181b34b6bbf97329 not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2827%252F19262827%252Fdocs_service_history-1774715006875.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D499c102d29af857ffd3ed34f32304ea4%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2827/19262827/docs_service_history-1774715006875.jpg?ixlib=js-3.8.0&auto=format&s=499c102d29af857ffd3ed34f32304ea4 not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1642%252F19271642%252Fexterior_front_passenger-1768401667032.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1642/19271642/exterior_front_passenger-1768401667032.jpg not downloaded yet
2026-03-29 20:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4989/13914989/exterior_rear_driver-1774708380822.jpg> (referer: None)
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0680%252F19130680%252Finterior_front_seats-1774717207736.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0680/19130680/interior_front_seats-1774717207736.jpeg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1642%252F19271642%252Fexterior_rear_passenger-1768401695415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1642/19271642/exterior_rear_passenger-1768401695415.jpg not downloaded yet
2026-03-29 20:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ead9227e-8b33-5b68-bc0b-f11f89066dcc with identifier: 20488455
2026-03-29 20:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead9227e-8b33-5b68-bc0b-f11f89066dcc with scrape type 1
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ead9227e-8b33-5b68-bc0b-f11f89066dcc
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8455%252F20488455%252Fexterior_front_driver-1774715932876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8455/20488455/exterior_front_driver-1774715932876.jpg not downloaded yet
2026-03-29 20:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d941e475-5d91-5abe-92ce-a4fc13dc83e7 with identifier: 20381652
2026-03-29 20:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d941e475-5d91-5abe-92ce-a4fc13dc83e7 with scrape type 1
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d941e475-5d91-5abe-92ce-a4fc13dc83e7
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1652%252F20381652%252Fexterior_front_driver-1774692925155.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1652/20381652/exterior_front_driver-1774692925155.jpg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0680%252F19130680%252Finterior_rear_seats-1774717314810.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0680/19130680/interior_rear_seats-1774717314810.jpeg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1642%252F19271642%252Finterior_front_seats-1768404410896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1642/19271642/interior_front_seats-1768404410896.jpg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8455%252F20488455%252Fexterior_rear_driver-1774717892678.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8455/20488455/exterior_rear_driver-1774717892678.jpg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1652%252F20381652%252Fexterior_rear_driver-1774692957969.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1652/20381652/exterior_rear_driver-1774692957969.jpg not downloaded yet
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fad0be10>
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad59e4fc-4afb-54c7-a849-32d5abae013b/ad59e4fc-4afb-54c7-a849-32d5abae013b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4989%252F13914989%252Fexterior_front_driver-1774708385759.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4989/13914989/exterior_front_driver-1774708385759.jpg saved to cache
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad59e4fc-4afb-54c7-a849-32d5abae013b
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0680%252F19130680%252F19130680-interior_dashboard-modified-1774775108452.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0680/19130680/19130680-interior_dashboard-modified-1774775108452.jpeg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1642%252F19271642%252Finterior_rear_seats-1768404412261.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1642/19271642/interior_rear_seats-1768404412261.jpg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8455%252F20488455%252Fexterior_front_passenger-1774717904481.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8455/20488455/exterior_front_passenger-1774717904481.jpg not downloaded yet
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1652%252F20381652%252Fexterior_front_passenger-1774692997860.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1652/20381652/exterior_front_passenger-1774692997860.jpg not downloaded yet
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f8a638d0>
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad59e4fc-4afb-54c7-a849-32d5abae013b/ad59e4fc-4afb-54c7-a849-32d5abae013b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4989%252F13914989%252Fexterior_rear_passenger-1774708383461.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4989/13914989/exterior_rear_passenger-1774708383461.jpg saved to cache
2026-03-29 20:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad59e4fc-4afb-54c7-a849-32d5abae013b
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86f924ed90>
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad59e4fc-4afb-54c7-a849-32d5abae013b/ad59e4fc-4afb-54c7-a849-32d5abae013b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4989%252F13914989%252Fexterior_front_passenger-1774708382060.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4989/13914989/exterior_front_passenger-1774708382060.jpg saved to cache
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad59e4fc-4afb-54c7-a849-32d5abae013b
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f86fa0a7e50>
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad59e4fc-4afb-54c7-a849-32d5abae013b/ad59e4fc-4afb-54c7-a849-32d5abae013b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4989%252F13914989%252Fexterior_rear_driver-1774708380822.jpg') HTTP/1.1" 204 0
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4989/13914989/exterior_rear_driver-1774708380822.jpg saved to cache
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad59e4fc-4afb-54c7-a849-32d5abae013b
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0680%252F19130680%252Finstrument_cluster-1774717366792.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0680/19130680/instrument_cluster-1774717366792.jpeg not downloaded yet
2026-03-29 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1836&page=51&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1642%252F19271642%252Finterior_dashboard-1768404411461.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1642/19271642/interior_dashboard-1768404411461.jpg not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8455%252F20488455%252Fexterior_rear_passenger-1774717917371.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8455/20488455/exterior_rear_passenger-1774717917371.jpg not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1652%252F20381652%252Fexterior_rear_passenger-1774692993058.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1652/20381652/exterior_rear_passenger-1774692993058.jpg not downloaded yet
2026-03-29 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9099/20489099/instrument_cluster-1774706673181.jpg> (referer: None)
2026-03-29 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4989/13914989/interior_front_seats-1774709126152.jpg> (referer: None)
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0680%252F19130680%252Finterior_boot-1774717910521.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0680/19130680/interior_boot-1774717910521.jpeg not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1642%252F19271642%252Finstrument_cluster-1768404410767.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1642/19271642/instrument_cluster-1768404410767.jpg not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8455%252F20488455%252Finterior_front_seats-1774716444268.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8455/20488455/interior_front_seats-1774716444268.jpg not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1652%252F20381652%252Finterior_front_seats-1774697126684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1652/20381652/interior_front_seats-1774697126684.jpg not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0680%252F19130680%252Fdocs_service_history-1774718823081.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dac7694983cb4c1ad513fa55f2f797180%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0680/19130680/docs_service_history-1774718823081.jpeg?ixlib=js-3.8.0&auto=format&s=ac7694983cb4c1ad513fa55f2f797180 not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1642%252F19271642%252Finterior_boot-1768404412257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1642/19271642/interior_boot-1768404412257.jpg not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8455%252F20488455%252Finterior_rear_seats-1774716570952.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8455/20488455/interior_rear_seats-1774716570952.jpg not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1652%252F20381652%252Finterior_rear_seats-1774697246364.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1652/20381652/interior_rear_seats-1774697246364.jpg not downloaded yet
2026-03-29 20:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9099/20489099/damage_paintwork-1774706237740.jpg> (referer: None)
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F1642%252F19271642%252Fdocs_service_history-1768485119239.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D592a1309a7ae909549a6d6f90b75a524%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/1642/19271642/docs_service_history-1768485119239.jpg?ixlib=js-3.8.0&auto=format&s=592a1309a7ae909549a6d6f90b75a524 not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8455%252F20488455%252Finterior_dashboard-1774717928498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8455/20488455/interior_dashboard-1774717928498.jpg not downloaded yet
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1652%252F20381652%252Finterior_dashboard-1774697235035.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1652/20381652/interior_dashboard-1774697235035.jpg not downloaded yet
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 9487324
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 19865604
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 18686856
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 10791383
2026-03-29 20:09:58 [motorway.uk] INFO: Found listing with ID: 20478477
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720478477%27 HTTP/1.1" 200 None
2026-03-29 20:09:58 [motorway.uk] INFO: Scrape type for 20478477: 1
2026-03-29 20:09:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:09:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:09:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:09:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f87010dbb90>
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d757c869-d95c-52db-b81a-901a8569b53e/d757c869-d95c-52db-b81a-901a8569b53e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9099%252F20489099%252Finstrument_cluster-1774706673181.jpg') HTTP/1.1"